+--------------------------------------------------------------+---------------+---------------+---------------+-----------------------+------------------------+ | Test Case | 2202.0-9 | 2202.0-10 | 2206.0-10 | 2202.0-10 vs 2202.0-9 | 2206.0-10 vs 2202.0-10 | +--------------------------------------------------------------+---------------+---------------+---------------+-----------------------+------------------------+ | 64b-4t2c-eth-l2xcbase-eth-2memif-1dcr | 30.22 +- 0.07 | 25.05 +- 0.05 | 27.73 +- 0.21 | -17.09 +- 0.26 | +10.69 +- 0.87 | | 78b-4t2c-af-xdp-ethip6-ip6scale20k | 2.01 +- 0.03 | 1.63 +- 0.02 | 1.8 +- 0.01 | -19.11 +- 1.56 | +10.66 +- 1.64 | | 64b-4t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 17.03 +- 0.07 | 14.26 +- 0.01 | 15.77 +- 0.08 | -16.26 +- 0.35 | +10.56 +- 0.6 | | 64b-4t2c-ethip4-ip4base-eth-2memif-1dcr | 21.01 +- 0.07 | 17.09 +- 0.02 | 18.77 +- 0.11 | -18.64 +- 0.29 | +9.81 +- 0.63 | | 64b-4t2c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 22.69 +- 0.06 | 18.64 +- 0.01 | 20.42 +- 0.16 | -17.82 +- 0.23 | +9.52 +- 0.84 | | 64b-4t2c-avf-ethip4udp-ip4base-h65536-p63-s4128768-cps | 5.95 +- 0.24 | 6.52 +- 0.3 | 6.88 +- 0.3 | +9.62 +- 6.79 | +5.49 +- 6.74 | | 64b-4t2c-eth-l2bdscale100kmaclrn | 36.57 +- 0.05 | 31.17 +- 0.08 | 32.75 +- 0.05 | -14.75 +- 0.25 | +5.06 +- 0.32 | | 64b-4t2c-af-xdp-ethip4-ip4base | 3.02 +- 0.04 | 2.18 +- 0.01 | 2.28 +- 0.24 | -27.77 +- 0.97 | +4.72 +- 10.89 | | 64b-4t2c-eth-l2bdscale1mmaclrn | 34.31 +- 0.04 | 28.17 +- 0.07 | 29.29 +- 0.04 | -17.91 +- 0.23 | +3.98 +- 0.31 | | 64b-4t2c-ethip4-ip4scale20k | 36.47 +- 0.23 | 35.39 +- 0.06 | 36.49 +- 0.07 | -2.96 +- 0.64 | +3.1 +- 0.27 | | 78b-4t2c-ethip6-ip6scale20k | 34.13 +- 0.03 | 28.81 +- 0.19 | 29.69 +- 0.12 | -15.6 +- 0.55 | +3.07 +- 0.79 | | 64b-4t2c-avf-ethip4udp-ip4base-h16384-p63-s1032192-cps | 5.86 +- 0.28 | 6.59 +- 0.18 | 6.75 +- 0.37 | +12.51 +- 6.24 | +2.49 +- 6.3 | | 64b-4t2c-ethip4-ip4scale20k-rnd | 36.19 +- 0.2 | 34.95 +- 0.04 | 35.81 +- 0.08 | -3.41 +- 0.54 | +2.46 +- 0.27 | | 64b-4t2c-eth-l2patch | 31.02 +- 0.21 | 32.66 +- 0.24 | 33.36 +- 0.2 | +5.31 +- 1.07 | +2.14 +- 0.98 | | 78b-4t2c-ethip6-ip6scale20k-rnd | 34.36 +- 0.03 | 29.3 +- 0.04 | 29.77 +- 0.06 | -14.74 +- 0.14 | +1.61 +- 0.26 | | 64b-4t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 18.39 +- 0.07 | 14.99 +- 0.05 | 15.22 +- 0.19 | -18.49 +- 0.42 | +1.59 +- 1.3 | | 78b-4t2c-ethip6-ip6base | 36.14 +- 0.11 | 34.73 +- 0.04 | 35.21 +- 0.02 | -3.91 +- 0.31 | +1.39 +- 0.14 | | 78b-4t2c-avf-ethip6-ip6scale2m | 27.52 +- 0.11 | 21.92 +- 0.1 | 22.15 +- 0.09 | -20.36 +- 0.48 | +1.07 +- 0.61 | | 64b-4t2c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 26.94 +- 0.63 | 22.12 +- 0.31 | 22.34 +- 0.28 | -17.89 +- 2.24 | +1.0 +- 1.91 | | 64b-4t2c-avf-eth-l2patch | 30.49 +- 0.21 | 31.62 +- 0.34 | 31.93 +- 0.38 | +3.71 +- 1.31 | +0.98 +- 1.61 | | 64b-4t2c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 19.95 +- 0.1 | 17.12 +- 0.06 | 17.29 +- 0.08 | -14.16 +- 0.52 | +0.95 +- 0.57 | | 64b-4t2c-avf-ethip4tcp-ip4base-h16384-p63-s1032192-cps | 2.7 +- 0.01 | 3.37 +- 0.01 | 3.4 +- 0.01 | +25.08 +- 0.52 | +0.93 +- 0.41 | | 64b-4t2c-avf-ethip4tcp-ip4base-h65536-p63-s4128768-cps | 2.42 +- 0.0 | 3.2 +- 0.01 | 3.23 +- 0.0 | +32.31 +- 0.26 | +0.89 +- 0.19 | | 64b-4t2c-avf-eth-l2bdscale10kmaclrn | 35.99 +- 0.15 | 36.7 +- 0.05 | 36.95 +- 0.1 | +1.97 +- 0.45 | +0.7 +- 0.3 | | 64b-4t2c-eth-l2bdbasemaclrn | 36.23 +- 0.05 | 36.11 +- 0.06 | 36.34 +- 0.09 | -0.31 +- 0.2 | +0.62 +- 0.3 | | 78b-4t2c-avf-ethip6-ip6base | 36.05 +- 0.11 | 36.93 +- 0.11 | 37.14 +- 0.06 | +2.44 +- 0.43 | +0.56 +- 0.33 | | 64b-4t2c-eth-l2bdscale10kmaclrn | 36.17 +- 0.24 | 34.65 +- 0.14 | 34.83 +- 0.24 | -4.21 +- 0.74 | +0.53 +- 0.79 | | 64b-4t2c-ethip4-ip4base | 36.49 +- 0.09 | 36.57 +- 0.03 | 36.76 +- 0.04 | +0.21 +- 0.26 | +0.52 +- 0.14 | | 64b-4t2c-avf-ethip4tcp-ip4base-h1024-p63-s64512-cps | 2.37 +- 0.06 | 2.91 +- 0.08 | 2.93 +- 0.07 | +22.97 +- 4.69 | +0.47 +- 3.71 | | 64b-4t2c-avf-eth-l2bdbasemaclrn | 35.14 +- 0.1 | 36.51 +- 0.1 | 36.64 +- 0.13 | +3.9 +- 0.42 | +0.36 +- 0.45 | | 64b-4t2c-avf-eth-l2xcbase-eth-2memif-1dcr | 37.32 +- 0.03 | 33.98 +- 0.08 | 34.11 +- 0.18 | -8.95 +- 0.23 | +0.36 +- 0.59 | | 64b-4t2c-avf-ethip4-ip4scale20k-rnd | 36.07 +- 0.11 | 36.8 +- 0.12 | 36.92 +- 0.13 | +2.0 +- 0.45 | +0.33 +- 0.49 | | 64b-4t2c-avf-ethip4--ethip4udpgeneve-16tun-ip4base | 24.77 +- 0.17 | 18.83 +- 0.06 | 18.88 +- 0.08 | -23.99 +- 0.58 | +0.28 +- 0.52 | | 64b-4t2c-avf-ethip4-ip4scale20k | 36.18 +- 0.11 | 36.8 +- 0.09 | 36.89 +- 0.05 | +1.7 +- 0.39 | +0.26 +- 0.29 | | 64b-4t2c-avf-eth-l2xcbase | 33.13 +- 0.52 | 34.53 +- 0.24 | 34.62 +- 0.27 | +4.23 +- 1.79 | +0.26 +- 1.04 | | 64b-4t2c-eth-l2xcbase | 34.27 +- 0.28 | 35.72 +- 0.08 | 35.78 +- 0.14 | +4.23 +- 0.89 | +0.18 +- 0.44 | | 64b-4t2c-avf-ethip4-ip4scale200k-rnd | 36.32 +- 0.29 | 36.95 +- 0.16 | 37.02 +- 0.14 | +1.72 +- 0.92 | +0.18 +- 0.57 | | 64b-4t2c-avf-ethip4-ip4scale200k | 36.47 +- 0.3 | 36.9 +- 0.17 | 36.93 +- 0.12 | +1.19 +- 0.95 | +0.08 +- 0.56 | | 64b-4t2c-avf-eth-l2bdscale100kmaclrn | 36.85 +- 0.14 | 37.35 +- 0.03 | 37.34 +- 0.02 | +1.35 +- 0.41 | -0.03 +- 0.1 | | 64b-4t2c-avf-ethip4udp-ip4base-h1024-p63-s64512-cps | 5.64 +- 0.36 | 6.11 +- 0.17 | 6.11 +- 0.17 | +8.36 +- 7.46 | -0.03 +- 3.97 | | 64b-4t2c-avf-ethip4--ethip4udpgeneve-1tun-ip4base | 27.36 +- 0.09 | 21.72 +- 0.12 | 21.69 +- 0.07 | -20.6 +- 0.51 | -0.12 +- 0.64 | | 64b-4t2c-avf-ethip4-ip4scale2m | 36.86 +- 0.04 | 37.37 +- 0.02 | 37.31 +- 0.03 | +1.36 +- 0.13 | -0.15 +- 0.1 | | 64b-4t2c-avf-ethip4--ethip4udpgeneve-4tun-ip4base | 24.77 +- 0.16 | 19.03 +- 0.11 | 19.0 +- 0.08 | -23.18 +- 0.66 | -0.16 +- 0.72 | | 64b-4t2c-avf-ethip4-ip4base | 35.64 +- 0.34 | 36.64 +- 0.11 | 36.58 +- 0.06 | +2.81 +- 1.03 | -0.17 +- 0.33 | | 64b-4t2c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 20.29 +- 0.01 | 18.66 +- 0.01 | 18.63 +- 0.01 | -8.04 +- 0.07 | -0.18 +- 0.1 | | 64b-4t2c-avf-ethip4--ethip4udpgeneve-256tun-ip4base | 24.2 +- 0.09 | 18.51 +- 0.13 | 18.47 +- 0.11 | -23.51 +- 0.62 | -0.2 +- 0.91 | | 64b-4t2c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 18.71 +- 0.02 | 16.43 +- 0.02 | 16.35 +- 0.03 | -12.2 +- 0.15 | -0.44 +- 0.2 | | 64b-4t2c-avf-ethip4--ethip4udpgeneve-64tun-ip4base | 24.45 +- 0.2 | 18.63 +- 0.08 | 18.55 +- 0.06 | -23.79 +- 0.71 | -0.45 +- 0.55 | | 64b-4t2c-avf-ethip4-ip4scale2m-rnd | 37.31 +- 0.06 | 34.91 +- 0.06 | 34.73 +- 0.08 | -6.44 +- 0.22 | -0.51 +- 0.28 | | 78b-4t2c-avf-ethip6-ip6scale2m-rnd | 22.32 +- 0.09 | 20.1 +- 0.03 | 19.93 +- 0.03 | -9.97 +- 0.38 | -0.83 +- 0.21 | | 64b-4t2c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 25.09 +- 0.04 | 20.62 +- 0.04 | 20.44 +- 0.03 | -17.82 +- 0.19 | -0.9 +- 0.23 | | 78b-4t2c-avf-ethip6-ip6scale20k-rnd | 37.09 +- 0.09 | 35.86 +- 0.11 | 35.44 +- 0.09 | -3.31 +- 0.37 | -1.17 +- 0.4 | | 64b-4t2c-af-xdp-ethip4-ip4scale20k-rnd | 2.63 +- 0.09 | 2.01 +- 0.0 | 1.98 +- 0.0 | -23.79 +- 2.64 | -1.29 +- 0.26 | | 64b-4t2c-avf-dot1q-l2bdbasemaclrn | 37.07 +- 0.07 | 32.77 +- 0.2 | 32.32 +- 0.19 | -11.59 +- 0.57 | -1.36 +- 0.85 | | 64b-4t2c-avf-eth-l2bdscale1mmaclrn | 37.0 +- 0.04 | 36.14 +- 0.04 | 35.56 +- 0.03 | -2.32 +- 0.16 | -1.6 +- 0.14 | | 64b-4t2c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 29.07 +- 0.07 | 23.64 +- 0.04 | 23.23 +- 0.06 | -18.69 +- 0.23 | -1.74 +- 0.3 | | 64b-4t2c-avf-ethip4udp-nat44ed-h16384-p63-s1032192-cps | 2.24 +- 0.03 | 1.94 +- 0.03 | 1.91 +- 0.02 | -13.28 +- 1.8 | -1.78 +- 1.82 | | 64b-4t2c-avf-ethip4tcp-nat44ed-h65536-p63-s4128768-cps | 1.28 +- 0.0 | 0.72 +- 0.01 | 0.71 +- 0.01 | -43.33 +- 0.44 | -1.89 +- 1.61 | | 78b-4t2c-avf-ethip6-ip6scale200k-rnd | 34.98 +- 0.19 | 31.17 +- 0.05 | 30.55 +- 0.09 | -10.87 +- 0.5 | -2.0 +- 0.33 | | 64b-4t2c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 21.38 +- 0.36 | 17.43 +- 0.03 | 17.01 +- 0.07 | -18.48 +- 1.37 | -2.41 +- 0.42 | | 78b-4t2c-avf-ethip6-ip6scale200k | 34.76 +- 0.1 | 30.66 +- 0.16 | 29.9 +- 0.11 | -11.79 +- 0.52 | -2.48 +- 0.61 | | 64b-4t2c-af-xdp-ethip4-ip4scale20k | 3.35 +- 0.03 | 2.01 +- 0.01 | 1.95 +- 0.01 | -40.16 +- 0.55 | -2.74 +- 0.36 | | 64b-4t2c-avf-ethip4tcp-nat44ed-h1024-p63-s64512-cps | 0.15 +- 0.0 | 0.05 +- 0.0 | 0.05 +- 0.0 | -69.17 +- 0.67 | -3.31 +- 1.45 | | 64b-4t2c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 21.19 +- 0.41 | 17.33 +- 0.21 | 16.71 +- 0.28 | -18.24 +- 1.87 | -3.57 +- 2.0 | | 64b-4t2c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 25.28 +- 0.19 | 20.99 +- 0.63 | 20.19 +- 1.49 | -16.96 +- 2.57 | -3.85 +- 7.67 | | 64b-4t2c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 36.24 +- 0.19 | 29.07 +- 0.14 | 27.6 +- 0.14 | -19.78 +- 0.56 | -5.04 +- 0.66 | | 64b-4t2c-avf-ethip4tcp-nat44ed-h16384-p63-s1032192-cps | 0.93 +- 0.01 | 0.43 +- 0.0 | 0.41 +- 0.0 | -54.1 +- 0.38 | -5.05 +- 0.45 | | 64b-4t2c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 37.33 +- 0.05 | 29.94 +- 0.13 | 28.25 +- 0.18 | -19.78 +- 0.37 | -5.64 +- 0.74 | | 64b-4t2c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 28.46 +- 0.52 | 23.04 +- 0.22 | 21.14 +- 1.22 | -19.01 +- 1.67 | -8.28 +- 5.35 | | 64b-4t2c-avf-ethip4udp-nat44ed-h1024-p63-s64512-cps | 3.33 +- 0.09 | 2.7 +- 0.04 | 2.43 +- 0.04 | -18.97 +- 2.59 | -10.13 +- 2.02 | | 78b-4t2c-af-xdp-ethip6-ip6scale20k-rnd | 2.79 +- 0.31 | 2.23 +- 0.04 | 1.68 +- 0.01 | -19.97 +- 8.91 | -24.92 +- 1.28 | | 78b-4t2c-af-xdp-ethip6-ip6base | 2.53 +- 0.03 | 2.74 +- 0.0 | 1.92 +- 0.0 | +8.14 +- 1.19 | -29.79 +- 0.18 | +--------------------------------------------------------------+---------------+---------------+---------------+-----------------------+------------------------+ Test Case: Test cases executed for: MRR throughput on 2n-icx with xxv710. YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code. 2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.