+--------------------------------------------------------------+---------------+---------------+---------------+-----------------------+------------------------+ | Test Case | 2202.0-9 | 2202.0-10 | 2206.0-10 | 2202.0-10 vs 2202.0-9 | 2206.0-10 vs 2202.0-10 | +--------------------------------------------------------------+---------------+---------------+---------------+-----------------------+------------------------+ | 64b-4t2c-eth-l2xcbase-eth-2memif-1dcr | 29.64 +- 0.14 | 24.6 +- 0.22 | 27.56 +- 0.26 | -17.0 +- 0.84 | +12.04 +- 1.47 | | 64b-4t2c-eth-l2bdscale1mmaclrn | 33.56 +- 1.22 | 27.18 +- 0.38 | 29.61 +- 0.45 | -19.01 +- 3.14 | +8.95 +- 2.25 | | 64b-4t2c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 22.36 +- 0.05 | 18.26 +- 0.08 | 19.77 +- 0.22 | -18.34 +- 0.39 | +8.27 +- 1.27 | | 64b-4t2c-ethip4-ip4base-eth-2memif-1dcr | 20.83 +- 0.05 | 16.98 +- 0.08 | 18.08 +- 0.25 | -18.48 +- 0.44 | +6.5 +- 1.58 | | 64b-4t2c-eth-l2bdscale100kmaclrn | 36.89 +- 0.1 | 31.09 +- 0.3 | 32.96 +- 0.4 | -15.72 +- 0.85 | +6.0 +- 1.65 | | 78b-4t2c-ethip6-ip6scale20k-rnd | 33.71 +- 0.05 | 28.48 +- 0.27 | 30.06 +- 0.2 | -15.52 +- 0.8 | +5.56 +- 1.2 | | 64b-4t2c-ethip4-ip4scale20k-rnd | 36.56 +- 0.05 | 34.66 +- 0.19 | 36.31 +- 0.46 | -5.18 +- 0.54 | +4.74 +- 1.44 | | 78b-4t2c-ethip6-ip6scale20k | 34.71 +- 0.15 | 28.53 +- 0.25 | 29.8 +- 0.31 | -17.79 +- 0.81 | +4.43 +- 1.44 | | 64b-4t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 16.8 +- 0.16 | 13.86 +- 0.14 | 14.46 +- 0.19 | -17.52 +- 1.12 | +4.31 +- 1.71 | | 64b-4t2c-eth-l2bdscale10kmaclrn | 36.52 +- 0.11 | 33.7 +- 0.42 | 34.96 +- 0.5 | -7.71 +- 1.18 | +3.71 +- 1.96 | | 78b-4t2c-ethip6-ip6base | 36.62 +- 0.07 | 34.0 +- 0.14 | 35.15 +- 0.28 | -7.18 +- 0.43 | +3.38 +- 0.93 | | 64b-4t2c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 18.09 +- 0.06 | 14.83 +- 0.08 | 15.3 +- 0.08 | -18.0 +- 0.51 | +3.15 +- 0.77 | | 64b-4t2c-avf-ethip4udp-ip4base-h16384-p63-s1032192-cps | 5.8 +- 0.11 | 6.69 +- 0.3 | 6.86 +- 0.14 | +15.32 +- 5.63 | +2.49 +- 5.02 | | 78b-4t2c-avf-ethip6-ip6scale200k-rnd | 34.95 +- 0.83 | 29.55 +- 1.17 | 30.07 +- 0.49 | -15.46 +- 3.9 | +1.77 +- 4.34 | | 64b-4t2c-ethip4-ip4scale20k | 36.78 +- 0.07 | 35.15 +- 0.29 | 35.76 +- 0.37 | -4.42 +- 0.82 | +1.75 +- 1.36 | | 78b-4t2c-af-xdp-ethip6-ip6scale20k | 1.01 +- 0.13 | 0.9 +- 0.26 | 0.91 +- 0.13 | -10.94 +- 28.23 | +1.33 +- 32.78 | | 64b-4t2c-eth-l2xcbase | 33.93 +- 0.07 | 35.84 +- 0.18 | 36.08 +- 0.25 | +5.63 +- 0.57 | +0.69 +- 0.85 | | 64b-4t2c-ethip4-ip4base | 36.81 +- 0.07 | 36.95 +- 0.13 | 37.18 +- 0.15 | +0.38 +- 0.4 | +0.62 +- 0.53 | | 64b-4t2c-avf-ethip4tcp-ip4base-h16384-p63-s1032192-cps | 2.2 +- 0.04 | 3.19 +- 0.02 | 3.2 +- 0.02 | +45.04 +- 2.49 | +0.47 +- 0.75 | | 64b-4t2c-avf-ethip4tcp-ip4base-h65536-p63-s4128768-cps | 1.87 +- 0.0 | 2.61 +- 0.02 | 2.62 +- 0.0 | +39.88 +- 1.2 | +0.39 +- 0.86 | | 64b-4t2c-eth-l2bdbasemaclrn | 36.62 +- 0.16 | 36.51 +- 0.09 | 36.64 +- 0.13 | -0.3 +- 0.5 | +0.36 +- 0.43 | | 64b-4t2c-avf-eth-l2patch | 30.63 +- 0.13 | 31.44 +- 0.13 | 31.53 +- 0.12 | +2.64 +- 0.6 | +0.27 +- 0.55 | | 64b-4t2c-avf-eth-l2xcbase | 32.72 +- 0.08 | 34.61 +- 0.13 | 34.69 +- 0.08 | +5.79 +- 0.47 | +0.23 +- 0.44 | | 64b-4t2c-eth-l2patch | 30.68 +- 0.14 | 32.63 +- 0.11 | 32.7 +- 0.15 | +6.37 +- 0.6 | +0.2 +- 0.56 | | 64b-4t2c-avf-ethip4-ip4base | 35.56 +- 0.16 | 37.18 +- 0.27 | 37.24 +- 0.15 | +4.54 +- 0.89 | +0.17 +- 0.85 | | 78b-4t2c-avf-ethip6-ip6base | 36.16 +- 0.09 | 37.43 +- 0.1 | 37.48 +- 0.06 | +3.51 +- 0.38 | +0.15 +- 0.3 | | 64b-4t2c-avf-ethip4udp-nat44ed-h1024-p63-s64512-cps | 3.19 +- 0.06 | 2.41 +- 0.45 | 2.41 +- 0.03 | -24.63 +- 14.06 | +0.14 +- 18.62 | | 64b-4t2c-avf-ethip4-ip4scale200k | 36.69 +- 0.28 | 37.44 +- 0.09 | 37.46 +- 0.08 | +2.07 +- 0.82 | +0.05 +- 0.32 | | 64b-4t2c-avf-eth-l2bdbasemaclrn | 35.4 +- 0.08 | 37.03 +- 0.33 | 37.05 +- 0.25 | +4.6 +- 0.97 | +0.05 +- 1.14 | | 64b-4t2c-avf-ethip4-ip4scale20k | 36.59 +- 0.1 | 37.33 +- 0.16 | 37.34 +- 0.13 | +2.03 +- 0.53 | +0.01 +- 0.55 | | 64b-4t2c-avf-eth-l2bdscale100kmaclrn | 37.07 +- 0.09 | 37.5 +- 0.0 | 37.5 +- 0.0 | +1.17 +- 0.24 | +0.0 +- 0.0 | | 64b-4t2c-avf-eth-l2bdscale10kmaclrn | 36.29 +- 0.13 | 37.35 +- 0.15 | 37.35 +- 0.15 | +2.93 +- 0.55 | +0.0 +- 0.56 | | 78b-4t2c-avf-ethip6-ip6scale2m | 26.17 +- 0.4 | 21.75 +- 0.18 | 21.74 +- 0.23 | -16.89 +- 1.43 | -0.03 +- 1.32 | | 64b-4t2c-avf-ethip4-ip4scale200k-rnd | 36.67 +- 0.16 | 37.46 +- 0.08 | 37.44 +- 0.09 | +2.17 +- 0.51 | -0.05 +- 0.32 | | 64b-4t2c-avf-ethip4-ip4scale20k-rnd | 36.51 +- 0.13 | 37.36 +- 0.15 | 37.33 +- 0.14 | +2.33 +- 0.56 | -0.1 +- 0.56 | | 64b-4t2c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 26.25 +- 0.2 | 22.12 +- 0.41 | 22.08 +- 0.26 | -15.76 +- 1.68 | -0.15 +- 2.19 | | 78b-4t2c-avf-ethip6-ip6scale200k | 35.51 +- 1.03 | 29.43 +- 1.16 | 29.32 +- 0.6 | -17.13 +- 4.06 | -0.38 +- 4.43 | | 64b-4t2c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 21.42 +- 0.15 | 18.16 +- 0.14 | 18.09 +- 0.2 | -15.25 +- 0.89 | -0.38 +- 1.34 | | 64b-4t2c-avf-ethip4--ethip4udpgeneve-1tun-ip4base | 27.57 +- 0.12 | 21.8 +- 0.18 | 21.69 +- 0.21 | -20.93 +- 0.76 | -0.52 +- 1.28 | | 64b-4t2c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 11.11 +- 0.07 | 8.87 +- 0.02 | 8.82 +- 0.03 | -20.14 +- 0.53 | -0.6 +- 0.45 | | 64b-4t2c-avf-ethip4tcp-ip4base-h1024-p63-s64512-cps | 3.04 +- 0.05 | 4.62 +- 0.1 | 4.59 +- 0.09 | +51.95 +- 4.05 | -0.66 +- 2.9 | | 64b-4t2c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 27.62 +- 0.06 | 22.91 +- 0.09 | 22.74 +- 0.14 | -17.03 +- 0.38 | -0.75 +- 0.74 | | 64b-4t2c-avf-ethip4-ip4scale2m-rnd | 37.5 +- 0.0 | 35.0 +- 0.23 | 34.71 +- 0.21 | -6.66 +- 0.62 | -0.83 +- 0.89 | | 64b-4t2c-avf-ethip4-ip4base-eth-2memif-1dcr | 26.98 +- 0.09 | 21.78 +- 0.09 | 21.59 +- 0.15 | -19.27 +- 0.42 | -0.85 +- 0.78 | | 64b-4t2c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 15.65 +- 0.11 | 13.71 +- 0.14 | 13.59 +- 0.16 | -12.36 +- 1.1 | -0.87 +- 1.58 | | 64b-4t2c-avf-ethip4--ethip4udpgeneve-16tun-ip4base | 24.26 +- 0.24 | 18.91 +- 0.14 | 18.73 +- 0.07 | -22.08 +- 0.95 | -0.93 +- 0.81 | | 64b-4t2c-avf-ethip4--ethip4udpgeneve-64tun-ip4base | 23.71 +- 0.26 | 18.59 +- 0.11 | 18.41 +- 0.11 | -21.58 +- 0.99 | -0.97 +- 0.84 | | 64b-4t2c-avf-ethip4--ethip4udpgeneve-4tun-ip4base | 24.65 +- 0.14 | 19.15 +- 0.07 | 18.96 +- 0.1 | -22.31 +- 0.54 | -1.02 +- 0.64 | | 64b-4t2c-avf-eth-l2bdscale1mmaclrn | 37.44 +- 0.08 | 35.57 +- 0.36 | 35.21 +- 0.16 | -5.0 +- 0.97 | -1.02 +- 1.08 | | 64b-4t2c-avf-ethip4--ethip4udpgeneve-256tun-ip4base | 23.28 +- 0.17 | 18.3 +- 0.11 | 18.1 +- 0.17 | -21.37 +- 0.74 | -1.13 +- 1.09 | | 64b-4t2c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 18.75 +- 0.0 | 16.3 +- 0.15 | 16.1 +- 0.13 | -13.06 +- 0.82 | -1.22 +- 1.22 | | 78b-4t2c-avf-ethip6-ip6scale2m-rnd | 22.12 +- 0.07 | 19.94 +- 0.09 | 19.69 +- 0.06 | -9.89 +- 0.48 | -1.26 +- 0.52 | | 64b-4t2c-avf-ethip4udp-ip4base-h65536-p63-s4128768-cps | 5.46 +- 0.11 | 6.55 +- 0.28 | 6.46 +- 0.29 | +19.92 +- 5.75 | -1.28 +- 6.17 | | 64b-4t2c-avf-ethip4-ip4scale2m | 37.41 +- 0.1 | 37.05 +- 0.41 | 36.56 +- 0.45 | -0.96 +- 1.13 | -1.32 +- 1.63 | | 64b-4t2c-avf-eth-l2xcbase-eth-2memif-1dcr | 37.5 +- 0.0 | 34.87 +- 0.28 | 34.36 +- 0.21 | -7.03 +- 0.75 | -1.46 +- 1.0 | | 78b-4t2c-avf-ethip6-ip6scale20k-rnd | 37.39 +- 0.09 | 35.24 +- 0.88 | 34.69 +- 0.35 | -5.76 +- 2.35 | -1.56 +- 2.63 | | 64b-4t2c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 20.74 +- 0.13 | 16.95 +- 0.21 | 16.67 +- 0.19 | -18.26 +- 1.12 | -1.69 +- 1.65 | | 64b-4t2c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 21.3 +- 0.05 | 17.38 +- 0.05 | 17.07 +- 0.08 | -18.4 +- 0.33 | -1.75 +- 0.56 | | 64b-4t2c-avf-dot1q-l2bdbasemaclrn | 37.37 +- 0.1 | 32.51 +- 0.44 | 31.93 +- 0.24 | -13.02 +- 1.21 | -1.76 +- 1.52 | | 64b-4t2c-af-xdp-ethip4-ip4scale20k-rnd | 1.05 +- 0.06 | 1.04 +- 0.12 | 1.01 +- 0.11 | -0.94 +- 12.35 | -2.9 +- 15.33 | | 64b-4t2c-avf-ethip4udp-ip4base-h1024-p63-s64512-cps | 6.79 +- 0.6 | 10.28 +- 2.75 | 9.97 +- 1.2 | +51.39 +- 42.65 | -3.01 +- 28.44 | | 64b-4t2c-avf-ethip4tcp-nat44ed-h65536-p63-s4128768-cps | 1.21 +- 0.01 | 1.03 +- 0.0 | 1.0 +- 0.0 | -14.74 +- 0.61 | -3.04 +- 0.59 | | 64b-4t2c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 29.2 +- 0.16 | 23.71 +- 0.17 | 22.96 +- 0.08 | -18.82 +- 0.73 | -3.14 +- 0.77 | | 78b-4t2c-avf-ethip6-ip6scale20k | 37.42 +- 0.25 | 34.59 +- 0.9 | 33.42 +- 0.3 | -7.57 +- 2.48 | -3.37 +- 2.66 | | 64b-4t2c-avf-ethip4tcp-nat44ed-h16384-p63-s1032192-cps | 1.34 +- 0.0 | 1.13 +- 0.01 | 1.09 +- 0.0 | -16.27 +- 0.47 | -3.55 +- 0.58 | | 64b-4t2c-avf-ethip4tcp-nat44ed-h1024-p63-s64512-cps | 1.69 +- 0.01 | 1.37 +- 0.01 | 1.32 +- 0.01 | -18.78 +- 0.69 | -3.65 +- 1.1 | | 64b-4t2c-af-xdp-ethip4-ip4scale20k | 1.01 +- 0.06 | 0.97 +- 0.09 | 0.93 +- 0.29 | -3.95 +- 10.12 | -4.03 +- 30.84 | | 78b-4t2c-af-xdp-ethip6-ip6scale20k-rnd | 0.97 +- 0.29 | 1.04 +- 0.11 | 1.0 +- 0.25 | +7.02 +- 34.06 | -4.47 +- 26.47 | | 64b-4t2c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 37.41 +- 0.2 | 30.32 +- 0.49 | 28.95 +- 0.21 | -18.95 +- 1.37 | -4.52 +- 1.68 | | 64b-4t2c-avf-ethip4udp-nat44ed-h65536-p63-s4128768-cps | 1.81 +- 0.02 | 1.59 +- 0.0 | 1.5 +- 0.01 | -12.25 +- 0.8 | -5.34 +- 0.69 | | 64b-4t2c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 36.5 +- 0.53 | 29.52 +- 0.42 | 27.88 +- 0.17 | -19.14 +- 1.63 | -5.54 +- 1.46 | | 64b-4t2c-avf-ethip4udp-nat44ed-h16384-p63-s1032192-cps | 2.13 +- 0.02 | 1.83 +- 0.01 | 1.71 +- 0.02 | -14.16 +- 0.95 | -6.85 +- 1.05 | | 64b-4t2c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 24.74 +- 0.61 | 19.85 +- 0.58 | 18.21 +- 0.35 | -19.77 +- 3.06 | -8.27 +- 3.2 | | 64b-4t2c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 25.2 +- 0.53 | 20.36 +- 0.36 | 18.27 +- 0.78 | -19.19 +- 2.22 | -10.26 +- 4.12 | | 78b-4t2c-af-xdp-ethip6-ip6base | 0.65 +- 0.1 | 1.06 +- 0.21 | 0.93 +- 0.22 | +64.12 +- 40.79 | -11.84 +- 26.78 | | 64b-4t2c-af-xdp-ethip4-ip4base | 1.03 +- 0.14 | 1.08 +- 0.08 | 0.94 +- 0.2 | +5.09 +- 16.44 | -12.58 +- 19.46 | +--------------------------------------------------------------+---------------+---------------+---------------+-----------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710. YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code. 2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.