+--------------------------------------------------------------+---------------+---------------+---------------+-----------------------+------------------------+ | Test Case | 2202.0-9 | 2202.0-10 | 2206.0-10 | 2202.0-10 vs 2202.0-9 | 2206.0-10 vs 2202.0-10 | +--------------------------------------------------------------+---------------+---------------+---------------+-----------------------+------------------------+ | 78b-2t1c-af-xdp-ethip6-ip6scale20k-rnd | 0.12 +- 0.01 | 0.08 +- 0.03 | 0.1 +- 0.05 | -36.46 +- 21.71 | +33.1 +- 80.02 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 15.13 +- 0.03 | 12.27 +- 0.08 | 14.27 +- 0.12 | -18.91 +- 0.57 | +16.36 +- 1.28 | | 64b-2t1c-af-xdp-ethip4-ip4base | 0.12 +- 0.02 | 0.09 +- 0.04 | 0.1 +- 0.04 | -23.78 +- 32.43 | +14.4 +- 59.99 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 11.37 +- 0.06 | 9.02 +- 0.11 | 10.07 +- 0.16 | -20.66 +- 1.07 | +11.71 +- 2.28 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 10.57 +- 0.02 | 8.37 +- 0.08 | 9.3 +- 0.06 | -20.88 +- 0.75 | +11.12 +- 1.27 | | 64b-2t1c-eth-l2bdscale1mmaclrn | 16.85 +- 0.15 | 13.57 +- 0.15 | 14.99 +- 0.17 | -19.49 +- 1.13 | +10.5 +- 1.74 | | 64b-2t1c-ethip4-ip4base | 22.95 +- 0.08 | 18.45 +- 0.13 | 20.31 +- 0.1 | -19.61 +- 0.62 | +10.06 +- 0.94 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k | 0.11 +- 0.02 | 0.09 +- 0.03 | 0.09 +- 0.04 | -23.03 +- 30.19 | +9.75 +- 57.2 | | 64b-2t1c-eth-l2xcbase | 33.62 +- 0.29 | 27.19 +- 0.26 | 29.75 +- 0.29 | -19.14 +- 1.04 | +9.45 +- 1.5 | | 64b-2t1c-eth-l2bdbasemaclrn | 24.53 +- 0.05 | 19.56 +- 0.12 | 21.21 +- 0.17 | -20.27 +- 0.52 | +8.44 +- 1.1 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 20.06 +- 0.04 | 16.1 +- 0.16 | 17.45 +- 0.21 | -19.74 +- 0.8 | +8.37 +- 1.68 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 18.79 +- 0.08 | 15.18 +- 0.2 | 16.44 +- 0.22 | -19.19 +- 1.1 | +8.27 +- 2.04 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 8.7 +- 0.08 | 7.0 +- 0.05 | 7.58 +- 0.09 | -19.48 +- 0.97 | +8.25 +- 1.49 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 16.77 +- 0.05 | 13.95 +- 0.17 | 15.09 +- 0.28 | -16.78 +- 1.03 | +8.11 +- 2.38 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k | 0.09 +- 0.03 | 0.11 +- 0.07 | 0.11 +- 0.03 | +12.4 +- 83.07 | +7.37 +- 79.52 | | 64b-2t1c-ethip4-ip4scale20k | 21.4 +- 0.17 | 17.43 +- 0.15 | 18.71 +- 0.27 | -18.56 +- 0.95 | +7.37 +- 1.79 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 20.76 +- 0.06 | 16.89 +- 0.16 | 18.11 +- 0.18 | -18.64 +- 0.81 | +7.21 +- 1.45 | | 78b-2t1c-ethip6-ip6base | 20.86 +- 0.06 | 16.59 +- 0.09 | 17.7 +- 0.13 | -20.48 +- 0.49 | +6.68 +- 0.98 | | 78b-2t1c-ethip6-ip6scale20k | 17.23 +- 0.17 | 14.79 +- 0.17 | 15.49 +- 0.22 | -14.15 +- 1.32 | +4.77 +- 1.94 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 9.14 +- 0.02 | 7.38 +- 0.06 | 7.65 +- 0.06 | -19.3 +- 0.65 | +3.68 +- 1.16 | | 64b-2t1c-avf-ethip4udp-ip4base-h65536-p63-s4128768-cps | 5.57 +- 0.14 | 6.59 +- 0.25 | 6.68 +- 0.2 | +18.28 +- 5.39 | +1.41 +- 4.99 | | 64b-2t1c-avf-ethip4tcp-ip4base-h16384-p63-s1032192-cps | 2.2 +- 0.03 | 2.7 +- 0.03 | 2.71 +- 0.03 | +22.78 +- 1.96 | +0.54 +- 1.5 | | 64b-2t1c-avf-eth-l2patch | 35.08 +- 0.15 | 37.13 +- 0.28 | 37.27 +- 0.12 | +5.85 +- 0.91 | +0.38 +- 0.82 | | 64b-2t1c-eth-l2patch | 36.81 +- 0.13 | 37.04 +- 0.15 | 37.17 +- 0.18 | +0.63 +- 0.53 | +0.34 +- 0.64 | | 78b-2t1c-avf-ethip6-ip6scale2m | 14.67 +- 0.48 | 13.13 +- 0.16 | 13.17 +- 0.12 | -10.5 +- 3.1 | +0.3 +- 1.49 | | 64b-2t1c-avf-eth-l2xcbase | 37.27 +- 0.07 | 37.5 +- 0.0 | 37.5 +- 0.0 | +0.63 +- 0.2 | +0.0 +- 0.0 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-4tun-ip4base | 12.68 +- 0.03 | 9.93 +- 0.02 | 9.92 +- 0.03 | -21.69 +- 0.25 | -0.08 +- 0.36 | | 64b-2t1c-avf-ethip4tcp-ip4base-h1024-p63-s64512-cps | 3.3 +- 0.07 | 4.62 +- 0.09 | 4.61 +- 0.1 | +40.0 +- 4.17 | -0.13 +- 2.97 | | 64b-2t1c-avf-ethip4tcp-ip4base-h65536-p63-s4128768-cps | 1.87 +- 0.0 | 2.61 +- 0.02 | 2.6 +- 0.03 | +39.7 +- 1.28 | -0.18 +- 1.33 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-16tun-ip4base | 12.61 +- 0.05 | 9.87 +- 0.02 | 9.84 +- 0.04 | -21.7 +- 0.34 | -0.34 +- 0.43 | | 64b-2t1c-avf-ethip4-ip4base | 32.68 +- 0.71 | 26.43 +- 0.47 | 26.32 +- 0.58 | -19.12 +- 2.26 | -0.44 +- 2.81 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-64tun-ip4base | 12.57 +- 0.06 | 9.86 +- 0.04 | 9.82 +- 0.04 | -21.51 +- 0.49 | -0.45 +- 0.56 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-1tun-ip4base | 13.64 +- 0.02 | 10.85 +- 0.02 | 10.8 +- 0.02 | -20.42 +- 0.19 | -0.52 +- 0.3 | | 64b-2t1c-avf-ethip4udp-ip4base-h16384-p63-s1032192-cps | 5.8 +- 0.31 | 6.87 +- 0.32 | 6.83 +- 0.16 | +18.39 +- 8.41 | -0.58 +- 5.25 | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 11.24 +- 0.03 | 10.11 +- 0.06 | 10.05 +- 0.05 | -10.04 +- 0.54 | -0.61 +- 0.71 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 10.97 +- 0.08 | 9.37 +- 0.14 | 9.29 +- 0.18 | -14.64 +- 1.46 | -0.78 +- 2.42 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 8.92 +- 0.03 | 7.26 +- 0.04 | 7.2 +- 0.05 | -18.64 +- 0.55 | -0.84 +- 0.94 | | 64b-2t1c-avf-ethip4-ip4scale2m | 26.27 +- 0.32 | 21.8 +- 0.4 | 21.6 +- 0.29 | -17.02 +- 1.83 | -0.91 +- 2.24 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 20.95 +- 0.05 | 16.64 +- 0.05 | 16.49 +- 0.15 | -20.57 +- 0.3 | -0.93 +- 0.95 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-256tun-ip4base | 12.5 +- 0.06 | 9.83 +- 0.03 | 9.73 +- 0.04 | -21.38 +- 0.44 | -0.98 +- 0.53 | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 19.33 +- 0.29 | 16.35 +- 0.21 | 16.17 +- 0.34 | -15.43 +- 1.66 | -1.11 +- 2.41 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 7.58 +- 0.06 | 6.9 +- 0.09 | 6.82 +- 0.07 | -9.06 +- 1.34 | -1.15 +- 1.59 | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 22.53 +- 0.08 | 18.31 +- 0.14 | 18.09 +- 0.19 | -18.72 +- 0.68 | -1.22 +- 1.26 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 14.35 +- 0.07 | 11.94 +- 0.06 | 11.79 +- 0.07 | -16.85 +- 0.6 | -1.22 +- 0.77 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 13.89 +- 0.08 | 11.6 +- 0.1 | 11.45 +- 0.12 | -16.53 +- 0.87 | -1.29 +- 1.33 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 14.02 +- 0.04 | 11.39 +- 0.07 | 11.24 +- 0.12 | -18.74 +- 0.54 | -1.32 +- 1.21 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 26.16 +- 0.32 | 21.12 +- 0.31 | 20.82 +- 0.39 | -19.26 +- 1.55 | -1.42 +- 2.33 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 21.01 +- 0.06 | 17.69 +- 0.18 | 17.42 +- 0.21 | -15.8 +- 0.9 | -1.54 +- 1.54 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 25.16 +- 0.19 | 20.62 +- 0.18 | 20.29 +- 0.22 | -18.01 +- 0.95 | -1.61 +- 1.38 | | 78b-2t1c-avf-ethip6-ip6scale200k | 19.84 +- 0.43 | 17.8 +- 0.22 | 17.51 +- 0.33 | -10.29 +- 2.23 | -1.62 +- 2.22 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 10.72 +- 0.09 | 8.82 +- 0.07 | 8.68 +- 0.06 | -17.72 +- 0.95 | -1.63 +- 1.05 | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 20.82 +- 0.05 | 17.91 +- 0.08 | 17.59 +- 0.1 | -14.01 +- 0.45 | -1.77 +- 0.73 | | 64b-2t1c-avf-ethip4-ip4scale20k | 30.25 +- 0.26 | 24.39 +- 0.3 | 23.92 +- 0.14 | -19.36 +- 1.21 | -1.94 +- 1.33 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 22.59 +- 0.04 | 18.61 +- 0.14 | 18.22 +- 0.1 | -17.64 +- 0.64 | -2.07 +- 0.92 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 29.05 +- 0.04 | 23.55 +- 0.13 | 23.05 +- 0.1 | -18.96 +- 0.48 | -2.09 +- 0.7 | | 64b-2t1c-avf-ethip4tcp-nat44ed-h65536-p63-s4128768-cps | 0.63 +- 0.0 | 0.53 +- 0.0 | 0.52 +- 0.0 | -15.96 +- 0.41 | -2.2 +- 0.59 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 11.01 +- 0.17 | 9.1 +- 0.06 | 8.88 +- 0.04 | -17.38 +- 1.42 | -2.33 +- 0.85 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 34.87 +- 0.08 | 27.81 +- 0.08 | 27.16 +- 0.19 | -20.25 +- 0.3 | -2.34 +- 0.74 | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 27.6 +- 0.07 | 22.65 +- 0.2 | 22.09 +- 0.16 | -17.94 +- 0.74 | -2.46 +- 1.11 | | 78b-2t1c-avf-ethip6-ip6scale20k | 21.22 +- 0.17 | 18.96 +- 0.31 | 18.46 +- 0.19 | -10.65 +- 1.64 | -2.62 +- 1.89 | | 64b-2t1c-avf-ethip4-ip4scale200k | 30.22 +- 0.34 | 24.41 +- 0.21 | 23.76 +- 0.14 | -19.22 +- 1.13 | -2.65 +- 1.01 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 19.16 +- 0.22 | 15.39 +- 0.28 | 14.93 +- 0.39 | -19.7 +- 1.72 | -3.0 +- 3.06 | | 64b-2t1c-avf-ethip4tcp-nat44ed-h16384-p63-s1032192-cps | 0.71 +- 0.0 | 0.59 +- 0.0 | 0.57 +- 0.0 | -17.08 +- 0.5 | -3.06 +- 0.74 | | 64b-2t1c-avf-ethip4tcp-nat44ed-h1024-p63-s64512-cps | 0.9 +- 0.0 | 0.73 +- 0.0 | 0.7 +- 0.0 | -19.5 +- 0.63 | -3.4 +- 0.93 | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-cps | 1.71 +- 0.01 | 1.29 +- 0.21 | 1.24 +- 0.01 | -24.73 +- 12.19 | -3.44 +- 15.65 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 15.34 +- 0.09 | 12.43 +- 0.09 | 12.0 +- 0.07 | -18.98 +- 0.74 | -3.48 +- 0.89 | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 11.59 +- 0.02 | 9.39 +- 0.13 | 9.04 +- 0.2 | -19.02 +- 1.15 | -3.72 +- 2.48 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 18.62 +- 0.02 | 14.91 +- 0.11 | 14.34 +- 0.24 | -19.95 +- 0.61 | -3.79 +- 1.76 | | 78b-2t1c-avf-ethip6-ip6base | 28.21 +- 0.05 | 22.41 +- 0.16 | 21.43 +- 0.04 | -20.57 +- 0.58 | -4.38 +- 0.69 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 14.75 +- 0.03 | 11.7 +- 0.04 | 11.16 +- 0.06 | -20.65 +- 0.31 | -4.62 +- 0.6 | | 64b-2t1c-avf-ethip4udp-nat44ed-h65536-p63-s4128768-cps | 0.99 +- 0.0 | 0.84 +- 0.0 | 0.8 +- 0.0 | -15.1 +- 0.54 | -5.38 +- 0.7 | | 64b-2t1c-avf-ethip4udp-nat44ed-h16384-p63-s1032192-cps | 1.17 +- 0.0 | 0.97 +- 0.01 | 0.91 +- 0.0 | -16.73 +- 0.5 | -6.69 +- 0.66 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 15.38 +- 0.24 | 12.2 +- 0.18 | 11.34 +- 0.06 | -20.73 +- 1.67 | -7.03 +- 1.44 | | 64b-2t1c-avf-ethip4udp-ip4base-h1024-p63-s64512-cps | 7.49 +- 0.39 | 10.71 +- 1.91 | 9.84 +- 1.06 | +42.93 +- 26.57 | -8.13 +- 19.15 | | 78b-2t1c-af-xdp-ethip6-ip6base | 0.11 +- 0.02 | 0.11 +- 0.08 | 0.1 +- 0.04 | -3.22 +- 70.38 | -8.28 +- 73.59 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k-rnd | 0.1 +- 0.03 | 0.1 +- 0.05 | 0.09 +- 0.04 | -1.75 +- 55.38 | -11.99 +- 56.88 | +--------------------------------------------------------------+---------------+---------------+---------------+-----------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710. YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code. 2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.