+--------------------------------------------------------------+---------------+---------------+---------------+---------------+-----------------------+------------------------+ | Test Case | 2110.0-9 | 2202.0-9 | 2202.0-10 | 2206.0-10 | 2202.0-10 vs 2202.0-9 | 2206.0-10 vs 2202.0-10 | +--------------------------------------------------------------+---------------+---------------+---------------+---------------+-----------------------+------------------------+ | 64b-2t1c-ethip4-ip4scale20k-rnd | 13.39 +- 0.04 | 11.52 +- 0.25 | 11.96 +- 2.35 | 16.4 +- 0.58 | +3.87 +- 20.5 | +37.05 +- 27.32 | | 64b-2t1c-eth-l2xcbase | 21.44 +- 0.39 | 17.54 +- 0.92 | 18.93 +- 3.7 | 25.66 +- 1.88 | +7.91 +- 21.84 | +35.55 +- 28.29 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 13.28 +- 0.13 | 11.54 +- 0.44 | 12.67 +- 2.04 | 16.76 +- 0.24 | +9.8 +- 18.19 | +32.29 +- 21.4 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 10.89 +- 0.06 | 9.55 +- 0.53 | 10.29 +- 1.39 | 13.14 +- 0.14 | +7.78 +- 15.68 | +27.69 +- 17.24 | | 78b-2t1c-ethip6-ip6base | 13.62 +- 0.12 | 11.88 +- 0.62 | 13.93 +- 1.91 | 17.72 +- 0.4 | +17.26 +- 17.17 | +27.2 +- 17.65 | | 64b-2t1c-eth-l2bdbasemaclrn | 16.49 +- 0.18 | 13.18 +- 1.26 | 16.36 +- 1.51 | 20.14 +- 0.41 | +24.12 +- 16.52 | +23.15 +- 11.65 | | 64b-2t1c-ethip4-ip4scale20k | 13.53 +- 0.38 | 11.72 +- 0.16 | 13.31 +- 1.44 | 16.27 +- 0.55 | +13.57 +- 12.35 | +22.26 +- 13.83 | | 78b-2t1c-ethip6-ip6scale20k | 9.02 +- 0.06 | 8.43 +- 0.22 | 9.5 +- 1.11 | 11.55 +- 0.16 | +12.73 +- 13.5 | +21.57 +- 14.29 | | 64b-2t1c-eth-l2patch | 31.36 +- 0.7 | 25.4 +- 0.93 | 30.76 +- 2.15 | 37.04 +- 0.13 | +21.1 +- 9.54 | +20.4 +- 8.42 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 7.81 +- 0.02 | 6.63 +- 0.09 | 7.68 +- 0.18 | 9.19 +- 0.05 | +15.86 +- 3.14 | +19.73 +- 2.85 | | 64b-2t1c-ethip4-ip4base | 15.26 +- 0.11 | 12.76 +- 0.52 | 15.78 +- 1.03 | 18.86 +- 0.38 | +23.62 +- 9.5 | +19.56 +- 8.18 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 9.09 +- 0.04 | 8.45 +- 0.27 | 9.72 +- 1.03 | 11.53 +- 0.1 | +15.06 +- 12.73 | +18.52 +- 12.6 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 5.93 +- 0.01 | 5.12 +- 0.02 | 6.01 +- 0.19 | 6.91 +- 0.02 | +17.21 +- 3.76 | +15.02 +- 3.69 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 6.38 +- 0.02 | 5.57 +- 0.05 | 6.56 +- 0.17 | 7.54 +- 0.05 | +17.79 +- 3.2 | +15.0 +- 3.03 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 13.49 +- 2.15 | 14.43 +- 0.47 | 14.68 +- 3.87 | 16.44 +- 2.17 | +1.76 +- 27.06 | +11.99 +- 33.05 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 13.33 +- 0.17 | 11.56 +- 0.09 | 13.69 +- 1.66 | 15.27 +- 1.12 | +18.42 +- 14.35 | +11.55 +- 15.79 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 19.17 +- 3.13 | 20.11 +- 1.23 | 21.02 +- 5.66 | 23.2 +- 2.55 | +4.56 +- 28.88 | +10.36 +- 32.1 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 16.8 +- 2.51 | 17.01 +- 1.98 | 19.86 +- 4.12 | 21.42 +- 1.63 | +16.76 +- 27.81 | +7.85 +- 23.86 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-1tun-ip4base | 9.11 +- 0.09 | 8.63 +- 0.04 | 9.97 +- 1.73 | 10.71 +- 1.18 | +15.49 +- 20.08 | +7.47 +- 22.09 | | 64b-2t1c-avf-eth-l2patch | 36.25 +- 1.28 | 35.94 +- 2.1 | 28.33 +- 7.36 | 30.41 +- 5.2 | -21.17 +- 20.98 | +7.32 +- 33.36 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-256tun-ip4base | 8.38 +- 0.2 | 7.65 +- 0.07 | 8.87 +- 1.03 | 9.5 +- 0.34 | +15.92 +- 13.5 | +7.1 +- 13.0 | | 64b-2t1c-avf-ethip4-ip4scale20k | 15.7 +- 3.64 | 18.03 +- 0.25 | 19.23 +- 4.68 | 20.52 +- 3.95 | +6.71 +- 25.99 | +6.67 +- 33.07 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 5.87 +- 0.84 | 6.46 +- 0.85 | 6.47 +- 1.77 | 6.9 +- 1.88 | +0.07 +- 30.3 | +6.66 +- 41.11 | | 64b-2t1c-avf-ethip4-ip4base | 15.79 +- 3.21 | 16.97 +- 2.44 | 20.5 +- 4.4 | 21.54 +- 3.09 | +20.8 +- 31.16 | +5.06 +- 27.1 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 8.81 +- 0.1 | 7.69 +- 0.09 | 9.76 +- 0.15 | 10.19 +- 0.21 | +27.01 +- 2.42 | +4.39 +- 2.67 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 9.68 +- 0.2 | 8.64 +- 0.1 | 10.91 +- 0.22 | 11.35 +- 0.41 | +26.26 +- 2.98 | +3.98 +- 4.29 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 5.02 +- 0.33 | 4.71 +- 0.07 | 5.25 +- 0.25 | 5.42 +- 0.3 | +11.29 +- 5.63 | +3.37 +- 7.62 | | 64b-2t1c-avf-eth-l2xcbase | 25.91 +- 4.79 | 27.53 +- 3.21 | 28.34 +- 4.23 | 29.28 +- 2.88 | +2.92 +- 19.5 | +3.32 +- 18.47 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-16tun-ip4base | 8.11 +- 0.57 | 7.97 +- 0.04 | 9.28 +- 1.23 | 9.56 +- 0.79 | +16.53 +- 15.5 | +2.98 +- 16.1 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 4.89 +- 0.79 | 5.92 +- 0.78 | 7.28 +- 1.57 | 7.46 +- 0.77 | +22.93 +- 31.05 | +2.54 +- 24.53 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 4.88 +- 0.22 | 4.75 +- 0.23 | 5.27 +- 0.28 | 5.35 +- 0.3 | +11.08 +- 7.99 | +1.42 +- 7.93 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 5.63 +- 0.6 | 5.96 +- 0.37 | 6.75 +- 1.03 | 6.79 +- 0.92 | +13.34 +- 18.6 | +0.54 +- 20.5 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-4tun-ip4base | 8.51 +- 0.11 | 8.05 +- 0.1 | 9.28 +- 1.54 | 9.29 +- 0.93 | +15.26 +- 19.15 | +0.17 +- 19.39 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 5.72 +- 0.02 | 5.82 +- 0.02 | 6.84 +- 0.12 | 6.84 +- 0.09 | +17.65 +- 2.16 | -0.03 +- 2.25 | | 78b-2t1c-avf-ethip6-ip6base | 15.0 +- 3.1 | 16.74 +- 1.03 | 19.77 +- 3.73 | 19.76 +- 3.68 | +18.09 +- 23.42 | -0.03 +- 26.48 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 9.43 +- 0.1 | 9.35 +- 0.14 | 11.71 +- 1.32 | 11.63 +- 1.25 | +25.17 +- 14.19 | -0.62 +- 15.48 | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 5.24 +- 0.03 | 5.18 +- 0.05 | 6.24 +- 0.11 | 6.19 +- 0.11 | +20.44 +- 2.47 | -0.81 +- 2.55 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 11.61 +- 0.83 | 11.77 +- 0.09 | 13.96 +- 2.25 | 13.81 +- 1.4 | +18.61 +- 19.13 | -1.1 +- 18.83 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 5.81 +- 0.02 | 5.97 +- 0.06 | 6.97 +- 0.06 | 6.88 +- 0.08 | +16.75 +- 1.6 | -1.26 +- 1.49 | | 78b-2t1c-avf-ethip6-ip6scale20k | 14.72 +- 0.42 | 13.72 +- 1.97 | 15.55 +- 3.65 | 15.32 +- 1.63 | +13.34 +- 31.19 | -1.43 +- 25.4 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 4.78 +- 0.24 | 4.98 +- 0.15 | 5.3 +- 0.29 | 5.21 +- 0.3 | +6.54 +- 6.54 | -1.75 +- 7.72 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-64tun-ip4base | 8.34 +- 0.24 | 7.84 +- 0.09 | 9.59 +- 0.9 | 9.4 +- 0.65 | +22.28 +- 11.58 | -2.06 +- 11.41 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 9.2 +- 0.34 | 9.28 +- 0.14 | 11.66 +- 1.52 | 11.41 +- 1.41 | +25.65 +- 16.47 | -2.13 +- 17.54 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 11.07 +- 0.7 | 10.94 +- 1.23 | 13.31 +- 2.48 | 13.02 +- 1.84 | +21.65 +- 26.48 | -2.19 +- 22.86 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 3.92 +- 0.58 | 4.74 +- 0.51 | 5.32 +- 0.95 | 5.19 +- 0.91 | +12.3 +- 23.5 | -2.45 +- 24.4 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 13.32 +- 0.76 | 13.26 +- 0.17 | 14.76 +- 3.47 | 14.36 +- 3.02 | +11.32 +- 26.22 | -2.75 +- 30.68 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 14.19 +- 2.04 | 15.54 +- 1.37 | 17.09 +- 3.62 | 15.48 +- 3.27 | +9.92 +- 25.21 | -9.37 +- 27.11 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 14.48 +- 3.58 | 16.6 +- 1.33 | 19.32 +- 2.83 | 17.37 +- 3.53 | +16.36 +- 19.41 | -10.07 +- 22.5 | +--------------------------------------------------------------+---------------+---------------+---------------+---------------+-----------------------+------------------------+ Test Case: Test cases executed for: NDR throughput on 2n-zn2 with xxv710. YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code. 2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.