+--------------------------------------------------------------+---------------+---------------+---------------+------------------------+ | Test Case | 2202.0-10 | 2206.0-10 | 2210.0-11 | 2210.0-11 vs 2206.0-10 | +--------------------------------------------------------------+---------------+---------------+---------------+------------------------+ | 78b-2t1c-avf-ethip6-ip6scale20k | 15.55 +- 3.65 | 15.32 +- 1.63 | 18.98 +- 1.45 | +23.85 +- 16.23 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 19.32 +- 2.83 | 17.37 +- 3.53 | 21.45 +- 1.28 | +23.48 +- 26.12 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 14.76 +- 3.47 | 14.36 +- 3.02 | 17.48 +- 0.29 | +21.76 +- 25.68 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 13.31 +- 2.48 | 13.02 +- 1.84 | 15.66 +- 0.21 | +20.29 +- 17.04 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 17.09 +- 3.62 | 15.48 +- 3.27 | 18.33 +- 2.92 | +18.34 +- 31.34 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 6.47 +- 1.77 | 6.9 +- 1.88 | 8.08 +- 0.62 | +17.16 +- 33.1 | | 64b-2t1c-avf-ethip4-ip4scale20k | 19.23 +- 4.68 | 20.52 +- 3.95 | 23.92 +- 1.26 | +16.6 +- 23.25 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 13.96 +- 2.25 | 13.81 +- 1.4 | 15.95 +- 0.29 | +15.52 +- 11.89 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-4tun-ip4base | 9.28 +- 1.54 | 9.29 +- 0.93 | 10.72 +- 0.13 | +15.3 +- 11.62 | | 78b-2t1c-avf-ethip6-ip6base | 19.77 +- 3.73 | 19.76 +- 3.68 | 22.47 +- 0.62 | +13.73 +- 21.4 | | 64b-2t1c-avf-ethip4-ip4base | 20.5 +- 4.4 | 21.54 +- 3.09 | 24.46 +- 1.07 | +13.56 +- 17.03 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-64tun-ip4base | 9.59 +- 0.9 | 9.4 +- 0.65 | 10.52 +- 0.09 | +12.02 +- 7.76 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 7.28 +- 1.57 | 7.46 +- 0.77 | 8.35 +- 0.1 | +11.93 +- 11.68 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 6.75 +- 1.03 | 6.79 +- 0.92 | 7.56 +- 0.32 | +11.27 +- 15.86 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-16tun-ip4base | 9.28 +- 1.23 | 9.56 +- 0.79 | 10.62 +- 0.12 | +11.08 +- 9.23 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 5.32 +- 0.95 | 5.19 +- 0.91 | 5.75 +- 0.49 | +10.76 +- 21.53 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-1tun-ip4base | 9.97 +- 1.73 | 10.71 +- 1.18 | 11.8 +- 0.08 | +10.19 +- 12.11 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 11.71 +- 1.32 | 11.63 +- 1.25 | 12.81 +- 0.06 | +10.16 +- 11.88 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 11.66 +- 1.52 | 11.41 +- 1.41 | 12.44 +- 0.05 | +9.01 +- 13.43 | | 64b-2t1c-ethip4-ip4scale20k | 13.31 +- 1.44 | 16.27 +- 0.55 | 17.57 +- 0.21 | +7.99 +- 3.88 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-256tun-ip4base | 8.87 +- 1.03 | 9.5 +- 0.34 | 10.25 +- 0.07 | +7.84 +- 3.9 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 21.02 +- 5.66 | 23.2 +- 2.55 | 24.93 +- 1.91 | +7.45 +- 14.41 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 11.96 +- 2.35 | 16.4 +- 0.58 | 17.62 +- 0.12 | +7.44 +- 3.9 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 19.86 +- 4.12 | 21.42 +- 1.63 | 23.01 +- 1.23 | +7.41 +- 10.01 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 14.68 +- 3.87 | 16.44 +- 2.17 | 17.62 +- 1.96 | +7.18 +- 18.5 | | 64b-2t1c-eth-l2xcbase | 18.93 +- 3.7 | 25.66 +- 1.88 | 27.45 +- 0.16 | +6.98 +- 7.84 | | 64b-2t1c-ethip4-ip4base | 15.78 +- 1.03 | 18.86 +- 0.38 | 20.14 +- 0.12 | +6.73 +- 2.26 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 6.01 +- 0.19 | 6.91 +- 0.02 | 7.29 +- 0.03 | +5.56 +- 0.61 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 12.67 +- 2.04 | 16.76 +- 0.24 | 17.66 +- 0.15 | +5.36 +- 1.74 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 9.76 +- 0.15 | 10.19 +- 0.21 | 10.74 +- 0.06 | +5.33 +- 2.25 | | 64b-2t1c-eth-l2bdbasemaclrn | 16.36 +- 1.51 | 20.14 +- 0.41 | 21.14 +- 0.09 | +4.94 +- 2.19 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 10.91 +- 0.22 | 11.35 +- 0.41 | 11.9 +- 0.13 | +4.88 +- 3.92 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 10.29 +- 1.39 | 13.14 +- 0.14 | 13.68 +- 0.11 | +4.11 +- 1.36 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 5.27 +- 0.28 | 5.35 +- 0.3 | 5.53 +- 0.23 | +3.52 +- 7.25 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 7.68 +- 0.18 | 9.19 +- 0.05 | 9.48 +- 0.03 | +3.15 +- 0.66 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 6.56 +- 0.17 | 7.54 +- 0.05 | 7.78 +- 0.02 | +3.11 +- 0.79 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 6.84 +- 0.12 | 6.84 +- 0.09 | 7.01 +- 0.06 | +2.42 +- 1.63 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 13.69 +- 1.66 | 15.27 +- 1.12 | 15.63 +- 0.23 | +2.36 +- 7.67 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 6.97 +- 0.06 | 6.88 +- 0.08 | 7.03 +- 0.09 | +2.11 +- 1.85 | | 78b-2t1c-ethip6-ip6base | 13.93 +- 1.91 | 17.72 +- 0.4 | 18.1 +- 0.1 | +2.1 +- 2.39 | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 6.24 +- 0.11 | 6.19 +- 0.11 | 6.3 +- 0.14 | +1.82 +- 2.92 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 5.3 +- 0.29 | 5.21 +- 0.3 | 5.28 +- 0.28 | +1.41 +- 7.95 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 9.72 +- 1.03 | 11.53 +- 0.1 | 11.64 +- 0.06 | +0.95 +- 0.99 | | 64b-2t1c-eth-l2patch | 30.76 +- 2.15 | 37.04 +- 0.13 | 37.02 +- 0.39 | -0.05 +- 1.12 | | 64b-2t1c-avf-eth-l2xcbase | 28.34 +- 4.23 | 29.28 +- 2.88 | 28.86 +- 4.94 | -1.43 +- 19.47 | | 78b-2t1c-ethip6-ip6scale20k | 9.5 +- 1.11 | 11.55 +- 0.16 | 11.25 +- 0.1 | -2.67 +- 1.59 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 5.25 +- 0.25 | 5.42 +- 0.3 | 5.23 +- 0.23 | -3.52 +- 6.89 | | 64b-2t1c-avf-eth-l2patch | 28.33 +- 7.36 | 30.41 +- 5.2 | 29.25 +- 8.01 | -3.81 +- 31.04 | +--------------------------------------------------------------+---------------+---------------+---------------+------------------------+ Test Case: Test cases executed for: NDR throughput on 2n-zn2 with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2210.0-11 vs 2206.0-10: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.