+--------------------------------------------------------------+---------------+---------------+---------------+---------------+-----------------------+------------------------+ | Test Case | 2110.0-9 | 2202.0-9 | 2202.0-10 | 2206.0-10 | 2202.0-10 vs 2202.0-9 | 2206.0-10 vs 2202.0-10 | +--------------------------------------------------------------+---------------+---------------+---------------+---------------+-----------------------+------------------------+ | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 5.33 +- 0.03 | 4.78 +- 0.02 | 5.15 +- 0.01 | 6.08 +- 0.02 | +7.94 +- 0.62 | +18.04 +- 0.52 | | 64b-2t1c-eth-l2xcbase | 22.49 +- 0.33 | 19.95 +- 0.08 | 24.59 +- 0.1 | 28.57 +- 0.05 | +23.27 +- 0.71 | +16.19 +- 0.53 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 8.2 +- 0.08 | 7.74 +- 0.03 | 9.19 +- 0.02 | 10.53 +- 0.21 | +18.67 +- 0.61 | +14.61 +- 2.26 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 13.76 +- 0.29 | 12.59 +- 0.02 | 16.32 +- 0.05 | 18.49 +- 0.05 | +29.58 +- 0.48 | +13.32 +- 0.47 | | 64b-2t1c-eth-l2bdbasemaclrn | 17.25 +- 0.44 | 15.01 +- 0.06 | 19.01 +- 0.05 | 21.43 +- 0.19 | +26.66 +- 0.6 | +12.71 +- 1.02 | | 64b-2t1c-ethip4-ip4base | 17.01 +- 0.12 | 14.36 +- 0.12 | 18.55 +- 0.06 | 20.88 +- 0.07 | +29.21 +- 1.16 | +12.59 +- 0.53 | | 78b-2t1c-ethip6-ip6base | 14.95 +- 0.09 | 13.51 +- 0.09 | 17.24 +- 0.08 | 19.37 +- 0.07 | +27.61 +- 1.05 | +12.35 +- 0.66 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 6.32 +- 0.06 | 5.66 +- 0.07 | 6.95 +- 0.05 | 7.63 +- 0.21 | +22.79 +- 1.64 | +9.79 +- 3.1 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 13.95 +- 0.21 | 12.4 +- 0.16 | 15.4 +- 0.13 | 16.75 +- 0.33 | +24.22 +- 1.87 | +8.76 +- 2.3 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 6.76 +- 0.11 | 6.25 +- 0.04 | 7.72 +- 0.02 | 8.38 +- 0.18 | +23.51 +- 0.9 | +8.61 +- 2.42 | | 64b-2t1c-eth-l2patch | 32.4 +- 0.08 | 28.6 +- 0.05 | 35.13 +- 0.08 | 37.36 +- 0.03 | +22.84 +- 0.37 | +6.34 +- 0.26 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 9.15 +- 0.04 | 8.16 +- 0.04 | 10.34 +- 0.04 | 10.95 +- 0.02 | +26.76 +- 0.84 | +5.93 +- 0.44 | | 64b-2t1c-avf-ethip4-ip4scale20k | 20.31 +- 0.29 | 18.88 +- 0.12 | 24.66 +- 0.11 | 25.76 +- 0.2 | +30.58 +- 1.0 | +4.5 +- 0.93 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 14.4 +- 0.11 | 13.01 +- 0.09 | 16.86 +- 0.1 | 17.52 +- 0.12 | +29.6 +- 1.2 | +3.94 +- 0.94 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 10.13 +- 0.06 | 8.91 +- 0.09 | 11.53 +- 0.36 | 11.97 +- 0.22 | +29.44 +- 4.24 | +3.87 +- 3.79 | | 64b-2t1c-ethip4-ip4scale20k | 14.44 +- 0.23 | 13.02 +- 0.11 | 16.81 +- 0.15 | 17.42 +- 0.19 | +29.1 +- 1.56 | +3.64 +- 1.44 | | 78b-2t1c-avf-ethip6-ip6base | 19.21 +- 0.07 | 18.8 +- 0.12 | 24.85 +- 0.06 | 25.54 +- 0.09 | +32.16 +- 0.88 | +2.78 +- 0.44 | | 64b-2t1c-avf-ethip4-ip4base | 22.2 +- 0.14 | 19.92 +- 0.18 | 26.63 +- 0.29 | 27.17 +- 0.11 | +33.7 +- 1.88 | +2.05 +- 1.17 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 11.1 +- 0.08 | 10.87 +- 0.04 | 13.44 +- 0.05 | 13.67 +- 0.17 | +23.66 +- 0.61 | +1.7 +- 1.32 | | 78b-2t1c-avf-ethip6-ip6scale20k | 16.33 +- 0.05 | 16.15 +- 0.1 | 21.1 +- 0.06 | 21.3 +- 0.13 | +30.7 +- 0.85 | +0.92 +- 0.65 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 16.25 +- 0.08 | 15.93 +- 0.06 | 20.7 +- 0.05 | 20.81 +- 0.1 | +29.93 +- 0.58 | +0.55 +- 0.56 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 4.9 +- 0.02 | 4.92 +- 0.02 | 5.65 +- 0.01 | 5.66 +- 0.01 | +14.76 +- 0.47 | +0.35 +- 0.15 | | 64b-2t1c-avf-eth-l2patch | 37.34 +- 0.02 | 37.34 +- 0.03 | 37.06 +- 0.05 | 37.13 +- 0.07 | -0.76 +- 0.16 | +0.2 +- 0.23 | | 64b-2t1c-avf-eth-l2xcbase | 33.08 +- 0.11 | 31.69 +- 0.05 | 37.32 +- 0.03 | 37.33 +- 0.02 | +17.78 +- 0.21 | +0.03 +- 0.1 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 9.68 +- 0.06 | 9.97 +- 0.08 | 12.22 +- 0.09 | 12.22 +- 0.04 | +22.58 +- 1.34 | -0.01 +- 0.83 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 19.55 +- 0.21 | 18.65 +- 0.04 | 24.15 +- 0.07 | 24.07 +- 0.14 | +29.52 +- 0.46 | -0.33 +- 0.64 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 6.84 +- 0.03 | 6.83 +- 0.05 | 8.87 +- 0.06 | 8.84 +- 0.07 | +29.98 +- 1.23 | -0.36 +- 1.04 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-1tun-ip4base | 9.57 +- 0.06 | 8.96 +- 0.04 | 11.96 +- 0.06 | 11.9 +- 0.11 | +33.45 +- 0.92 | -0.46 +- 1.03 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-64tun-ip4base | 8.64 +- 0.06 | 8.09 +- 0.08 | 10.81 +- 0.08 | 10.75 +- 0.09 | +33.64 +- 1.65 | -0.56 +- 1.11 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-16tun-ip4base | 8.65 +- 0.05 | 8.16 +- 0.08 | 10.91 +- 0.11 | 10.85 +- 0.1 | +33.71 +- 1.86 | -0.58 +- 1.31 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 14.31 +- 0.07 | 13.6 +- 0.03 | 18.07 +- 0.04 | 17.96 +- 0.13 | +32.9 +- 0.44 | -0.63 +- 0.77 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 7.68 +- 0.03 | 7.91 +- 0.01 | 9.54 +- 0.07 | 9.45 +- 0.07 | +20.49 +- 0.88 | -0.94 +- 1.03 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-4tun-ip4base | 8.75 +- 0.06 | 8.28 +- 0.04 | 10.97 +- 0.06 | 10.87 +- 0.07 | +32.46 +- 0.97 | -0.96 +- 0.87 | | 64b-2t1c-avf-ethip4--ethip4udpgeneve-256tun-ip4base | 8.6 +- 0.05 | 7.88 +- 0.2 | 10.35 +- 0.18 | 10.23 +- 0.27 | +31.3 +- 4.07 | -1.19 +- 3.13 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 12.3 +- 0.11 | 11.78 +- 0.09 | 15.78 +- 0.19 | 15.57 +- 0.2 | +33.95 +- 1.96 | -1.31 +- 1.75 | | 78b-2t1c-ethip6-ip6scale20k | 10.07 +- 0.05 | 10.27 +- 0.03 | 12.38 +- 0.08 | 12.22 +- 0.15 | +20.63 +- 0.89 | -1.36 +- 1.4 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 9.18 +- 0.02 | 9.56 +- 0.02 | 13.08 +- 0.03 | 12.89 +- 0.05 | +36.76 +- 0.4 | -1.42 +- 0.46 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 22.84 +- 0.09 | 21.92 +- 0.07 | 28.27 +- 0.09 | 27.84 +- 0.09 | +28.94 +- 0.58 | -1.51 +- 0.44 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 6.85 +- 0.01 | 6.95 +- 0.01 | 8.54 +- 0.07 | 8.4 +- 0.04 | +22.94 +- 1.03 | -1.62 +- 0.92 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 9.7 +- 0.16 | 9.34 +- 0.05 | 12.64 +- 0.03 | 12.43 +- 0.07 | +35.31 +- 0.8 | -1.65 +- 0.61 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 18.07 +- 0.06 | 17.78 +- 0.04 | 23.51 +- 0.09 | 23.1 +- 0.13 | +32.19 +- 0.58 | -1.75 +- 0.67 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 12.79 +- 0.02 | 12.63 +- 0.08 | 17.0 +- 0.03 | 16.69 +- 0.09 | +34.55 +- 0.84 | -1.81 +- 0.55 | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 6.79 +- 0.01 | 6.49 +- 0.01 | 7.87 +- 0.06 | 7.72 +- 0.08 | +21.19 +- 0.92 | -1.89 +- 1.21 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 10.27 +- 0.23 | 10.32 +- 0.31 | 14.21 +- 0.05 | 13.89 +- 0.04 | +37.67 +- 4.11 | -2.25 +- 0.45 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 17.3 +- 0.06 | 17.11 +- 0.12 | 22.23 +- 0.16 | 21.6 +- 0.1 | +29.92 +- 1.3 | -2.79 +- 0.83 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 8.06 +- 0.47 | 7.46 +- 0.41 | 9.74 +- 0.33 | 9.27 +- 0.54 | +30.51 +- 8.5 | -4.84 +- 6.44 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 4.71 +- 0.03 | 5.12 +- 0.04 | 5.46 +- 0.01 | 5.11 +- 0.02 | +6.81 +- 0.76 | -6.5 +- 0.33 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 4.91 +- 0.07 | 5.37 +- 0.03 | 6.71 +- 0.03 | 5.74 +- 0.07 | +24.89 +- 0.89 | -14.53 +- 1.14 | +--------------------------------------------------------------+---------------+---------------+---------------+---------------+-----------------------+------------------------+ Test Case: Test cases executed for: MRR throughput on 2n-zn2 with xxv710. YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code. 2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.