+------------------------------------------------------------------------+---------------+---------------+----------------+----------------+----------------------+----------------------+ | Test Case | 2101.0-7 | 2106.0-7 | 2106.0-8 | 2110.0-8 | 2106.0-8 vs 2106.0-7 | 2110.0-8 vs 2106.0-8 | +------------------------------------------------------------------------+---------------+---------------+----------------+----------------+----------------------+----------------------+ | 64b-2t2c-af-xdp-eth-l2bdscale100kmaclrn | NT | 10.53 +- NaN | 0.16 +- 0.11 | 0.21 +- 0.15 | -98.5 +- NaN | +30.74 +- 127.77 | | 64b-2t2c-eth-l2xcbase | 25.77 +- 0.88 | 25.94 +- 3.36 | 17.68 +- 10.29 | 21.18 +- 5.95 | -31.85 +- 40.65 | +19.83 +- 77.47 | | 64b-2t2c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 11.6 +- 0.29 | 11.58 +- 1.3 | 8.63 +- 3.96 | 9.8 +- 2.35 | -25.44 +- 35.18 | +13.52 +- 58.7 | | 64b-2t2c-eth-l2bdscale10kmaclrn | 15.96 +- 0.37 | 16.79 +- 0.33 | 10.64 +- 5.93 | 11.82 +- 5.85 | -36.63 +- 35.36 | +11.13 +- 82.83 | | 64b-2t2c-af-xdp-eth-l2bdscale10kmaclrn | NT | 10.17 +- NaN | 0.21 +- 0.13 | 0.23 +- 0.12 | -97.9 +- NaN | +8.5 +- 86.22 | | 64b-2t2c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm-udir | NT | 2.09 +- 0.08 | 1.9 +- 0.33 | 2.03 +- 0.36 | -8.88 +- 16.09 | +6.58 +- 26.55 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm-udir | NT | 2.85 +- 0.08 | 2.63 +- 0.23 | 2.79 +- 0.15 | -7.66 +- 8.41 | +5.73 +- 10.82 | | 64b-2t2c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm-udir | NT | 3.57 +- 0.05 | 3.28 +- 0.49 | 3.47 +- 0.53 | -8.07 +- 13.76 | +5.63 +- 22.53 | | 64b-2t2c-ethip4-ip4scale2m | 14.88 +- 0.49 | 16.19 +- 0.45 | 14.42 +- 5.1 | 15.12 +- 2.87 | -10.96 +- 31.6 | +4.86 +- 42.12 | | 64b-2t2c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 5.93 +- 0.04 | 5.93 +- 0.11 | 5.63 +- 0.73 | 5.9 +- 0.81 | -5.12 +- 12.47 | +4.79 +- 19.78 | | 64b-2t2c-ethip4-ip4base-eth-2memif-1dcr | NT | 7.09 +- 1.22 | 7.16 +- 1.34 | 7.49 +- 0.6 | +1.02 +- 25.66 | +4.64 +- 21.33 | | 64b-2t2c-eth-l2bdbasemaclrn-eth-2memif-1dcr | NT | 8.6 +- 0.14 | 7.99 +- 1.82 | 8.31 +- 1.36 | -7.06 +- 21.21 | +3.96 +- 29.15 | | 64b-2t2c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 9.58 +- 0.09 | 8.89 +- 0.62 | 7.35 +- 2.01 | 7.57 +- 1.52 | -17.3 +- 23.3 | +2.88 +- 34.84 | | 78b-2t2c-ethip6-ip6base | 17.65 +- 0.4 | 17.48 +- 0.37 | 13.82 +- 5.65 | 14.2 +- 3.97 | -20.96 +- 32.36 | +2.73 +- 50.89 | | 78b-2t2c-ethip6-ip6base-iacldstbase | 11.78 +- 0.37 | 10.6 +- 1.91 | 8.56 +- 2.91 | 8.78 +- 3.3 | -19.24 +- 31.04 | +2.57 +- 51.93 | | 64b-2t2c-ethip4-ip4base | 19.14 +- 0.18 | 18.96 +- 3.94 | 13.37 +- 7.4 | 13.66 +- 5.6 | -29.44 +- 41.73 | +2.14 +- 70.34 | | imix-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm-udir | NT | 2.39 +- 0.1 | 2.28 +- 0.16 | 2.32 +- 0.11 | -4.69 +- 7.83 | +1.87 +- 8.78 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | NT | 0.22 +- 0.0 | 0.22 +- 0.0 | 0.22 +- 0.0 | -0.47 +- 0.67 | +0.47 +- 0.6 | | 64b-2t2c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm-udir | NT | 0.89 +- 0.0 | 0.89 +- 0.0 | 0.89 +- 0.0 | +0.37 +- 0.49 | +0.13 +- 0.53 | | 1518b-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | NT | 0.21 +- 0.0 | 0.21 +- 0.0 | 0.21 +- 0.0 | +0.14 +- 0.48 | -0.03 +- 0.48 | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm-udir | NT | 1.04 +- 0.0 | 1.04 +- 0.0 | 1.04 +- 0.0 | +0.09 +- 0.28 | -0.04 +- 0.25 | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | NT | 0.49 +- 0.0 | 0.49 +- 0.0 | 0.48 +- 0.0 | +0.03 +- 0.22 | -0.04 +- 0.19 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | NT | 0.5 +- 0.0 | 0.5 +- 0.0 | 0.5 +- 0.0 | +0.26 +- 0.27 | -0.07 +- 0.3 | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | NT | 0.21 +- 0.0 | 0.21 +- 0.0 | 0.21 +- 0.0 | +0.3 +- 0.59 | -0.14 +- 0.56 | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm-udir | NT | 0.79 +- 0.0 | 0.79 +- 0.0 | 0.79 +- 0.0 | +0.09 +- 0.24 | -0.17 +- 0.23 | | imix-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | NT | 0.48 +- 0.0 | 0.48 +- 0.0 | 0.48 +- 0.0 | +0.22 +- 0.2 | -0.24 +- 0.17 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm-udir | NT | 1.09 +- 0.0 | 1.09 +- 0.0 | 1.09 +- 0.0 | +0.13 +- 0.23 | -0.25 +- 0.23 | | 1518b-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm-udir | NT | 1.01 +- 0.01 | 1.01 +- 0.01 | 1.01 +- 0.01 | +0.78 +- 1.17 | -0.27 +- 0.83 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm-udir | NT | 0.82 +- 0.0 | 0.82 +- 0.0 | 0.82 +- 0.0 | +0.27 +- 0.16 | -0.31 +- 0.15 | | 1518b-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm-udir | NT | 0.78 +- 0.0 | 0.78 +- 0.0 | 0.78 +- 0.0 | +0.45 +- 0.46 | -0.35 +- 0.4 | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm-udir | NT | 2.16 +- 0.02 | 2.13 +- 0.02 | 2.12 +- 0.02 | -1.63 +- 1.44 | -0.35 +- 1.59 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm-udir | NT | 2.38 +- 0.01 | 2.36 +- 0.04 | 2.34 +- 0.02 | -1.08 +- 1.58 | -0.55 +- 1.69 | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm-udir | NT | 2.57 +- 0.04 | 2.49 +- 0.14 | 2.47 +- 0.1 | -3.33 +- 5.52 | -0.72 +- 6.73 | | imix-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm-udir | NT | 2.05 +- 0.04 | 2.02 +- 0.05 | 1.98 +- 0.05 | -1.27 +- 3.06 | -2.0 +- 3.46 | | 78b-2t2c-ethip6-ip6scale200k | 7.61 +- 0.72 | 10.75 +- 0.17 | 11.13 +- 0.3 | 10.9 +- 0.12 | +3.45 +- 3.26 | -2.03 +- 2.9 | | 64b-2t2c-eth-l2xcbase-eth-2memif-1dcr | NT | 10.63 +- 0.1 | 9.66 +- 2.39 | 9.4 +- 2.08 | -9.17 +- 22.5 | -2.61 +- 32.31 | | 64b-2t2c-ethip4udp-ip4base-oacl50sf-10kflows | 11.92 +- 0.14 | 12.1 +- 1.0 | 9.68 +- 3.78 | 9.37 +- 3.1 | -20.02 +- 31.93 | -3.15 +- 49.6 | | 78b-2t2c-ethip6-ip6scale2m | 7.5 +- 0.15 | 9.08 +- 0.58 | 8.69 +- 1.35 | 8.37 +- 1.59 | -4.31 +- 16.03 | -3.7 +- 23.63 | | 64b-2t2c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 11.02 +- 0.26 | 11.7 +- 0.16 | 8.56 +- 3.64 | 8.19 +- 2.32 | -26.78 +- 31.14 | -4.34 +- 48.89 | | 64b-2t2c-ethip4udp-ip4base-iacl50sl-10kflows | 9.72 +- 0.22 | 9.16 +- 0.39 | 7.37 +- 2.15 | 6.93 +- 2.21 | -19.55 +- 23.77 | -5.92 +- 40.68 | | 64b-2t2c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 9.02 +- 0.32 | 8.82 +- 0.58 | 7.71 +- 1.16 | 7.13 +- 1.3 | -12.53 +- 14.31 | -7.59 +- 21.84 | | 64b-2t2c-eth-l2bdscale1mmaclrn | 12.49 +- 0.48 | 11.47 +- 1.64 | 9.95 +- 3.3 | 9.09 +- 3.47 | -13.27 +- 31.3 | -8.64 +- 46.18 | | 64b-2t2c-ethip4-ip4scale200k | 17.36 +- 0.47 | 16.98 +- 0.45 | 17.39 +- 0.45 | 15.74 +- 1.66 | +2.45 +- 3.79 | -9.52 +- 9.83 | | 64b-2t2c-ethip4udp-ip4base-oacl50sl-10kflows | 9.72 +- 0.12 | 9.03 +- 0.88 | 8.52 +- 0.74 | 7.67 +- 1.79 | -5.69 +- 12.31 | -9.92 +- 22.48 | | 64b-2t2c-eth-l2bdbasemaclrn | 20.37 +- 0.53 | 21.15 +- 2.11 | 19.83 +- 4.44 | 17.48 +- 6.01 | -6.24 +- 22.98 | -11.87 +- 36.16 | | 64b-2t2c-ethip4-ip4scale20k | 18.12 +- 0.24 | 17.6 +- 1.49 | 15.6 +- 4.71 | 13.73 +- 4.77 | -11.35 +- 27.78 | -12.01 +- 40.49 | | 64b-2t2c-ethip4-ip4base-iacldstbase | 12.69 +- 0.33 | 12.19 +- 0.38 | 8.88 +- 3.21 | 7.41 +- 2.58 | -27.14 +- 26.42 | -16.62 +- 41.83 | | 64b-2t2c-dot1q-l2bdbasemaclrn | 13.66 +- 0.43 | 15.16 +- 0.17 | 11.59 +- 4.86 | 9.66 +- 4.75 | -23.53 +- 32.09 | -16.69 +- 53.85 | | 64b-2t2c-ethip4udp-ip4base-iacl50sf-10kflows | 12.09 +- 0.18 | 12.11 +- 2.68 | 10.83 +- 2.75 | 8.92 +- 3.16 | -10.57 +- 30.12 | -17.58 +- 35.92 | | 64b-2t2c-af-xdp-eth-l2bdscale1mmaclrn | NT | 8.66 +- NaN | 0.18 +- 0.09 | 0.14 +- 0.11 | -97.93 +- NaN | -23.6 +- 74.44 | | 64b-2t2c-eth-l2patch | 31.24 +- 1.07 | 35.9 +- 1.89 | 22.25 +- 15.65 | 16.62 +- 12.81 | -38.02 +- 43.72 | -25.31 +- 77.92 | | 64b-2t2c-eth-l2bdscale100kmaclrn | 15.46 +- 0.49 | 15.93 +- 0.17 | 12.65 +- 4.57 | 9.32 +- 4.77 | -20.63 +- 28.71 | -26.34 +- 46.15 | | 78b-2t2c-ethip6-ip6scale20k | 13.35 +- 0.48 | 13.74 +- 0.26 | 13.01 +- 1.86 | 8.3 +- 3.51 | -5.29 +- 13.68 | -36.18 +- 28.48 | +------------------------------------------------------------------------+---------------+---------------+----------------+----------------+----------------------+----------------------+ Test Case: Test cases executed for: NDR throughput on 2n-tx2 with xl710. YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "7" for CSIT rls2106, "8" for CSIT rls2110). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2106.0-8 vs 2106.0-7: Compares CSIT environment current vs previous with previous VPP code. 2110.0-8 vs 2106.0-8: Compares VPP code current vs previous in the current CSIT environment.