+------------------------------------------------------------------------+---------------+---------------+---------------+---------------+----------------------+----------------------+ | Test Case | 2101.0-7 | 2106.0-7 | 2106.0-8 | 2110.0-8 | 2106.0-8 vs 2106.0-7 | 2110.0-8 vs 2106.0-8 | +------------------------------------------------------------------------+---------------+---------------+---------------+---------------+----------------------+----------------------+ | 78b-1t1c-ethip6-ip6base-iacldstbase | 6.04 +- 0.03 | 6.31 +- 0.02 | 6.32 +- 0.01 | 6.69 +- 0.05 | +0.14 +- 0.34 | +5.85 +- 0.85 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | NT | 3.19 +- 0.01 | 3.2 +- 0.02 | 3.39 +- 0.02 | +0.38 +- 0.58 | +5.83 +- 0.87 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm-udir | NT | 2.13 +- 0.0 | 2.13 +- 0.0 | 2.21 +- 0.0 | -0.07 +- 0.15 | +4.2 +- 0.15 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm-udir | NT | 1.8 +- 0.01 | 1.8 +- 0.01 | 1.87 +- 0.01 | +0.06 +- 0.72 | +4.07 +- 0.81 | | 64b-1t1c-ethip4-ip4base-iacldstbase | 6.34 +- 0.02 | 6.75 +- 0.02 | 6.8 +- 0.03 | 7.02 +- 0.03 | +0.65 +- 0.49 | +3.3 +- 0.67 | | 64b-1t1c-af-xdp-eth-l2patch | NT | 10.59 +- 0.08 | 1.2 +- 0.01 | 1.22 +- 0.01 | -88.66 +- 0.1 | +1.92 +- 0.79 | | 78b-1t1c-af-xdp-ethip6-ip6scale200k | NT | 4.21 +- 0.02 | 0.27 +- 0.0 | 0.27 +- 0.0 | -93.69 +- 0.04 | +0.79 +- 1.64 | | imix-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | NT | 0.25 +- 0.0 | 0.25 +- 0.0 | 0.25 +- 0.0 | +0.26 +- 0.12 | +0.12 +- 0.16 | | imix-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | NT | 0.24 +- 0.0 | 0.24 +- 0.0 | 0.24 +- 0.0 | +0.05 +- 0.27 | +0.08 +- 0.26 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | NT | 0.11 +- 0.0 | 0.11 +- 0.0 | 0.11 +- 0.0 | +0.11 +- 0.79 | +0.03 +- 0.71 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm-udir | NT | 0.41 +- 0.0 | 0.41 +- 0.0 | 0.41 +- 0.0 | -0.18 +- 0.69 | +0.01 +- 0.77 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | NT | 0.11 +- 0.0 | 0.11 +- 0.0 | 0.11 +- 0.0 | +0.15 +- 0.85 | -0.02 +- 0.77 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm-udir | NT | 0.45 +- 0.0 | 0.45 +- 0.0 | 0.45 +- 0.0 | +0.48 +- 0.71 | -0.03 +- 1.09 | | imix-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | NT | 0.24 +- 0.0 | 0.24 +- 0.0 | 0.24 +- 0.0 | +0.24 +- 0.2 | -0.07 +- 0.12 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | NT | 0.11 +- 0.0 | 0.11 +- 0.0 | 0.11 +- 0.0 | +0.19 +- 0.7 | -0.07 +- 0.62 | | 64b-1t1c-af-xdp-eth-l2bdscale10kmaclrn | NT | 7.84 +- 0.03 | 0.43 +- 0.0 | 0.43 +- 0.0 | -94.46 +- 0.03 | -0.12 +- 0.48 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm-udir | NT | 0.55 +- 0.0 | 0.55 +- 0.0 | 0.55 +- 0.0 | +0.05 +- 0.56 | -0.16 +- 0.55 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm-udir | NT | 0.52 +- 0.0 | 0.52 +- 0.0 | 0.52 +- 0.0 | +0.19 +- 0.67 | -0.21 +- 0.76 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm-udir | NT | 0.52 +- 0.0 | 0.52 +- 0.0 | 0.52 +- 0.0 | +0.33 +- 0.74 | -0.26 +- 0.56 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm-udir | NT | 0.4 +- 0.0 | 0.4 +- 0.0 | 0.4 +- 0.0 | -0.09 +- 0.55 | -0.28 +- 0.75 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm-udir | NT | 0.4 +- 0.0 | 0.4 +- 0.0 | 0.4 +- 0.0 | +0.34 +- 0.63 | -0.41 +- 0.58 | | 64b-1t1c-eth-l2xcbase-eth-2memif-1dcr | NT | 6.39 +- 0.03 | 6.38 +- 0.03 | 6.35 +- 0.04 | -0.16 +- 0.64 | -0.51 +- 0.71 | | 78b-1t1c-af-xdp-ethip6-ip6scale20k | NT | 5.87 +- 0.02 | 0.36 +- 0.0 | 0.36 +- 0.0 | -93.84 +- 0.04 | -0.58 +- 0.74 | | 64b-1t1c-af-xdp-eth-l2bdscale1mmaclrn | NT | 6.73 +- 0.03 | 0.38 +- 0.0 | 0.37 +- 0.0 | -94.41 +- 0.03 | -0.59 +- 0.31 | | imix-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm-udir | NT | 1.47 +- 0.0 | 1.47 +- 0.0 | 1.46 +- 0.0 | +0.19 +- 0.17 | -0.65 +- 0.17 | | imix-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm-udir | NT | 1.08 +- 0.0 | 1.09 +- 0.0 | 1.08 +- 0.0 | +0.15 +- 0.17 | -0.7 +- 0.16 | | imix-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm-udir | NT | 1.29 +- 0.0 | 1.29 +- 0.0 | 1.28 +- 0.0 | +0.03 +- 0.21 | -0.73 +- 0.28 | | 64b-1t1c-af-xdp-eth-l2bdscale100kmaclrn | NT | 7.45 +- 0.02 | 0.42 +- 0.0 | 0.41 +- 0.0 | -94.39 +- 0.01 | -0.82 +- 0.36 | | imix-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm-udir | NT | 1.21 +- 0.0 | 1.21 +- 0.0 | 1.2 +- 0.0 | +0.37 +- 0.13 | -0.86 +- 0.17 | | imix-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm-udir | NT | 1.31 +- 0.0 | 1.31 +- 0.0 | 1.29 +- 0.0 | -0.02 +- 0.11 | -0.86 +- 0.14 | | imix-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm-udir | NT | 1.1 +- 0.0 | 1.1 +- 0.0 | 1.09 +- 0.0 | +0.18 +- 0.14 | -0.87 +- 0.14 | | 64b-1t1c-af-xdp-eth-l2bdbasemaclrn | NT | 8.88 +- 0.08 | 0.55 +- 0.0 | 0.55 +- 0.01 | -93.76 +- 0.07 | -1.46 +- 1.15 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | NT | 5.06 +- 0.03 | 5.09 +- 0.03 | 5.01 +- 0.03 | +0.47 +- 0.85 | -1.49 +- 0.81 | | 64b-1t1c-ethip4-ip4base-eth-2memif-1dcr | NT | 4.53 +- 0.02 | 4.51 +- 0.04 | 4.42 +- 0.03 | -0.44 +- 0.99 | -1.92 +- 1.12 | | 78b-1t1c-af-xdp-ethip6-ip6base | NT | 7.33 +- 0.11 | 0.46 +- 0.0 | 0.45 +- 0.0 | -93.77 +- 0.11 | -1.93 +- 1.35 | | 64b-1t1c-af-xdp-ethip4-ip4base | NT | 8.01 +- 0.03 | 0.49 +- 0.0 | 0.48 +- 0.0 | -93.91 +- 0.05 | -2.04 +- 0.97 | | 64b-1t1c-af-xdp-ethip4-ip4scale200k | NT | 7.44 +- 0.08 | 0.44 +- 0.0 | 0.43 +- 0.0 | -94.04 +- 0.07 | -2.05 +- 1.14 | | 78b-1t1c-ethip6-ip6scale200k | 4.3 +- 0.02 | 4.58 +- 0.01 | 4.82 +- 0.03 | 4.72 +- 0.05 | +5.45 +- 0.66 | -2.13 +- 1.2 | | 64b-1t1c-af-xdp-ethip4-ip4scale20k | NT | 7.5 +- 0.1 | 0.45 +- 0.0 | 0.44 +- 0.0 | -93.99 +- 0.09 | -2.35 +- 0.82 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 7.02 +- 0.02 | 7.9 +- 0.05 | 7.93 +- 0.05 | 7.74 +- 0.04 | +0.44 +- 0.9 | -2.45 +- 0.77 | | 78b-1t1c-ethip6-ip6scale2m | 3.95 +- 0.01 | 4.12 +- 0.03 | 4.39 +- 0.02 | 4.28 +- 0.03 | +6.67 +- 1.02 | -2.64 +- 0.89 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 5.77 +- 0.02 | 6.35 +- 0.04 | 6.32 +- 0.03 | 6.12 +- 0.03 | -0.43 +- 0.78 | -3.08 +- 0.66 | | 64b-1t1c-eth-l2bdscale100kmaclrn | 7.77 +- 0.02 | 8.3 +- 0.01 | 8.31 +- 0.02 | 8.06 +- 0.01 | +0.16 +- 0.26 | -3.08 +- 0.22 | | 64b-1t1c-eth-l2bdscale10kmaclrn | 8.1 +- 0.04 | 8.6 +- 0.03 | 8.64 +- 0.03 | 8.36 +- 0.02 | +0.39 +- 0.49 | -3.22 +- 0.41 | | 64b-1t1c-eth-l2patch | 18.42 +- 0.17 | 20.32 +- 0.07 | 20.37 +- 0.17 | 19.7 +- 0.2 | +0.23 +- 0.89 | -3.28 +- 1.27 | | 64b-1t1c-eth-l2bdbasemaclrn | 10.22 +- 0.04 | 11.31 +- 0.07 | 11.39 +- 0.07 | 11.02 +- 0.07 | +0.72 +- 0.87 | -3.32 +- 0.84 | | 78b-1t1c-ethip6-ip6scale20k | 6.56 +- 0.03 | 6.92 +- 0.02 | 6.96 +- 0.04 | 6.72 +- 0.04 | +0.52 +- 0.6 | -3.37 +- 0.82 | | 64b-1t1c-eth-l2bdscale1mmaclrn | 6.62 +- 0.02 | 7.06 +- 0.03 | 7.15 +- 0.01 | 6.89 +- 0.01 | +1.24 +- 0.42 | -3.58 +- 0.22 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 4.81 +- 0.02 | 5.4 +- 0.02 | 5.38 +- 0.03 | 5.18 +- 0.03 | -0.2 +- 0.68 | -3.72 +- 0.79 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 4.84 +- 0.01 | 5.4 +- 0.03 | 5.4 +- 0.04 | 5.19 +- 0.04 | -0.04 +- 0.88 | -3.83 +- 0.96 | | 78b-1t1c-ethip6-ip6base | 8.67 +- 0.04 | 9.26 +- 0.06 | 9.27 +- 0.06 | 8.92 +- 0.06 | +0.14 +- 0.97 | -3.84 +- 0.94 | | 64b-1t1c-ethip4-ip4scale20k | 8.78 +- 0.05 | 9.79 +- 0.05 | 9.69 +- 0.05 | 9.32 +- 0.05 | -1.02 +- 0.75 | -3.85 +- 0.74 | | 64b-1t1c-eth-l2xcbase | 13.19 +- 0.05 | 14.61 +- 0.1 | 14.65 +- 0.09 | 14.04 +- 0.12 | +0.28 +- 0.93 | -4.12 +- 1.01 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 4.61 +- 0.02 | 5.19 +- 0.02 | 5.22 +- 0.03 | 5.0 +- 0.03 | +0.6 +- 0.67 | -4.14 +- 0.72 | | 64b-1t1c-af-xdp-eth-l2xcbase | NT | 10.64 +- 0.03 | 0.81 +- 0.01 | 0.77 +- 0.0 | -92.41 +- 0.08 | -4.34 +- 1.01 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 5.5 +- 0.02 | 6.1 +- 0.04 | 6.13 +- 0.03 | 5.84 +- 0.03 | +0.54 +- 0.81 | -4.79 +- 0.67 | | 64b-1t1c-ethip4-ip4scale200k | 8.65 +- 0.04 | 9.42 +- 0.06 | 9.48 +- 0.07 | 9.02 +- 0.06 | +0.64 +- 0.96 | -4.92 +- 0.94 | | 64b-1t1c-ethip4-ip4base | 9.45 +- 0.05 | 10.42 +- 0.02 | 10.48 +- 0.07 | 9.97 +- 0.08 | +0.59 +- 0.72 | -4.92 +- 1.03 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 4.91 +- 0.02 | 5.59 +- 0.03 | 5.58 +- 0.04 | 5.3 +- 0.03 | -0.13 +- 0.89 | -5.07 +- 0.84 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 5.9 +- 0.04 | 6.38 +- 0.04 | 6.4 +- 0.03 | 6.05 +- 0.04 | +0.41 +- 0.82 | -5.52 +- 0.81 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 5.99 +- 0.02 | 6.64 +- 0.04 | 6.64 +- 0.04 | 6.24 +- 0.04 | +0.0 +- 0.86 | -6.02 +- 0.79 | | 64b-1t1c-ethip4-ip4scale2m | 7.59 +- 0.05 | 8.12 +- 0.1 | 8.44 +- 0.04 | 7.92 +- 0.04 | +3.87 +- 1.33 | -6.14 +- 0.65 | +------------------------------------------------------------------------+---------------+---------------+---------------+---------------+----------------------+----------------------+ Test Case: Test cases executed for: MRR throughput on 2n-tx2 with xl710. YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "7" for CSIT rls2106, "8" for CSIT rls2110). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2106.0-8 vs 2106.0-7: Compares CSIT environment current vs previous with previous VPP code. 2110.0-8 vs 2106.0-8: Compares VPP code current vs previous in the current CSIT environment.