+------------------------------------------------------------------------+---------------+---------------+---------------+---------------+-----------------------+------------------------+ | Test Case | 2110.0-9 | 2202.0-9 | 2202.0-10 | 2206.0-10 | 2202.0-10 vs 2202.0-9 | 2206.0-10 vs 2202.0-10 | +------------------------------------------------------------------------+---------------+---------------+---------------+---------------+-----------------------+------------------------+ | 78b-2t2c-af-xdp-ethip6-ip6scale200k | 0.14 +- 0.09 | 0.11 +- 0.04 | 0.17 +- 0.09 | 0.23 +- 0.09 | +61.77 +- 104.12 | +30.71 +- 88.32 | | 64b-2t2c-af-xdp-ethip4-ip4scale20k | 0.16 +- 0.1 | 0.17 +- 0.12 | 0.17 +- 0.05 | 0.22 +- 0.09 | -1.79 +- 71.64 | +26.43 +- 65.74 | | 64b-2t2c-af-xdp-eth-l2bdscale10kmaclrn | 0.12 +- 0.08 | 0.13 +- 0.09 | 0.16 +- 0.07 | 0.2 +- 0.05 | +28.19 +- 101.73 | +21.71 +- 59.8 | | 64b-2t2c-af-xdp-eth-l2patch | 0.14 +- 0.09 | 0.11 +- 0.04 | 0.15 +- 0.08 | 0.17 +- 0.09 | +37.78 +- 97.1 | +19.21 +- 92.96 | | 64b-2t2c-ethip4-ip4base-eth-2memif-1dcr | 7.72 +- 0.14 | 6.56 +- 0.55 | 6.13 +- 0.64 | 7.21 +- 0.2 | -6.54 +- 12.52 | +17.62 +- 12.79 | | 64b-2t2c-ethip4udp-ip4base-iacl50sf-10kflows | 11.39 +- 2.32 | 9.16 +- 0.28 | 9.04 +- 0.24 | 10.54 +- 0.1 | -1.33 +- 3.99 | +16.64 +- 3.26 | | 64b-2t2c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 5.39 +- 0.85 | 5.44 +- 0.18 | 5.41 +- 0.26 | 6.3 +- 0.06 | -0.55 +- 5.81 | +16.5 +- 5.73 | | 64b-2t2c-ethip4-ip4scale20k | 16.36 +- 3.31 | 13.26 +- 0.44 | 12.52 +- 1.68 | 14.57 +- 0.21 | -5.63 +- 13.02 | +16.37 +- 15.67 | | 78b-2t2c-ethip6-ip6scale200k | 10.82 +- 0.21 | 9.0 +- 0.26 | 7.61 +- 0.69 | 8.8 +- 0.17 | -15.41 +- 8.07 | +15.65 +- 10.73 | | 64b-2t2c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 11.61 +- 0.25 | 9.07 +- 0.31 | 8.88 +- 0.28 | 10.24 +- 0.06 | -2.06 +- 4.57 | +15.3 +- 3.74 | | 64b-2t2c-eth-l2xcbase | 26.14 +- 1.89 | 20.04 +- 0.49 | 18.47 +- 2.26 | 21.17 +- 0.65 | -7.84 +- 11.49 | +14.58 +- 14.43 | | 64b-2t2c-ethip4udp-ip4base-oacl50sf-10kflows | 10.32 +- 2.83 | 9.08 +- 0.28 | 8.81 +- 0.75 | 10.07 +- 0.23 | -3.01 +- 8.84 | +14.36 +- 10.13 | | 64b-2t2c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 10.63 +- 1.71 | 8.77 +- 0.25 | 8.54 +- 0.32 | 9.73 +- 0.05 | -2.56 +- 4.54 | +13.88 +- 4.28 | | 64b-2t2c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm-udir | 2.16 +- 0.08 | 2.0 +- 0.08 | 2.01 +- 0.13 | 2.28 +- 0.03 | +0.46 +- 7.78 | +13.52 +- 7.65 | | 64b-2t2c-ethip4udp-ip4base-oacl50sl-10kflows | 8.9 +- 0.49 | 7.89 +- 0.2 | 7.53 +- 0.69 | 8.49 +- 0.1 | -4.59 +- 9.09 | +12.7 +- 10.42 | | 64b-2t2c-eth-l2patch | 34.48 +- 3.59 | 27.21 +- 1.22 | 26.2 +- 1.33 | 29.45 +- 0.29 | -3.71 +- 6.51 | +12.38 +- 5.8 | | 64b-2t2c-ethip4-ip4base | 19.03 +- 0.27 | 14.68 +- 0.55 | 14.24 +- 0.88 | 15.97 +- 0.14 | -2.96 +- 7.03 | +12.15 +- 7.01 | | 64b-2t2c-eth-l2bdbasemaclrn | 18.24 +- 5.77 | 15.98 +- 0.48 | 15.23 +- 1.06 | 17.06 +- 0.19 | -4.7 +- 7.22 | +12.05 +- 7.9 | | 64b-2t2c-ethip4ipsec1spe-cache-ip4base-policy-outbound-nocrypto | NT | 8.12 +- 0.17 | 7.75 +- 0.29 | 8.67 +- 0.12 | -4.45 +- 4.13 | +11.75 +- 4.52 | | 64b-2t2c-eth-l2xcbase-eth-2memif-1dcr | 10.47 +- 0.29 | 8.2 +- 1.23 | 8.51 +- 0.87 | 9.51 +- 0.23 | +3.69 +- 18.82 | +11.75 +- 11.75 | | 64b-2t2c-eth-l2bdscale10kmaclrn | 14.75 +- 3.54 | 13.29 +- 0.28 | 12.42 +- 1.05 | 13.88 +- 0.23 | -6.52 +- 8.17 | +11.75 +- 9.67 | | 64b-2t2c-af-xdp-ethip4-ip4base | 0.09 +- 0.03 | 0.12 +- 0.08 | 0.17 +- 0.09 | 0.19 +- 0.09 | +49.29 +- 130.46 | +11.24 +- 79.25 | | 64b-2t2c-dot1q-l2bdbasemaclrn | 12.87 +- 3.57 | 11.37 +- 0.37 | 11.2 +- 0.61 | 12.38 +- 0.36 | -1.54 +- 6.24 | +10.57 +- 6.81 | | 64b-2t2c-ethip4ipsec100spe-cache-ip4base-policy-outbound-nocrypto | NT | 8.16 +- 0.1 | 7.85 +- 0.26 | 8.65 +- 0.22 | -3.72 +- 3.4 | +10.12 +- 4.56 | | 64b-2t2c-ethip4ipsec1000spe-cache-ip4base-policy-outbound-nocrypto | NT | 7.51 +- 0.74 | 7.94 +- 0.27 | 8.74 +- 0.06 | +5.67 +- 10.94 | +10.05 +- 3.77 | | 64b-2t2c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm-udir | 3.62 +- 0.33 | 3.3 +- 0.16 | 3.4 +- 0.09 | 3.74 +- 0.04 | +3.17 +- 5.63 | +10.04 +- 3.26 | | 78b-2t2c-ethip6-ip6scale20k | 13.49 +- 0.13 | 10.93 +- 0.35 | 10.7 +- 0.38 | 11.75 +- 0.1 | -2.16 +- 4.67 | +9.87 +- 4.0 | | 64b-2t2c-ethip4udp-ip4base-iacl50sl-10kflows | 8.22 +- 1.41 | 8.06 +- 0.09 | 7.75 +- 0.29 | 8.49 +- 0.28 | -3.91 +- 3.73 | +9.54 +- 5.44 | | 64b-2t2c-ethip4ipsec1000spe-ip4base-policy-outbound-nocrypto | 0.73 +- 0.0 | 0.57 +- 0.01 | 0.56 +- 0.01 | 0.61 +- 0.0 | -0.78 +- 1.48 | +9.21 +- 1.01 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm-udir | 0.82 +- 0.0 | 0.8 +- 0.0 | 0.8 +- 0.0 | 0.87 +- 0.0 | -0.17 +- 0.3 | +9.08 +- 0.34 | | 64b-2t2c-ethip4ipsec100spe-ip4base-policy-outbound-nocrypto | 5.17 +- 0.37 | 4.16 +- 0.07 | 4.11 +- 0.07 | 4.48 +- 0.02 | -1.1 +- 2.38 | +8.92 +- 1.84 | | 64b-2t2c-eth-l2bdscale100kmaclrn | 14.12 +- 3.25 | 12.42 +- 0.39 | 12.2 +- 0.32 | 13.27 +- 0.31 | -1.72 +- 4.04 | +8.79 +- 3.83 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm-udir | 2.36 +- 0.03 | 2.34 +- 0.09 | 2.3 +- 0.1 | 2.5 +- 0.01 | -1.79 +- 5.92 | +8.63 +- 4.91 | | 64b-2t2c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 8.29 +- 1.3 | 6.96 +- 0.55 | 7.13 +- 0.57 | 7.73 +- 0.17 | +2.4 +- 11.49 | +8.44 +- 8.94 | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm-udir | 0.79 +- 0.0 | 0.78 +- 0.0 | 0.78 +- 0.0 | 0.85 +- 0.0 | -0.02 +- 0.19 | +8.26 +- 0.24 | | 1518b-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm-udir | 0.78 +- 0.0 | 0.78 +- 0.0 | 0.78 +- 0.0 | 0.84 +- 0.0 | -0.19 +- 0.23 | +7.86 +- 0.24 | | 64b-2t2c-ethip4-ip4scale200k | 16.36 +- 0.16 | 13.13 +- 0.3 | 11.71 +- 0.31 | 12.59 +- 0.29 | -10.86 +- 3.15 | +7.58 +- 3.8 | | 64b-2t2c-ethip4ipsec1spe-ip4base-policy-outbound-nocrypto | 10.15 +- 2.74 | 9.26 +- 0.79 | 9.36 +- 0.23 | 10.0 +- 0.21 | +1.04 +- 8.97 | +6.85 +- 3.5 | | 78b-2t2c-ethip6-ip6base | 16.31 +- 1.73 | 13.63 +- 0.32 | 13.35 +- 0.39 | 14.22 +- 0.2 | -2.03 +- 3.69 | +6.53 +- 3.46 | | 78b-2t2c-ethip6-ip6base-iacldstbase | 10.89 +- 2.63 | 9.78 +- 0.29 | 9.68 +- 0.25 | 10.28 +- 0.87 | -1.08 +- 3.89 | +6.18 +- 9.41 | | 64b-2t2c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm-udir | 0.89 +- 0.0 | 0.72 +- 0.01 | 0.71 +- 0.03 | 0.75 +- 0.0 | -1.79 +- 3.92 | +5.84 +- 4.03 | | 64b-2t2c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 8.45 +- 0.3 | 7.5 +- 0.26 | 7.63 +- 0.14 | 8.08 +- 0.32 | +1.82 +- 4.05 | +5.82 +- 4.57 | | 64b-2t2c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 8.76 +- 0.38 | 7.96 +- 0.22 | 7.79 +- 0.23 | 8.17 +- 0.3 | -2.1 +- 3.92 | +4.89 +- 4.96 | | imix-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm-udir | 2.04 +- 0.03 | 2.06 +- 0.15 | 2.1 +- 0.07 | 2.18 +- 0.01 | +1.78 +- 8.05 | +4.19 +- 3.37 | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm-udir | 2.14 +- 0.02 | 2.19 +- 0.06 | 2.22 +- 0.02 | 2.29 +- 0.01 | +1.26 +- 3.1 | +3.44 +- 1.29 | | 64b-2t2c-ethip4-ip4base-iacldstbase | 10.3 +- 2.91 | 9.73 +- 0.3 | 9.75 +- 0.25 | 9.96 +- 1.11 | +0.21 +- 4.04 | +2.18 +- 11.67 | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm-udir | 2.54 +- 0.04 | 2.55 +- 0.03 | 2.51 +- 0.18 | 2.56 +- 0.02 | -1.59 +- 7.32 | +2.04 +- 7.53 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.22 +- 0.0 | 0.22 +- 0.0 | 0.22 +- 0.0 | 0.22 +- 0.0 | -0.47 +- 0.65 | +0.68 +- 0.53 | | imix-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm-udir | 2.27 +- 0.17 | 2.4 +- 0.07 | 2.42 +- 0.08 | 2.44 +- 0.01 | +0.92 +- 4.51 | +0.49 +- 3.39 | | imix-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.48 +- 0.0 | 0.48 +- 0.0 | 0.47 +- 0.0 | 0.48 +- 0.0 | -0.5 +- 0.21 | +0.49 +- 0.17 | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.48 +- 0.0 | 0.48 +- 0.0 | 0.48 +- 0.0 | 0.48 +- 0.0 | -0.49 +- 0.22 | +0.43 +- 0.25 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm-udir | 2.77 +- 0.15 | 2.82 +- 0.05 | 2.81 +- 0.04 | 2.82 +- 0.02 | -0.38 +- 2.17 | +0.41 +- 1.49 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.5 +- 0.0 | 0.5 +- 0.0 | 0.49 +- 0.0 | 0.5 +- 0.0 | -0.48 +- 0.28 | +0.41 +- 0.22 | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.21 +- 0.0 | 0.21 +- 0.0 | 0.21 +- 0.0 | 0.21 +- 0.0 | +0.33 +- 1.02 | +0.17 +- 0.92 | | 1518b-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha-udir | 0.21 +- 0.0 | 0.21 +- 0.0 | 0.21 +- 0.0 | 0.21 +- 0.0 | -0.14 +- 0.66 | -0.25 +- 0.51 | | 64b-2t2c-af-xdp-eth-l2bdbasemaclrn | 0.15 +- 0.11 | 0.12 +- 0.11 | 0.19 +- 0.1 | 0.18 +- 0.1 | +49.88 +- 149.9 | -1.83 +- 75.12 | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm-udir | 1.04 +- 0.0 | 1.02 +- 0.0 | 1.02 +- 0.0 | 1.0 +- 0.0 | -0.09 +- 0.26 | -1.89 +- 0.26 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm-udir | 1.09 +- 0.0 | 1.06 +- 0.0 | 1.06 +- 0.0 | 1.04 +- 0.0 | -0.1 +- 0.16 | -2.17 +- 0.17 | | 1518b-2t2c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm-udir | 1.01 +- 0.0 | 1.01 +- 0.0 | 1.01 +- 0.0 | 0.99 +- 0.0 | +0.32 +- 0.42 | -2.23 +- 0.44 | | 64b-2t2c-af-xdp-ethip4-ip4scale200k | 0.14 +- 0.07 | 0.1 +- 0.05 | 0.18 +- 0.1 | 0.17 +- 0.09 | +76.74 +- 129.56 | -5.74 +- 73.46 | | 64b-2t2c-af-xdp-eth-l2xcbase | 0.14 +- 0.05 | 0.12 +- 0.05 | 0.21 +- 0.09 | 0.19 +- 0.09 | +80.92 +- 108.28 | -10.16 +- 57.98 | | 64b-2t2c-af-xdp-eth-l2bdscale100kmaclrn | 0.18 +- 0.1 | 0.14 +- 0.12 | 0.17 +- 0.1 | 0.15 +- 0.05 | +18.22 +- 122.35 | -12.17 +- 59.32 | | 78b-2t2c-af-xdp-ethip6-ip6base | 0.14 +- 0.13 | 0.15 +- 0.1 | 0.22 +- 0.07 | 0.16 +- 0.09 | +47.39 +- 108.53 | -25.97 +- 47.77 | | 78b-2t2c-af-xdp-ethip6-ip6scale20k | 0.12 +- 0.04 | 0.17 +- 0.12 | 0.23 +- 0.07 | 0.17 +- 0.05 | +34.91 +- 99.6 | -26.2 +- 29.3 | +------------------------------------------------------------------------+---------------+---------------+---------------+---------------+-----------------------+------------------------+ Test Case: Test cases executed for: NDR throughput on 2n-tx2 with xl710. YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code. 2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.