+------------------------------------------------------------------+---------------+--------------+---------------+--------------+-----------------------+------------------------+ | Test Case | 2110.0-9 | 2202.0-9 | 2202.0-10 | 2206.0-10 | 2202.0-10 vs 2202.0-9 | 2206.0-10 vs 2202.0-10 | +------------------------------------------------------------------+---------------+--------------+---------------+--------------+-----------------------+------------------------+ | 64b-1t1c-ethip4vxlan-l2xcbase | 4.46 +- 0.01 | 3.29 +- 1.07 | 2.58 +- 1.12 | 3.8 +- 0.73 | -21.56 +- 42.47 | +47.32 +- 69.64 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 0.29 +- 0.0 | 0.26 +- 0.06 | 0.24 +- 0.07 | 0.27 +- 0.04 | -7.04 +- 32.49 | +10.91 +- 35.24 | | 64b-1t1c-eth-l2xcbase | 8.24 +- 0.02 | 7.11 +- 1.67 | 6.53 +- 2.2 | 7.11 +- 1.67 | -8.1 +- 37.75 | +8.77 +- 44.68 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 3.79 +- 0.01 | 3.24 +- 0.56 | 2.99 +- 0.77 | 3.24 +- 0.56 | -7.73 +- 28.57 | +8.44 +- 33.6 | | 64b-1t1c-ethip4-ip4scale20k | 5.2 +- 0.11 | 4.44 +- 0.78 | 4.19 +- 0.77 | 4.34 +- 0.78 | -5.69 +- 23.91 | +3.48 +- 26.53 | | 78b-1t1c-ethip6-ip6scale20k | 2.8 +- 0.01 | 2.87 +- 0.24 | 2.78 +- 0.15 | 2.87 +- 0.12 | -2.89 +- 9.79 | +3.24 +- 7.27 | | imix-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.2 +- 0.0 | 0.2 +- 0.0 | 0.2 +- 0.0 | 0.2 +- 0.0 | -0.52 +- 0.27 | +0.55 +- 0.26 | | imix-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.23 +- 0.0 | 0.23 +- 0.0 | 0.23 +- 0.0 | 0.23 +- 0.0 | -0.2 +- 0.32 | +0.39 +- 0.39 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.07 +- 0.0 | 0.07 +- 0.0 | 0.07 +- 0.0 | 0.07 +- 0.0 | -0.06 +- 0.34 | +0.26 +- 0.37 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.08 +- 0.0 | 0.08 +- 0.0 | 0.08 +- 0.0 | 0.08 +- 0.0 | +0.09 +- 0.34 | -0.05 +- 0.27 | | 64b-1t1c-eth-l2bdscale10kmaclrn | 3.72 +- 0.1 | 3.39 +- 0.2 | 3.27 +- 0.24 | 3.26 +- 0.22 | -3.65 +- 9.09 | -0.24 +- 10.0 | | 78b-1t1c-ethip6-ip6scale20k-rnd | 2.1 +- 0.01 | 2.28 +- 0.01 | 2.28 +- 0.0 | 2.28 +- 0.01 | +0.19 +- 0.41 | -0.35 +- 0.62 | | imix-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 0.61 +- 0.0 | 0.58 +- 0.0 | 0.58 +- 0.0 | 0.58 +- 0.0 | -0.18 +- 0.76 | -0.76 +- 0.61 | | 78b-1t1c-ethip6-ip6base | 5.13 +- 0.01 | 4.95 +- 0.02 | 4.64 +- 0.85 | 4.58 +- 0.9 | -6.21 +- 17.12 | -1.26 +- 26.45 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 0.34 +- 0.0 | 0.26 +- 0.1 | 0.3 +- 0.08 | 0.29 +- 0.08 | +13.54 +- 51.55 | -2.28 +- 38.05 | | 64b-1t1c-ethip4-ip4scale20k-rnd | 4.21 +- 0.03 | 3.82 +- 0.32 | 3.78 +- 0.36 | 3.64 +- 0.51 | -0.84 +- 12.55 | -3.8 +- 16.18 | | 64b-1t1c-eth-l2bdbasemaclrn | 6.25 +- 0.01 | 5.83 +- 0.01 | 5.42 +- 1.08 | 5.15 +- 1.24 | -7.09 +- 18.52 | -5.01 +- 29.65 | | imix-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 0.84 +- 0.0 | 0.72 +- 0.15 | 0.8 +- 0.12 | 0.76 +- 0.13 | +11.27 +- 28.77 | -5.59 +- 21.8 | | 64b-1t1c-ethip4-ip4base | 6.01 +- 0.02 | 5.17 +- 0.97 | 5.21 +- 0.91 | 4.4 +- 1.36 | +0.75 +- 25.83 | -15.61 +- 29.91 | | 64b-1t1c-eth-l2patch | 12.25 +- 0.04 | 9.8 +- 3.87 | 11.73 +- 0.02 | 9.08 +- 4.22 | +19.69 +- 47.27 | -22.54 +- 36.01 | +------------------------------------------------------------------+---------------+--------------+---------------+--------------+-----------------------+------------------------+ Test Case: Test cases executed for: NDR throughput on 3n-dnv with x553. YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code. 2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.