+------------------------------------------------------------------+---------------+---------------+---------------+---------------+-----------------------+------------------------+ | Test Case | 2110.0-9 | 2202.0-9 | 2202.0-10 | 2206.0-10 | 2202.0-10 vs 2202.0-9 | 2206.0-10 vs 2202.0-10 | +------------------------------------------------------------------+---------------+---------------+---------------+---------------+-----------------------+------------------------+ | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 1.11 +- 0.01 | 0.95 +- 0.25 | 0.88 +- 0.24 | 1.06 +- 0.0 | -7.51 +- 35.08 | +20.64 +- 33.56 | | 64b-2t2c-eth-l2xcbase | 11.32 +- 0.35 | 8.7 +- 3.24 | 7.88 +- 3.67 | 9.13 +- 3.01 | -9.39 +- 54.08 | +15.83 +- 66.17 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 0.66 +- 0.0 | 0.64 +- 0.0 | 0.5 +- 0.24 | 0.58 +- 0.19 | -21.86 +- 36.7 | +14.61 +- 65.19 | | 64b-2t2c-ethip4-ip4scale20k | 6.89 +- 0.19 | 4.88 +- 1.8 | 5.29 +- 1.58 | 5.92 +- 1.06 | +8.44 +- 51.48 | +11.77 +- 38.86 | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 0.56 +- 0.0 | 0.48 +- 0.16 | 0.35 +- 0.22 | 0.37 +- 0.2 | -27.65 +- 51.29 | +6.13 +- 88.04 | | 64b-2t2c-ethip4-ip4base | 8.45 +- 0.03 | 6.82 +- 2.02 | 6.97 +- 1.95 | 7.22 +- 1.59 | +2.23 +- 41.72 | +3.6 +- 36.92 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.38 +- 0.0 | 0.38 +- 0.0 | 0.38 +- 0.0 | 0.38 +- 0.0 | +0.12 +- 0.34 | +1.28 +- 0.45 | | imix-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.34 +- 0.0 | 0.34 +- 0.0 | 0.34 +- 0.0 | 0.34 +- 0.0 | +0.03 +- 0.26 | +1.18 +- 0.42 | | 64b-2t2c-eth-l2bdscale10kmaclrn | 5.35 +- 0.06 | 4.3 +- 1.1 | 4.81 +- 0.74 | 4.84 +- 0.7 | +11.75 +- 33.34 | +0.63 +- 21.26 | | 1518b-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.13 +- 0.0 | 0.13 +- 0.0 | 0.13 +- 0.0 | 0.13 +- 0.0 | +0.04 +- 0.21 | +0.59 +- 0.34 | | 1518b-2t2c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 0.12 +- 0.0 | 0.12 +- 0.0 | 0.12 +- 0.0 | 0.12 +- 0.0 | +0.24 +- 0.47 | +0.39 +- 0.68 | | 64b-2t2c-ethip4vxlan-l2bdbasemaclrn | 5.81 +- 0.01 | 4.51 +- 1.5 | 4.5 +- 1.49 | 4.51 +- 1.5 | -0.13 +- 46.87 | +0.21 +- 46.98 | | 64b-2t2c-eth-l2patch | 14.7 +- 0.17 | 12.44 +- 3.55 | 12.39 +- 3.54 | 12.36 +- 4.14 | -0.38 +- 40.23 | -0.22 +- 43.94 | | imix-2t2c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 1.48 +- 0.0 | 1.31 +- 0.41 | 1.34 +- 0.37 | 1.33 +- 0.37 | +2.16 +- 42.5 | -0.57 +- 38.83 | | 64b-2t2c-ethip4-ip4scale20k-rnd | 5.97 +- 0.01 | 4.6 +- 1.34 | 5.24 +- 0.91 | 5.19 +- 0.98 | +13.86 +- 38.67 | -0.92 +- 25.38 | | 64b-2t2c-ethip4vxlan-l2xcbase | 6.65 +- 0.03 | 5.49 +- 1.46 | 4.83 +- 2.02 | 4.78 +- 2.01 | -12.01 +- 43.65 | -1.0 +- 58.73 | | 64b-2t2c-eth-l2bdbasemaclrn | 9.25 +- 0.05 | 7.27 +- 2.26 | 6.52 +- 2.74 | 6.19 +- 2.93 | -10.36 +- 46.83 | -4.96 +- 60.14 | | 78b-2t2c-ethip6-ip6scale20k-rnd | 3.45 +- 0.02 | 3.39 +- 0.57 | 3.55 +- 0.49 | 3.34 +- 0.58 | +4.89 +- 22.85 | -6.01 +- 20.92 | | 78b-2t2c-ethip6-ip6base | 7.61 +- 0.03 | 6.55 +- 1.61 | 5.84 +- 2.24 | 5.2 +- 2.47 | -10.88 +- 40.61 | -10.89 +- 54.44 | | 78b-2t2c-ethip6-ip6scale20k | 4.05 +- 0.11 | 3.81 +- 0.77 | 4.09 +- 0.18 | 3.5 +- 0.79 | +7.52 +- 22.31 | -14.54 +- 19.7 | +------------------------------------------------------------------+---------------+---------------+---------------+---------------+-----------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 3n-dnv with x553. YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code. 2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.