+--------------------------------------------------------------------+----------------+-----------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2210.0-11 vs 2206.0-10 | +--------------------------------------------------------------------+----------------+-----------------+------------------------+ | 64b-1t1c-ethip4-ip4base-iacldstbase | 42.4 +- 11.55 | 47.6 +- 6.22 | +12.26 +- 33.92 | | 78b-1t1c-ethip6-ip6base-iacldstbase | 36.4 +- 3.66 | 40.8 +- 11.28 | +12.09 +- 32.98 | | 64b-1t1c-ethip4ipsec100spe-cache-ip4base-policy-outbound-nocrypto | 38.2 +- 2.15 | 40.6 +- 6.47 | +6.28 +- 17.96 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | 189.3 +- 26.06 | 194.2 +- 40.47 | +2.59 +- 25.62 | | 64b-1t1c-ethip4-ip4base | 39.2 +- 2.94 | 39.8 +- 2.53 | +1.53 +- 9.97 | | 64b-1t1c-ethip4-ip4scale20k | 39.1 +- 10.13 | 39.6 +- 10.02 | +1.28 +- 36.68 | | 64b-1t1c-ethip4ipsec1spe-cache-ip4base-policy-outbound-nocrypto | 37.0 +- 3.09 | 37.4 +- 6.59 | +1.08 +- 19.7 | | 64b-1t1c-ethip4vxlan-l2xcbase | 41.4 +- 3.34 | 41.6 +- 4.43 | +0.48 +- 13.42 | | 64b-1t1c-ethip4ipsec1000spe-cache-ip4base-policy-outbound-nocrypto | 38.9 +- 2.69 | 38.1 +- 3.54 | -2.06 +- 11.34 | | 64b-1t1c-ethip4ipsec1spe-ip4base-policy-outbound-nocrypto | 37.9 +- 3.28 | 36.8 +- 4.08 | -2.9 +- 13.65 | | 64b-1t1c-ethip4ipsec100spe-ip4base-policy-outbound-nocrypto | 41.7 +- 3.83 | 39.8 +- 3.61 | -4.56 +- 12.33 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 152.8 +- 37.02 | 145.78 +- 35.53 | -4.6 +- 32.78 | | 64b-1t1c-eth-l2patch | 26.9 +- 2.96 | 25.6 +- 1.58 | -4.83 +- 12.01 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 42.5 +- 4.25 | 40.4 +- 3.86 | -4.94 +- 13.15 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 38.2 +- 4.42 | 36.1 +- 3.96 | -5.5 +- 15.06 | | 78b-1t1c-ethip6-ip6scale200k | 45.1 +- 6.28 | 42.6 +- 7.71 | -5.54 +- 21.56 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 38.5 +- 3.03 | 36.1 +- 3.21 | -6.23 +- 11.14 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 37.6 +- 4.55 | 35.2 +- 2.86 | -6.38 +- 13.65 | | 78b-1t1c-ethip6-ip6base | 39.8 +- 8.05 | 37.0 +- 4.67 | -7.04 +- 22.16 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 38.2 +- 2.49 | 35.5 +- 2.01 | -7.07 +- 8.02 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 41.9 +- 5.67 | 38.9 +- 3.07 | -7.16 +- 14.54 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 38.5 +- 4.01 | 35.7 +- 2.54 | -7.27 +- 11.69 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 39.2 +- 3.46 | 36.3 +- 3.5 | -7.4 +- 12.1 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 39.1 +- 3.51 | 35.9 +- 3.48 | -8.18 +- 12.13 | | 78b-1t1c-ethip6-ip6scale20k | 44.5 +- 4.2 | 40.3 +- 5.19 | -9.44 +- 14.45 | | 64b-1t1c-eth-l2bdscale10kmaclrn | 43.5 +- 4.12 | 39.3 +- 5.91 | -9.66 +- 16.05 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 38.2 +- 4.32 | 34.3 +- 2.54 | -10.21 +- 12.13 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | 62.5 +- 9.12 | 55.9 +- 10.17 | -10.56 +- 20.86 | | 64b-1t1c-eth-l2bdscale100kmaclrn | 43.6 +- 3.37 | 38.7 +- 3.83 | -11.24 +- 11.15 | | 64b-1t1c-ethip4-ip4scale200k | 41.8 +- 4.61 | 36.9 +- 6.14 | -11.72 +- 17.62 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 160.8 +- 22.25 | 140.8 +- 26.69 | -12.44 +- 20.55 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | 57.4 +- 7.96 | 49.9 +- 5.2 | -13.07 +- 15.08 | | 64b-1t1c-eth-l2bdbasemaclrn | 39.6 +- 3.89 | 34.1 +- 2.73 | -13.89 +- 10.91 | | 64b-1t1c-eth-l2xcbase | 40.1 +- 4.65 | 34.4 +- 3.66 | -14.21 +- 13.5 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 196.1 +- 33.33 | 167.67 +- 42.12 | -14.5 +- 25.93 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | 208.4 +- 32.43 | 175.7 +- 44.14 | -15.69 +- 24.91 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 43.2 +- 6.63 | 36.4 +- 8.24 | -15.74 +- 23.04 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | 198.4 +- 33.3 | 158.9 +- 46.61 | -19.91 +- 27.06 | | 64b-1t1c-ethip4ipsec1000spe-ip4base-policy-outbound-nocrypto | 81.2 +- 21.18 | 63.7 +- 12.07 | -21.55 +- 25.3 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | 188.2 +- 26.35 | 146.44 +- 42.18 | -22.19 +- 24.92 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 167.8 +- 28.26 | 128.5 +- 26.85 | -23.42 +- 20.55 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 200.6 +- 29.05 | 151.7 +- 40.61 | -24.38 +- 23.02 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 220.7 +- 30.42 | 166.2 +- 36.58 | -24.69 +- 19.56 | +--------------------------------------------------------------------+----------------+-----------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 3n-alt with xl710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2210.0-11 vs 2206.0-10: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.