+--------------------------------------------------------------------+-----------------+------------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2210.0-11 vs 2206.0-10 | +--------------------------------------------------------------------+-----------------+------------------+------------------------+ | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 535.1 +- 114.57 | 644.22 +- 90.97 | +20.39 +- 30.88 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 659.3 +- 84.18 | 778.3 +- 64.04 | +18.05 +- 17.93 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | 492.0 +- 20.4 | 559.22 +- 35.22 | +13.66 +- 8.57 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 657.8 +- 96.32 | 737.8 +- 49.94 | +12.16 +- 18.09 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | 903.5 +- 171.81 | 973.4 +- 166.77 | +7.74 +- 27.58 | | 64b-1t1c-eth-l2patch | 41.2 +- 1.48 | 43.8 +- 2.04 | +6.31 +- 6.25 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 587.4 +- 83.91 | 620.22 +- 73.12 | +5.59 +- 19.56 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 647.6 +- 57.77 | 677.3 +- 69.8 | +4.59 +- 14.25 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 62.5 +- 8.34 | 63.7 +- 6.9 | +1.92 +- 17.52 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 64.2 +- 2.97 | 63.5 +- 3.44 | -1.09 +- 7.05 | | 64b-1t1c-ethip4ipsec1spe-cache-ip4base-policy-outbound-nocrypto | 65.4 +- 3.53 | 64.5 +- 5.52 | -1.38 +- 9.99 | | 64b-1t1c-eth-l2bdscale100kmaclrn | 75.9 +- 4.58 | 74.8 +- 4.08 | -1.45 +- 8.01 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | 588.9 +- 60.03 | 579.7 +- 42.68 | -1.56 +- 12.38 | | 78b-1t1c-ethip6-ip6base-iacldstbase | 74.1 +- 3.28 | 72.2 +- 4.73 | -2.56 +- 7.71 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 86.3 +- 6.07 | 83.6 +- 2.55 | -3.13 +- 7.43 | | 78b-1t1c-ethip6-ip6scale200k | 88.0 +- 6.85 | 85.0 +- 11.76 | -3.41 +- 15.33 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 59.4 +- 3.41 | 57.3 +- 4.67 | -3.54 +- 9.61 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 628.0 +- 40.55 | 605.0 +- 67.31 | -3.66 +- 12.39 | | 64b-1t1c-ethip4vxlan-l2xcbase | 80.2 +- 7.9 | 77.0 +- 3.86 | -3.99 +- 10.61 | | 64b-1t1c-ethip4ipsec1spe-ip4base-policy-outbound-nocrypto | 64.2 +- 4.83 | 61.2 +- 4.34 | -4.67 +- 9.85 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | 141.4 +- 20.63 | 134.7 +- 8.77 | -4.74 +- 15.22 | | 78b-1t1c-ethip6-ip6scale20k | 81.7 +- 3.13 | 77.1 +- 4.53 | -5.63 +- 6.62 | | 64b-1t1c-ethip4ipsec1000spe-cache-ip4base-policy-outbound-nocrypto | 62.8 +- 3.55 | 59.1 +- 3.14 | -5.89 +- 7.31 | | 78b-1t1c-ethip6-ip6base | 68.8 +- 4.42 | 64.4 +- 4.72 | -6.4 +- 9.12 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 60.8 +- 6.63 | 56.8 +- 4.37 | -6.58 +- 12.46 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 59.6 +- 3.89 | 55.6 +- 3.5 | -6.71 +- 8.47 | | 64b-1t1c-ethip4ipsec1000spe-ip4base-policy-outbound-nocrypto | 331.2 +- 33.73 | 307.9 +- 38.84 | -7.04 +- 15.07 | | 64b-1t1c-ethip4-ip4base-iacldstbase | 75.1 +- 5.53 | 69.8 +- 3.68 | -7.06 +- 8.41 | | 64b-1t1c-eth-l2bdscale10kmaclrn | 71.8 +- 5.45 | 66.5 +- 5.13 | -7.38 +- 10.02 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | 123.1 +- 12.35 | 113.9 +- 10.63 | -7.47 +- 12.68 | | 64b-1t1c-ethip4ipsec100spe-ip4base-policy-outbound-nocrypto | 82.4 +- 6.19 | 76.1 +- 12.18 | -7.65 +- 16.33 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 67.1 +- 6.17 | 61.8 +- 3.29 | -7.9 +- 9.79 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 59.5 +- 3.24 | 54.7 +- 5.1 | -8.07 +- 9.93 | | 64b-1t1c-ethip4ipsec100spe-cache-ip4base-policy-outbound-nocrypto | 64.1 +- 3.98 | 58.5 +- 5.3 | -8.74 +- 10.02 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 66.5 +- 3.24 | 59.9 +- 3.93 | -9.92 +- 7.36 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 65.4 +- 4.4 | 58.8 +- 4.05 | -10.09 +- 8.66 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 75.1 +- 6.49 | 67.3 +- 8.11 | -10.39 +- 13.29 | | 64b-1t1c-ethip4-ip4base | 74.6 +- 3.98 | 66.1 +- 2.13 | -11.39 +- 5.52 | | 64b-1t1c-ethip4-ip4scale200k | 77.9 +- 4.12 | 69.0 +- 2.83 | -11.42 +- 5.93 | | 64b-1t1c-eth-l2xcbase | 69.1 +- 4.91 | 59.9 +- 1.91 | -13.31 +- 6.75 | | 64b-1t1c-ethip4-ip4scale20k | 77.9 +- 3.6 | 65.7 +- 2.79 | -15.66 +- 5.3 | | 64b-1t1c-eth-l2bdbasemaclrn | 72.7 +- 7.21 | 61.3 +- 1.83 | -15.68 +- 8.73 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | 583.6 +- 37.95 | 462.7 +- 34.14 | -20.72 +- 7.8 | +--------------------------------------------------------------------+-----------------+------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 3n-alt with xl710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2210.0-11 vs 2206.0-10: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.