+--------------------------------------------------------------------+------------------+--------------------+------------------------+ | Test Case | 2206.0-10 | 2210.0-11 | 2210.0-11 vs 2206.0-10 | +--------------------------------------------------------------------+------------------+--------------------+------------------------+ | 64b-1t1c-ethip4ipsec1spe-cache-ip4base-policy-outbound-nocrypto | 148.8 +- 27.18 | 781.8 +- 1659.85 | +425.4 +- 1119.61 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 188.2 +- 186.42 | 428.6 +- 697.05 | +127.74 +- 433.67 | | 64b-1t1c-ethip4ipsec1000spe-ip4base-policy-outbound-nocrypto | 807.6 +- 39.72 | 1687.4 +- 2959.48 | +108.94 +- 366.6 | | 64b-1t1c-ethip4-ip4scale20k | 155.2 +- 11.48 | 267.9 +- 218.6 | +72.62 +- 141.43 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 123.8 +- 9.78 | 197.3 +- 112.65 | +59.37 +- 91.86 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 207.7 +- 163.61 | 322.4 +- 214.2 | +55.22 +- 159.96 | | 78b-1t1c-ethip6-ip6base-iacldstbase | 211.4 +- 180.31 | 295.8 +- 208.52 | +39.92 +- 154.83 | | 78b-1t1c-ethip6-ip6scale20k | 223.7 +- 165.86 | 298.4 +- 186.83 | +33.39 +- 129.45 | | 64b-1t1c-eth-l2xcbase | 123.9 +- 6.57 | 164.5 +- 125.9 | +32.77 +- 101.86 | | 64b-1t1c-ethip4ipsec100spe-ip4base-policy-outbound-nocrypto | 244.0 +- 175.08 | 322.1 +- 180.28 | +32.01 +- 120.13 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 1541.6 +- 277.79 | 2026.78 +- 560.49 | +31.47 +- 43.4 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 1177.8 +- 254.85 | 1545.78 +- 184.7 | +31.24 +- 32.44 | | 64b-1t1c-ethip4-ip4base | 144.9 +- 9.35 | 173.6 +- 56.65 | +19.81 +- 39.85 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | 1275.8 +- 246.71 | 1473.9 +- 882.05 | +15.53 +- 72.66 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | 1647.2 +- 385.91 | 1843.44 +- 428.02 | +11.91 +- 36.91 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 197.2 +- 183.02 | 219.0 +- 133.79 | +11.05 +- 123.4 | | 64b-1t1c-eth-l2patch | 75.3 +- 7.3 | 83.5 +- 5.4 | +10.89 +- 12.93 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | 2375.3 +- 310.5 | 2576.5 +- 374.39 | +8.47 +- 21.2 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 1604.2 +- 372.65 | 1721.3 +- 196.54 | +7.3 +- 27.77 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 1183.1 +- 79.42 | 1260.0 +- 150.14 | +6.5 +- 14.57 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 179.5 +- 143.57 | 190.0 +- 131.76 | +5.85 +- 112.05 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 1565.2 +- 216.77 | 1627.8 +- 172.97 | +4.0 +- 18.15 | | 64b-1t1c-ethip4ipsec100spe-cache-ip4base-policy-outbound-nocrypto | 192.6 +- 175.53 | 196.3 +- 131.13 | +1.92 +- 115.17 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 179.0 +- 15.71 | 181.3 +- 10.14 | +1.28 +- 10.54 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | 1149.4 +- 66.8 | 1144.5 +- 221.85 | -0.43 +- 20.15 | | 78b-1t1c-ethip6-ip6scale200k | 226.5 +- 53.52 | 225.2 +- 37.71 | -0.57 +- 28.8 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 1402.6 +- 346.51 | 1375.2 +- 247.14 | -1.95 +- 29.95 | | 64b-1t1c-ethip4ipsec1000spe-cache-ip4base-policy-outbound-nocrypto | 193.9 +- 174.6 | 186.5 +- 117.26 | -3.82 +- 105.63 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 195.4 +- 170.76 | 186.0 +- 136.32 | -4.81 +- 108.57 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | 444.2 +- 212.54 | 405.2 +- 197.9 | -8.78 +- 62.37 | | 64b-1t1c-ethip4ipsec1spe-ip4base-policy-outbound-nocrypto | 259.3 +- 247.05 | 232.7 +- 175.15 | -10.26 +- 108.96 | | 64b-1t1c-ethip4vxlan-l2xcbase | 275.5 +- 225.18 | 244.4 +- 120.45 | -11.29 +- 84.67 | | 64b-1t1c-eth-l2bdscale10kmaclrn | 202.8 +- 166.56 | 179.9 +- 65.9 | -11.29 +- 79.77 | | 64b-1t1c-eth-l2bdscale100kmaclrn | 258.5 +- 205.53 | 215.8 +- 133.57 | -16.52 +- 84.12 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 255.6 +- 245.19 | 210.3 +- 115.64 | -17.72 +- 90.97 | | 64b-1t1c-ethip4-ip4base-iacldstbase | 197.6 +- 163.37 | 161.7 +- 40.8 | -18.17 +- 70.74 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | 415.3 +- 256.41 | 337.3 +- 159.05 | -18.78 +- 63.1 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 207.9 +- 181.86 | 163.1 +- 44.78 | -21.55 +- 71.93 | | 64b-1t1c-ethip4-ip4scale200k | 332.8 +- 198.47 | 235.6 +- 27.48 | -29.21 +- 43.02 | | 64b-1t1c-eth-l2bdbasemaclrn | 242.1 +- 212.72 | 166.4 +- 101.07 | -31.27 +- 73.42 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 262.1 +- 246.53 | 164.6 +- 39.65 | -37.2 +- 60.98 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 271.8 +- 278.12 | 170.6 +- 47.42 | -37.23 +- 66.55 | | 78b-1t1c-ethip6-ip6base | 250.5 +- 230.49 | 141.9 +- 16.55 | -43.35 +- 52.54 | +--------------------------------------------------------------------+------------------+--------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 3n-alt with xl710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2210.0-11 vs 2206.0-10: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.