+-------------------------------------------------------------------+-----------------+-----------------+-----------------+------------------------+ | Test Case | 2202.0-10 | 2206.0-10 | 2210.0-11 | 2210.0-11 vs 2206.0-10 | +-------------------------------------------------------------------+-----------------+-----------------+-----------------+------------------------+ | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 61.2 +- 9.93 | 49.88 +- 6.69 | 72.2 +- 25.08 | +44.76 +- 53.89 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 67.33 +- 6.14 | 56.22 +- 11.17 | 81.3 +- 33.17 | +44.6 +- 65.62 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 74.38 +- 9.8 | 66.0 +- 5.94 | 95.1 +- 11.02 | +44.09 +- 21.15 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 65.4 +- 6.22 | 60.0 +- 8.2 | 83.1 +- 26.4 | +38.5 +- 47.91 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 191.33 +- 35.43 | 160.38 +- 20.28 | 209.11 +- 29.83 | +30.39 +- 24.86 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 138.11 +- 23.8 | 164.22 +- 17.06 | 207.0 +- 12.73 | +26.05 +- 15.22 | | 64b-1t1c-ethip4-ip4base | 59.67 +- 5.96 | 59.14 +- 7.17 | 74.4 +- 14.19 | +25.8 +- 28.44 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 123.0 +- 15.03 | 131.78 +- 15.93 | 164.0 +- 55.15 | +24.45 +- 44.48 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 63.0 +- 12.21 | 56.88 +- 9.06 | 70.67 +- 22.78 | +24.25 +- 44.68 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 61.6 +- 3.13 | 56.44 +- 3.24 | 69.6 +- 23.23 | +23.31 +- 41.77 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | 223.22 +- 18.82 | 224.38 +- 27.91 | 275.1 +- 50.8 | +22.61 +- 27.3 | | 64b-1t1c-eth-l2patch | 39.78 +- 3.96 | 35.25 +- 2.96 | 43.0 +- 5.1 | +21.99 +- 17.73 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 171.5 +- 25.15 | 173.33 +- 23.1 | 209.9 +- 45.26 | +21.1 +- 30.7 | | 78b-1t1c-ethip6-ip6base | 62.22 +- 5.45 | 56.0 +- 4.57 | 66.2 +- 7.87 | +18.21 +- 17.04 | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids | 99.0 +- 14.21 | 86.44 +- 11.53 | 100.8 +- 19.32 | +16.61 +- 27.23 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 57.4 +- 4.25 | 54.12 +- 4.26 | 62.78 +- 5.31 | +15.99 +- 13.4 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | 140.33 +- 9.41 | 128.44 +- 13.33 | 148.0 +- 24.12 | +15.22 +- 22.26 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 60.12 +- 5.91 | 57.56 +- 6.73 | 66.2 +- 8.36 | +15.02 +- 19.8 | | 64b-1t1c-eth-l2bdbasemaclrn | 64.0 +- 5.55 | 61.89 +- 4.08 | 70.2 +- 5.81 | +13.43 +- 11.99 | | 78b-1t1c-ethip6ip6-ip6base-srv6enc1sid | 84.0 +- 12.34 | 80.43 +- 8.0 | 90.4 +- 14.03 | +12.4 +- 20.72 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 183.67 +- 18.47 | 166.0 +- 14.18 | 185.0 +- 32.37 | +11.45 +- 21.7 | | 64b-1t1c-ethip4vxlan-l2xcbase | 92.8 +- 14.57 | 91.4 +- 10.05 | 100.9 +- 14.14 | +10.39 +- 19.66 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 64.75 +- 6.23 | 59.0 +- 5.48 | 64.9 +- 27.67 | +10.0 +- 48.0 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 138.2 +- 18.21 | 152.5 +- 18.83 | 167.0 +- 12.12 | +9.51 +- 15.69 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 156.78 +- 19.76 | 180.22 +- 11.13 | 197.0 +- 8.72 | +9.31 +- 8.31 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | 220.67 +- 39.98 | 223.11 +- 34.39 | 241.5 +- 49.26 | +8.24 +- 27.67 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 62.44 +- 4.42 | 59.22 +- 5.63 | 64.0 +- 3.23 | +8.07 +- 11.63 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 95.89 +- 12.14 | 95.9 +- 6.77 | 103.33 +- 25.49 | +7.75 +- 27.64 | | 64b-1t1c-eth-l2xcbase | 52.1 +- 6.54 | 55.89 +- 4.46 | 60.2 +- 4.42 | +7.71 +- 11.67 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 193.75 +- 23.42 | 206.14 +- 15.51 | 221.7 +- 34.5 | +7.55 +- 18.59 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | 214.22 +- 29.78 | 214.38 +- 29.04 | 230.33 +- 41.55 | +7.44 +- 24.24 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | 143.9 +- 14.59 | 137.89 +- 17.69 | 147.33 +- 22.05 | +6.85 +- 21.07 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 170.75 +- 33.36 | 173.22 +- 30.85 | 181.33 +- 34.06 | +4.68 +- 27.1 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | 207.7 +- 34.98 | 202.67 +- 14.62 | 209.8 +- 29.69 | +3.52 +- 16.44 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 156.3 +- 36.3 | 181.78 +- 21.21 | 184.0 +- 33.18 | +1.22 +- 21.74 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 216.12 +- 18.79 | 206.38 +- 24.67 | 207.4 +- 25.39 | +0.5 +- 17.2 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 170.0 +- 22.84 | 189.17 +- 29.68 | 188.0 +- 17.95 | -0.62 +- 18.25 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 202.75 +- 19.23 | 234.67 +- 21.9 | 226.33 +- 29.77 | -3.55 +- 15.55 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 216.5 +- 43.56 | 254.4 +- 48.05 | 242.2 +- 64.91 | -4.8 +- 31.21 | +-------------------------------------------------------------------+-----------------+-----------------+-----------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2210.0-11 vs 2206.0-10: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.