+-------------------------------------------------------------------+-------------------+-------------------+------------------+------------------------+ | Test Case | 2202.0-10 | 2206.0-10 | 2210.0-11 | 2210.0-11 vs 2206.0-10 | +-------------------------------------------------------------------+-------------------+-------------------+------------------+------------------------+ | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 494.33 +- 29.23 | 491.5 +- 43.15 | 723.7 +- 137.75 | +47.24 +- 30.86 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 170.12 +- 9.45 | 168.9 +- 14.15 | 246.9 +- 26.91 | +46.18 +- 20.1 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 120.56 +- 15.32 | 115.25 +- 8.4 | 163.89 +- 30.13 | +42.2 +- 28.13 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 116.25 +- 12.9 | 115.44 +- 10.96 | 156.3 +- 37.33 | +35.39 +- 34.8 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 122.67 +- 17.06 | 120.0 +- 11.08 | 162.4 +- 48.78 | +35.33 +- 42.53 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 128.6 +- 15.79 | 114.62 +- 15.77 | 154.33 +- 37.84 | +34.64 +- 37.86 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 113.11 +- 16.57 | 113.33 +- 19.09 | 150.7 +- 37.69 | +32.97 +- 40.1 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 591.0 +- 103.2 | 573.29 +- 22.77 | 754.6 +- 156.53 | +31.63 +- 27.8 | | 64b-1t1c-eth-l2xcbase | 131.1 +- 11.74 | 136.56 +- 5.13 | 177.9 +- 16.52 | +30.28 +- 13.05 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | 553.11 +- 35.59 | 552.38 +- 36.39 | 718.44 +- 94.61 | +30.06 +- 19.15 | | 64b-1t1c-eth-l2bdbasemaclrn | 167.88 +- 7.75 | 151.44 +- 8.82 | 196.2 +- 8.85 | +29.55 +- 9.54 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | 300.9 +- 15.58 | 292.78 +- 23.07 | 370.44 +- 29.71 | +26.53 +- 14.23 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 675.12 +- 153.28 | 572.56 +- 115.95 | 720.3 +- 75.75 | +25.8 +- 28.71 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 115.12 +- 16.07 | 111.5 +- 12.33 | 139.2 +- 8.93 | +24.84 +- 15.96 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 653.38 +- 158.83 | 643.0 +- 130.3 | 802.33 +- 269.31 | +24.78 +- 48.92 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | 566.5 +- 41.44 | 557.67 +- 35.93 | 695.5 +- 189.16 | +24.72 +- 34.86 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 116.2 +- 15.66 | 120.38 +- 12.63 | 148.7 +- 9.8 | +23.53 +- 15.3 | | 78b-1t1c-ethip6ip6-ip6base-srv6enc1sid | 194.44 +- 12.17 | 190.86 +- 5.43 | 235.7 +- 22.04 | +23.5 +- 12.07 | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids | 213.4 +- 26.15 | 213.11 +- 11.89 | 262.9 +- 21.69 | +23.36 +- 12.29 | | 78b-1t1c-ethip6-ip6base | 164.67 +- 18.04 | 151.12 +- 21.77 | 180.4 +- 27.41 | +19.37 +- 24.99 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | 281.0 +- 9.57 | 309.33 +- 11.84 | 364.2 +- 47.16 | +17.74 +- 15.9 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 572.75 +- 99.19 | 584.62 +- 95.23 | 684.1 +- 148.23 | +17.02 +- 31.72 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 112.3 +- 16.36 | 118.67 +- 15.74 | 137.7 +- 28.81 | +16.04 +- 28.74 | | 64b-1t1c-ethip4vxlan-l2xcbase | 213.1 +- 10.31 | 211.0 +- 9.3 | 241.2 +- 20.87 | +14.31 +- 11.1 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 274.0 +- 31.89 | 333.22 +- 18.53 | 375.5 +- 37.48 | +12.69 +- 12.87 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 520.0 +- 113.11 | 499.75 +- 59.21 | 563.0 +- 124.11 | +12.66 +- 28.19 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 605.5 +- 94.14 | 662.78 +- 93.93 | 745.67 +- 119.65 | +12.51 +- 24.09 | | 64b-1t1c-ethip4-ip4base | 174.11 +- 8.07 | 165.71 +- 8.98 | 183.5 +- 7.04 | +10.73 +- 7.35 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | 591.44 +- 96.57 | 641.5 +- 95.84 | 707.4 +- 79.93 | +10.27 +- 20.66 | | 64b-1t1c-eth-l2patch | 74.33 +- 2.92 | 72.25 +- 6.9 | 79.67 +- 8.26 | +10.27 +- 15.55 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 254.2 +- 51.84 | 318.62 +- 18.37 | 342.67 +- 21.13 | +7.55 +- 9.08 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 232.89 +- 16.03 | 253.22 +- 13.35 | 269.5 +- 9.19 | +6.43 +- 6.68 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 295.11 +- 32.78 | 403.56 +- 9.76 | 427.33 +- 15.28 | +5.89 +- 4.57 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 128.4 +- 20.69 | 136.11 +- 15.07 | 140.3 +- 11.79 | +3.08 +- 14.33 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 527.2 +- 106.9 | 463.89 +- 47.98 | 476.2 +- 112.19 | +2.65 +- 26.41 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 253.67 +- 3.77 | 256.8 +- 4.39 | 260.0 +- 79.19 | +1.25 +- 30.88 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | 1445.56 +- 223.86 | 1642.56 +- 33.8 | 1619.3 +- 150.95 | -1.42 +- 9.41 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 467.38 +- 95.63 | 484.89 +- 52.79 | 476.89 +- 116.48 | -1.65 +- 26.3 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 752.0 +- 309.41 | 768.2 +- 171.2 | 605.9 +- 184.42 | -21.13 +- 29.75 | +-------------------------------------------------------------------+-------------------+-------------------+------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2210.0-11 vs 2206.0-10: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.