+-----------------------------------------------------------------------+----------------+----------------+------------------+-----------------+-----------------------+------------------------+ | Test Case | 2110.0-9 | 2202.0-9 | 2202.0-10 | 2206.0-10 | 2202.0-10 vs 2202.0-9 | 2206.0-10 vs 2202.0-10 | +-----------------------------------------------------------------------+----------------+----------------+------------------+-----------------+-----------------------+------------------------+ | 64b-2t1c-ethip4vxlan-l2bdbasemaclrn | 133.9 +- 1.37 | 73.5 +- 0.71 | 70.5 +- 1.51 | 128.8 +- 1.14 | -4.08 +- 2.25 | +82.7 +- 4.23 | | 64b-2t1c-ethip4vxlan-l2xcbase | 105.3 +- 1.34 | 60.8 +- 1.23 | 59.2 +- 2.04 | 105.1 +- 1.37 | -2.63 +- 3.9 | +77.53 +- 6.55 | | 64b-2t1c-ethip4-ip4base | 65.2 +- 1.32 | 47.4 +- 0.7 | 46.9 +- 1.73 | 77.4 +- 4.03 | -1.05 +- 3.93 | +65.03 +- 10.53 | | 64b-2t1c-ethip4gtpusw-ip4base | 114.4 +- 1.96 | 76.3 +- 1.64 | 74.8 +- 2.35 | 118.5 +- 3.44 | -1.97 +- 3.73 | +58.42 +- 6.77 | | 64b-2t1c-eth-l2xcbase | 72.1 +- 2.42 | 39.7 +- 0.67 | 40.0 +- 1.25 | 62.3 +- 1.77 | +0.76 +- 3.58 | +55.75 +- 6.56 | | 64b-2t1c-eth-l2patch | 53.1 +- 1.29 | 34.5 +- 0.71 | 34.2 +- 0.63 | 51.6 +- 1.35 | -0.87 +- 2.74 | +50.88 +- 4.83 | | 64b-2t1c-eth-l2bdbasemaclrn | 76.1 +- 4.01 | 48.4 +- 0.7 | 48.7 +- 2.11 | 73.4 +- 1.96 | +0.62 +- 4.6 | +50.72 +- 7.67 | | 78b-2t1c-ethip6-ip6base | 73.7 +- 3.74 | 50.8 +- 1.03 | 49.4 +- 0.97 | 69.9 +- 1.66 | -2.76 +- 2.74 | +41.5 +- 4.36 | | 1518b-2t1c-ethip4ipsec40tnlsw-ip4base-int-aes256gcm | 173.5 +- 13.48 | 167.4 +- 15.49 | 254.8 +- 42.57 | 317.8 +- 35.85 | +52.21 +- 29.07 | +24.73 +- 25.14 | | 1518b-2t1c-avf-ethip4ipsec40tnlsw-ip4base-int-aes256gcm | 198.1 +- 15.29 | 195.3 +- 20.29 | 249.14 +- 55.17 | 302.33 +- 31.94 | +27.57 +- 31.2 | +21.35 +- 29.77 | | 1518b-2t1c-avf-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 214.3 +- 22.99 | 182.9 +- 16.21 | 265.0 +- 57.22 | 321.11 +- 19.81 | +44.89 +- 33.82 | +21.17 +- 27.21 | | 1518b-2t1c-avf-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 172.9 +- 18.22 | 185.6 +- 23.8 | 276.0 +- 68.43 | 307.75 +- 53.35 | +48.71 +- 41.51 | +11.5 +- 33.73 | | 1518b-2t1c-avf-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 408.7 +- 30.17 | 409.1 +- 36.62 | 520.86 +- 113.8 | 569.89 +- 60.08 | +27.32 +- 30.06 | +9.41 +- 26.54 | | 1518b-2t1c-avf-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 406.7 +- 24.96 | 367.5 +- 26.95 | 572.29 +- 85.63 | 625.33 +- 47.06 | +55.72 +- 25.95 | +9.27 +- 18.3 | | 1518b-2t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 191.8 +- 18.76 | 188.5 +- 16.41 | 253.1 +- 38.77 | 276.1 +- 43.73 | +34.27 +- 23.66 | +9.09 +- 24.04 | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6enc2sids | 107.8 +- 2.57 | 110.0 +- 4.74 | 115.9 +- 5.38 | 124.0 +- 3.43 | +5.36 +- 6.67 | +6.99 +- 5.79 | | 78b-2t1c-avf-ethip6ip6-ip6base-srv6enc1sid | 99.2 +- 4.05 | 103.4 +- 1.17 | 104.8 +- 2.35 | 111.6 +- 2.5 | +1.35 +- 2.55 | +6.49 +- 3.38 | | 64b-2t1c-avf-eth-l2xcbase | 49.6 +- 0.52 | 50.6 +- 0.84 | 51.2 +- 1.14 | 53.7 +- 0.67 | +1.19 +- 2.81 | +4.88 +- 2.67 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 68.2 +- 0.79 | 66.1 +- 1.52 | 68.2 +- 1.69 | 71.0 +- 1.49 | +3.18 +- 3.49 | +4.11 +- 3.38 | | 78b-2t1c-avf-ethip6-ip6base | 65.0 +- 1.15 | 71.8 +- 1.4 | 73.2 +- 1.69 | 76.0 +- 1.89 | +1.95 +- 3.08 | +3.83 +- 3.52 | | 64b-2t1c-avf-ethip4gtpusw-ip4base | 123.2 +- 1.32 | 120.3 +- 1.42 | 122.8 +- 2.57 | 127.1 +- 3.07 | +2.08 +- 2.45 | +3.5 +- 3.31 | | 64b-2t1c-avf-ethip4-ip4base | 64.4 +- 0.7 | 68.3 +- 1.77 | 70.7 +- 1.95 | 73.1 +- 2.13 | +3.51 +- 3.91 | +3.39 +- 4.15 | | 64b-2t1c-avf-ethip4vxlan-l2xcbase | 104.6 +- 0.84 | 101.1 +- 1.29 | 101.0 +- 2.11 | 104.4 +- 2.07 | -0.1 +- 2.44 | +3.37 +- 2.97 | | 64b-2t1c-avf-ethip4vxlan-l2bdbasemaclrn | 125.2 +- 1.03 | 119.4 +- 1.51 | 122.3 +- 1.89 | 125.8 +- 1.87 | +2.43 +- 2.04 | +2.86 +- 2.21 | | 1518b-2t1c-avf-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 192.0 +- 8.41 | 188.9 +- 12.94 | 295.57 +- 18.59 | 302.44 +- 16.94 | +56.47 +- 14.55 | +2.33 +- 8.62 | | 1518b-2t1c-avf-ethip4ipsec40tnlsw-ip4base-int-aes128cbc-hmac512sha | 391.9 +- 34.5 | 394.9 +- 25.95 | 524.57 +- 86.92 | 531.78 +- 29.27 | +32.84 +- 23.68 | +1.37 +- 17.7 | | 64b-2t1c-avf-eth-l2patch | 28.9 +- 0.32 | 28.1 +- 0.32 | 29.4 +- 1.17 | 29.8 +- 1.03 | +4.63 +- 4.34 | +1.36 +- 5.36 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 84.8 +- 1.32 | 84.0 +- 3.02 | 84.5 +- 1.78 | 83.9 +- 2.18 | +0.6 +- 4.19 | -0.71 +- 3.32 | | 1518b-2t1c-avf-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 380.5 +- 30.53 | 391.0 +- 42.11 | 606.43 +- 106.31 | 595.67 +- 131.6 | +55.1 +- 31.91 | -1.77 +- 27.7 | | 1518b-2t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 205.3 +- 13.41 | 194.9 +- 29.13 | 318.7 +- 57.81 | 296.1 +- 48.59 | +63.52 +- 38.43 | -7.09 +- 22.73 | +-----------------------------------------------------------------------+----------------+----------------+------------------+-----------------+-----------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code. 2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.