+-----------------------------------------------------------------------+-----------------+-----------------+--------------------+-------------------+-----------------------+------------------------+ | Test Case | 2110.0-9 | 2202.0-9 | 2202.0-10 | 2206.0-10 | 2202.0-10 vs 2202.0-9 | 2206.0-10 vs 2202.0-10 | +-----------------------------------------------------------------------+-----------------+-----------------+--------------------+-------------------+-----------------------+------------------------+ | 64b-2t1c-ethip4vxlan-l2bdbasemaclrn | 243.0 +- 9.32 | 118.8 +- 4.08 | 122.9 +- 13.67 | 226.7 +- 7.41 | +3.45 +- 12.05 | +84.46 +- 21.39 | | 64b-2t1c-ethip4vxlan-l2xcbase | 191.2 +- 7.48 | 96.0 +- 3.37 | 104.4 +- 7.24 | 181.1 +- 6.47 | +8.75 +- 8.46 | +73.47 +- 13.54 | | 64b-2t1c-ethip4-ip4base | 106.8 +- 3.49 | 73.2 +- 1.75 | 77.4 +- 7.4 | 123.0 +- 7.69 | +5.74 +- 10.42 | +58.91 +- 18.15 | | 64b-2t1c-eth-l2bdbasemaclrn | 129.1 +- 7.02 | 73.8 +- 2.1 | 77.3 +- 6.09 | 122.6 +- 6.82 | +4.74 +- 8.78 | +58.6 +- 15.3 | | 64b-2t1c-eth-l2xcbase | 112.1 +- 5.88 | 60.8 +- 3.26 | 62.6 +- 3.89 | 99.1 +- 6.28 | +2.96 +- 8.45 | +58.31 +- 14.06 | | 64b-2t1c-eth-l2patch | 78.4 +- 3.17 | 51.6 +- 2.72 | 52.6 +- 3.17 | 77.8 +- 2.74 | +1.94 +- 8.16 | +47.91 +- 10.32 | | 64b-2t1c-ethip4gtpusw-ip4base | 201.7 +- 5.25 | 123.1 +- 4.36 | 137.8 +- 18.26 | 197.1 +- 11.23 | +11.94 +- 15.35 | +43.03 +- 20.63 | | 78b-2t1c-ethip6-ip6base | 122.9 +- 6.42 | 78.5 +- 3.03 | 83.2 +- 6.2 | 115.4 +- 6.36 | +5.99 +- 8.89 | +38.7 +- 12.85 | | 1518b-2t1c-avf-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 450.8 +- 50.95 | 406.1 +- 56.63 | 564.86 +- 135.69 | 682.44 +- 58.3 | +39.09 +- 38.64 | +20.82 +- 30.8 | | 1518b-2t1c-ethip4ipsec40tnlsw-ip4base-int-aes256gcm | 358.9 +- 35.73 | 343.4 +- 36.81 | 563.2 +- 100.86 | 673.5 +- 63.86 | +64.01 +- 34.23 | +19.58 +- 24.23 | | 1518b-2t1c-avf-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 880.6 +- 70.38 | 895.1 +- 88.24 | 1067.14 +- 262.96 | 1259.89 +- 161.16 | +19.22 +- 31.64 | +18.06 +- 32.78 | | 1518b-2t1c-avf-ethip4ipsec40tnlsw-ip4base-int-aes256gcm | 455.7 +- 79.73 | 460.5 +- 78.81 | 563.43 +- 101.3 | 661.11 +- 58.18 | +22.35 +- 30.37 | +17.34 +- 23.49 | | 64b-2t1c-avf-ethip4-ip4base | 166.3 +- 37.79 | 148.4 +- 34.96 | 174.6 +- 41.58 | 197.4 +- 46.8 | +17.65 +- 39.41 | +13.06 +- 37.99 | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6enc2sids | 300.3 +- 25.89 | 267.4 +- 39.68 | 284.2 +- 25.42 | 298.3 +- 30.31 | +6.28 +- 18.42 | +4.96 +- 14.21 | | 64b-2t1c-avf-ethip4vxlan-l2xcbase | 200.8 +- 25.96 | 198.3 +- 21.6 | 219.5 +- 34.56 | 229.2 +- 25.07 | +10.69 +- 21.19 | +4.42 +- 20.02 | | 64b-2t1c-avf-ethip4gtpusw-ip4base | 293.0 +- 32.45 | 266.3 +- 36.39 | 277.2 +- 35.75 | 284.9 +- 28.01 | +4.09 +- 19.56 | +2.78 +- 16.67 | | 1518b-2t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 432.1 +- 30.7 | 407.0 +- 46.78 | 559.6 +- 68.98 | 573.3 +- 78.4 | +37.49 +- 23.17 | +2.45 +- 18.86 | | 64b-2t1c-avf-eth-l2xcbase | 144.4 +- 45.86 | 94.6 +- 17.91 | 132.6 +- 56.45 | 131.3 +- 35.98 | +40.17 +- 65.31 | -0.98 +- 50.13 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 220.5 +- 39.44 | 227.0 +- 26.39 | 210.3 +- 42.88 | 207.2 +- 36.22 | -7.36 +- 21.74 | -1.47 +- 26.46 | | 1518b-2t1c-avf-ethip4ipsec40tnlsw-ip4base-int-aes128cbc-hmac512sha | 802.0 +- 68.57 | 865.2 +- 83.83 | 1130.29 +- 179.33 | 1113.56 +- 73.81 | +30.64 +- 24.29 | -1.48 +- 16.94 | | 78b-2t1c-avf-ethip6ip6-ip6base-srv6enc1sid | 239.3 +- 29.82 | 254.3 +- 33.84 | 264.6 +- 30.98 | 259.4 +- 26.96 | +4.05 +- 18.44 | -1.97 +- 15.35 | | 78b-2t1c-avf-ethip6-ip6base | 178.6 +- 33.51 | 200.8 +- 37.49 | 190.6 +- 38.49 | 186.7 +- 29.13 | -5.08 +- 26.11 | -2.05 +- 25.0 | | 1518b-2t1c-avf-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 481.1 +- 57.09 | 468.1 +- 43.46 | 658.57 +- 76.06 | 630.78 +- 43.06 | +40.69 +- 20.85 | -4.22 +- 12.85 | | 64b-2t1c-avf-ethip4vxlan-l2bdbasemaclrn | 254.0 +- 28.06 | 243.2 +- 26.9 | 245.0 +- 36.15 | 232.1 +- 27.03 | +0.74 +- 18.58 | -5.27 +- 17.81 | | 1518b-2t1c-avf-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 799.1 +- 101.7 | 833.1 +- 95.37 | 1346.0 +- 268.58 | 1270.89 +- 273.75 | +61.57 +- 37.17 | -5.58 +- 27.72 | | 1518b-2t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 421.9 +- 50.33 | 434.1 +- 65.19 | 721.2 +- 136.82 | 670.6 +- 116.2 | +66.14 +- 40.2 | -7.02 +- 23.89 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 166.9 +- 47.31 | 204.6 +- 32.0 | 186.5 +- 44.36 | 173.2 +- 48.01 | -8.85 +- 25.95 | -7.13 +- 33.92 | | 1518b-2t1c-avf-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 632.1 +- 476.39 | 730.2 +- 840.29 | 1329.86 +- 1080.91 | 980.0 +- 802.71 | +82.12 +- 256.59 | -26.31 +- 85.04 | | 64b-2t1c-avf-eth-l2patch | 114.7 +- 46.68 | 72.0 +- 29.88 | 98.7 +- 46.43 | 70.4 +- 40.84 | +37.08 +- 86.0 | -28.67 +- 53.27 | | 1518b-2t1c-avf-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 825.6 +- 49.49 | 816.3 +- 85.65 | 2773.14 +- 4219.04 | 1316.89 +- 167.69 | +239.72 +- 518.08 | -52.51 +- 72.5 | +-----------------------------------------------------------------------+-----------------+-----------------+--------------------+-------------------+-----------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code. 2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.