+-------------------------------------------------------------------+-------------------+-------------------+-------------------+-------------------+-----------------------+------------------------+ | Test Case | 2110.0-9 | 2202.0-9 | 2202.0-10 | 2206.0-10 | 2202.0-10 vs 2202.0-9 | 2206.0-10 vs 2202.0-10 | +-------------------------------------------------------------------+-------------------+-------------------+-------------------+-------------------+-----------------------+------------------------+ | 78b-1t1c-ethip6ip6-ip6base-srv6enc1sid | 461.44 +- 271.4 | 596.75 +- 399.88 | 385.56 +- 43.76 | 707.43 +- 347.17 | -35.39 +- 43.91 | +83.48 +- 92.42 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 1052.3 +- 223.83 | 1133.22 +- 293.62 | 1040.44 +- 200.44 | 1491.17 +- 691.71 | -8.19 +- 29.64 | +43.32 +- 71.99 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 598.0 +- 356.14 | 429.44 +- 291.54 | 329.5 +- 46.94 | 464.5 +- 251.61 | -23.27 +- 53.22 | +40.97 +- 78.96 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 929.4 +- 333.82 | 928.2 +- 290.91 | 703.22 +- 118.89 | 924.11 +- 284.09 | -24.24 +- 26.98 | +31.41 +- 46.1 | | 64b-1t1c-eth-l2xcbase | 471.33 +- 331.56 | 286.4 +- 52.55 | 275.5 +- 66.68 | 361.44 +- 247.94 | -3.81 +- 29.21 | +31.2 +- 95.43 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 518.1 +- 226.24 | 644.25 +- 407.5 | 462.67 +- 48.01 | 604.6 +- 241.91 | -28.19 +- 46.03 | +30.68 +- 54.01 | | 64b-1t1c-ethip4-ip4base | 411.56 +- 252.47 | 445.0 +- 326.95 | 420.11 +- 301.31 | 535.57 +- 298.45 | -5.59 +- 96.93 | +27.48 +- 115.79 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | 3928.2 +- 651.66 | 4319.7 +- 826.54 | 3951.56 +- 521.56 | 4929.56 +- 401.73 | -8.52 +- 21.26 | +24.75 +- 19.35 | | 64b-1t1c-eth-l2bdbasemaclrn | 319.1 +- 72.23 | 326.88 +- 57.27 | 442.5 +- 318.09 | 543.0 +- 342.1 | +35.37 +- 100.16 | +22.71 +- 117.29 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | 1364.11 +- 330.87 | 1382.7 +- 394.58 | 1456.4 +- 415.07 | 1680.5 +- 763.51 | +5.33 +- 42.48 | +15.39 +- 61.89 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 1358.9 +- 505.08 | 1201.0 +- 564.94 | 1319.38 +- 213.55 | 1470.0 +- 571.96 | +9.86 +- 54.65 | +11.42 +- 46.95 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 745.4 +- 85.88 | 684.62 +- 121.75 | 715.89 +- 323.71 | 789.67 +- 399.51 | +4.57 +- 50.81 | +10.31 +- 74.85 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 1407.75 +- 537.97 | 1266.56 +- 208.09 | 1371.0 +- 172.55 | 1491.78 +- 426.77 | +8.25 +- 22.4 | +8.81 +- 34.01 | | 78b-1t1c-ethip6-ip6base | 607.2 +- 386.26 | 420.8 +- 284.23 | 501.33 +- 293.01 | 532.12 +- 299.86 | +19.14 +- 106.41 | +6.14 +- 86.17 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 1405.7 +- 205.41 | 1532.1 +- 347.22 | 1644.11 +- 395.15 | 1724.62 +- 74.02 | +7.31 +- 35.45 | +4.9 +- 25.61 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 484.5 +- 355.82 | 289.9 +- 130.53 | 486.9 +- 329.92 | 507.22 +- 290.71 | +67.95 +- 136.64 | +4.17 +- 92.45 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 351.8 +- 315.09 | 396.4 +- 277.35 | 412.62 +- 101.07 | 419.11 +- 291.61 | +4.09 +- 77.17 | +1.57 +- 74.92 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | 628.9 +- 298.84 | 921.5 +- 456.04 | 694.22 +- 366.51 | 685.33 +- 224.76 | -24.66 +- 54.52 | -1.28 +- 61.35 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | 1410.62 +- 673.59 | 899.89 +- 519.03 | 1323.78 +- 502.37 | 1277.0 +- 440.09 | +47.1 +- 101.56 | -3.53 +- 49.45 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 470.89 +- 419.34 | 426.1 +- 278.41 | 466.9 +- 273.18 | 448.88 +- 257.07 | +9.58 +- 96.1 | -3.86 +- 78.71 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | 730.4 +- 394.52 | 1063.7 +- 528.9 | 735.7 +- 305.5 | 700.0 +- 246.81 | -30.84 +- 44.81 | -4.85 +- 51.83 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 1562.4 +- 645.46 | 1323.12 +- 198.67 | 1692.12 +- 680.96 | 1593.38 +- 597.03 | +27.89 +- 54.93 | -5.84 +- 51.78 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 1210.89 +- 278.63 | 1456.4 +- 196.83 | 1560.0 +- 307.8 | 1465.89 +- 180.37 | +7.11 +- 25.62 | -6.03 +- 21.85 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 240.6 +- 112.27 | 493.2 +- 450.56 | 554.22 +- 306.49 | 508.67 +- 271.02 | +12.37 +- 120.0 | -8.22 +- 70.48 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 546.78 +- 344.85 | 625.78 +- 483.41 | 460.5 +- 261.77 | 422.22 +- 91.59 | -26.41 +- 70.58 | -8.31 +- 55.79 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 1275.11 +- 412.64 | 1074.8 +- 543.38 | 1243.88 +- 412.6 | 1139.22 +- 126.44 | +15.73 +- 69.98 | -8.41 +- 32.04 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 1042.8 +- 486.4 | 963.78 +- 363.57 | 814.22 +- 405.78 | 719.78 +- 59.14 | -15.52 +- 52.8 | -11.6 +- 44.65 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | 1311.22 +- 472.11 | 1372.0 +- 451.69 | 1438.78 +- 524.3 | 1239.88 +- 380.21 | +4.87 +- 51.5 | -13.82 +- 41.04 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 992.0 +- 438.45 | 751.1 +- 128.18 | 875.2 +- 504.92 | 751.62 +- 358.3 | +16.52 +- 70.1 | -14.12 +- 64.27 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 1324.2 +- 199.95 | 1775.2 +- 335.02 | 1870.5 +- 233.06 | 1589.9 +- 145.88 | +5.37 +- 23.83 | -15.0 +- 13.15 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 1044.33 +- 161.61 | 1530.1 +- 826.18 | 1570.75 +- 841.36 | 1253.33 +- 226.37 | +2.66 +- 78.08 | -20.21 +- 45.1 | | 64b-1t1c-ethip4vxlan-l2xcbase | 542.33 +- 356.44 | 599.4 +- 445.09 | 688.3 +- 436.58 | 519.9 +- 285.54 | +14.83 +- 112.14 | -24.47 +- 63.38 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 1028.11 +- 113.97 | 1543.62 +- 499.37 | 1670.7 +- 311.85 | 1236.56 +- 252.56 | +8.23 +- 40.42 | -25.99 +- 20.48 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 391.6 +- 266.17 | 644.6 +- 464.43 | 521.22 +- 410.06 | 375.5 +- 121.68 | -19.14 +- 86.26 | -27.96 +- 61.3 | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids | 549.9 +- 340.55 | 517.33 +- 275.7 | 610.5 +- 408.12 | 437.67 +- 23.04 | +18.01 +- 100.89 | -28.31 +- 48.07 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 527.4 +- 430.69 | 360.22 +- 289.92 | 674.44 +- 599.32 | 450.22 +- 123.23 | +87.23 +- 224.47 | -33.25 +- 62.07 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 395.0 +- 316.61 | 504.4 +- 374.01 | 609.9 +- 374.41 | 353.0 +- 126.11 | +20.92 +- 116.4 | -42.12 +- 41.11 | | 64b-1t1c-eth-l2patch | 144.11 +- 40.97 | 106.22 +- 6.42 | 264.22 +- 361.53 | 137.25 +- 13.36 | +148.74 +- 340.68 | -48.06 +- 71.25 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 500.9 +- 400.09 | 458.67 +- 367.93 | 736.88 +- 509.66 | 375.5 +- 142.63 | +60.66 +- 170.16 | -49.04 +- 40.21 | +-------------------------------------------------------------------+-------------------+-------------------+-------------------+-------------------+-----------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code. 2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.