+-------------------------------------------------------------------+-------------------+--------------------+-------------------+-------------------+----------------------+----------------------+ | Test Case | 2106.0-8 | 2110.0-8 | 2110.0-9 | 2202.0-9 | 2110.0-9 vs 2110.0-8 | 2202.0-9 vs 2110.0-9 | +-------------------------------------------------------------------+-------------------+--------------------+-------------------+-------------------+----------------------+----------------------+ | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 417.2 +- 234.51 | 369.6 +- 138.54 | 240.6 +- 112.27 | 493.2 +- 450.56 | -34.9 +- 38.96 | +104.99 +- 210.28 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 315.7 +- 275.74 | 344.7 +- 160.94 | 391.6 +- 266.17 | 644.6 +- 464.43 | +13.61 +- 93.68 | +64.61 +- 163.04 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 1102.3 +- 259.63 | 1202.8 +- 354.03 | 1028.11 +- 113.97 | 1543.62 +- 499.37 | -14.52 +- 26.88 | +50.14 +- 51.34 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | 507.33 +- 61.29 | 607.0 +- 302.12 | 628.9 +- 298.84 | 921.5 +- 456.04 | +3.61 +- 71.3 | +46.53 +- 100.53 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 1352.56 +- 640.64 | 1301.8 +- 595.82 | 1044.33 +- 161.61 | 1530.1 +- 826.18 | -19.78 +- 38.76 | +46.51 +- 82.3 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | 821.9 +- 425.79 | 644.2 +- 274.05 | 730.4 +- 394.52 | 1063.7 +- 528.9 | +13.38 +- 77.96 | +45.63 +- 106.92 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 1337.67 +- 122.11 | 1329.7 +- 125.52 | 1324.2 +- 199.95 | 1775.2 +- 335.02 | -0.41 +- 17.73 | +34.06 +- 32.4 | | 78b-1t1c-ethip6ip6-ip6base-srv6enc1sid | 523.56 +- 351.82 | 617.67 +- 392.21 | 461.44 +- 271.4 | 596.75 +- 399.88 | -25.29 +- 64.66 | +29.32 +- 115.3 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 457.88 +- 423.92 | 720.2 +- 407.04 | 395.0 +- 316.61 | 504.4 +- 374.01 | -45.15 +- 53.79 | +27.7 +- 139.43 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 500.3 +- 238.86 | 734.3 +- 397.04 | 518.1 +- 226.24 | 644.25 +- 407.5 | -29.44 +- 49.04 | +24.35 +- 95.58 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 1039.1 +- 84.42 | 1346.89 +- 349.76 | 1210.89 +- 278.63 | 1456.4 +- 196.83 | -10.1 +- 31.19 | +20.28 +- 32.1 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 389.5 +- 337.82 | 623.11 +- 501.11 | 546.78 +- 344.85 | 625.78 +- 483.41 | -12.25 +- 89.68 | +14.45 +- 114.13 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 397.3 +- 246.99 | 366.8 +- 261.14 | 351.8 +- 315.09 | 396.4 +- 277.35 | -4.09 +- 109.74 | +12.68 +- 128.06 | | 64b-1t1c-ethip4vxlan-l2xcbase | 350.8 +- 52.95 | 326.8 +- 55.42 | 542.33 +- 356.44 | 599.4 +- 445.09 | +65.95 +- 112.64 | +10.52 +- 109.6 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | 4267.78 +- 533.21 | 4376.5 +- 571.66 | 3928.2 +- 651.66 | 4319.7 +- 826.54 | -10.24 +- 18.95 | +9.97 +- 27.85 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 1433.3 +- 277.24 | 1349.9 +- 338.27 | 1405.7 +- 205.41 | 1532.1 +- 347.22 | +4.13 +- 30.21 | +8.99 +- 29.39 | | 64b-1t1c-ethip4-ip4base | 431.56 +- 242.82 | 377.0 +- 245.15 | 411.56 +- 252.47 | 445.0 +- 326.95 | +9.17 +- 97.59 | +8.13 +- 103.49 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 964.0 +- 110.63 | 1027.6 +- 150.9 | 1052.3 +- 223.83 | 1133.22 +- 293.62 | +2.4 +- 26.47 | +7.69 +- 36.1 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | 1193.2 +- 140.28 | 1434.4 +- 485.22 | 1311.22 +- 472.11 | 1372.0 +- 451.69 | -8.59 +- 45.16 | +4.64 +- 51.05 | | 64b-1t1c-eth-l2bdbasemaclrn | 518.5 +- 377.11 | 408.6 +- 238.1 | 319.1 +- 72.23 | 326.88 +- 57.27 | -21.9 +- 48.82 | +2.44 +- 29.32 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | 1537.33 +- 313.67 | 1682.22 +- 423.87 | 1364.11 +- 330.87 | 1382.7 +- 394.58 | -18.91 +- 28.36 | +1.36 +- 37.96 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 834.6 +- 269.95 | 1150.3 +- 468.16 | 929.4 +- 333.82 | 928.2 +- 290.91 | -19.2 +- 43.86 | -0.13 +- 47.61 | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids | 547.5 +- 337.58 | 483.7 +- 251.65 | 549.9 +- 340.55 | 517.33 +- 275.7 | +13.69 +- 91.95 | -5.92 +- 76.86 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 857.89 +- 394.11 | 1004.5 +- 436.59 | 1042.8 +- 486.4 | 963.78 +- 363.57 | +3.81 +- 66.19 | -7.58 +- 55.44 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 631.67 +- 63.1 | 680.11 +- 66.69 | 745.4 +- 85.88 | 684.62 +- 121.75 | +9.6 +- 16.58 | -8.15 +- 19.46 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 293.44 +- 120.89 | 416.8 +- 253.04 | 500.9 +- 400.09 | 458.67 +- 367.93 | +20.18 +- 120.57 | -8.43 +- 103.66 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 369.6 +- 409.67 | 318.0 +- 161.05 | 470.89 +- 419.34 | 426.1 +- 278.41 | +48.08 +- 151.7 | -9.51 +- 99.95 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 1355.0 +- 352.07 | 1241.67 +- 252.79 | 1407.75 +- 537.97 | 1266.56 +- 208.09 | +13.38 +- 49.09 | -10.03 +- 37.42 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 1530.0 +- 568.37 | 1142.7 +- 115.71 | 1358.9 +- 505.08 | 1201.0 +- 564.94 | +18.92 +- 45.81 | -11.62 +- 52.99 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 1547.1 +- 696.89 | 1317.6 +- 173.98 | 1562.4 +- 645.46 | 1323.12 +- 198.67 | +18.58 +- 51.43 | -15.31 +- 37.22 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 1563.1 +- 622.67 | 1077.11 +- 119.29 | 1275.11 +- 412.64 | 1074.8 +- 543.38 | +18.38 +- 40.49 | -15.71 +- 50.6 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 718.2 +- 57.53 | 935.62 +- 285.81 | 992.0 +- 438.45 | 751.1 +- 128.18 | +6.03 +- 56.97 | -24.28 +- 35.87 | | 64b-1t1c-eth-l2patch | 113.3 +- 21.1 | 137.22 +- 27.01 | 144.11 +- 40.97 | 106.22 +- 6.42 | +5.02 +- 36.31 | -26.29 +- 21.42 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 444.67 +- 236.77 | 357.0 +- 36.35 | 598.0 +- 356.14 | 429.44 +- 291.54 | +67.51 +- 101.21 | -28.19 +- 64.85 | | 78b-1t1c-ethip6-ip6base | 393.9 +- 240.23 | 404.8 +- 225.71 | 607.2 +- 386.26 | 420.8 +- 284.23 | +50.0 +- 126.89 | -30.7 +- 64.3 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 235.0 +- 101.65 | 914.2 +- 1301.71 | 527.4 +- 430.69 | 360.22 +- 289.92 | -42.31 +- 94.69 | -31.7 +- 78.31 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | 1051.0 +- 524.32 | 1075.3 +- 525.47 | 1410.62 +- 673.59 | 899.89 +- 519.03 | +31.18 +- 89.63 | -36.21 +- 47.77 | | 64b-1t1c-eth-l2xcbase | 307.12 +- 80.7 | 327.2 +- 59.93 | 471.33 +- 331.56 | 286.4 +- 52.55 | +44.05 +- 104.71 | -39.24 +- 44.17 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 510.44 +- 354.11 | 495.3 +- 351.72 | 484.5 +- 355.82 | 289.9 +- 130.53 | -2.18 +- 99.93 | -40.17 +- 51.54 | +-------------------------------------------------------------------+-------------------+--------------------+-------------------+-------------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "8" for CSIT rls2110, "9" for CSIT rls2202). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2110.0-9 vs 2110.0-8: Compares CSIT environment current vs previous with previous VPP code. 2202.0-9 vs 2110.0-9: Compares VPP code current vs previous in the current CSIT environment.