+-------------------------------------------------------------------+--------------------+-------------------+-------------------+--------------------+----------------------+----------------------+ | Test Case | 2101.0-7 | 2106.0-7 | 2106.0-8 | 2110.0-8 | 2106.0-8 vs 2106.0-7 | 2110.0-8 vs 2106.0-8 | +-------------------------------------------------------------------+--------------------+-------------------+-------------------+--------------------+----------------------+----------------------+ | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 407.22 +- 659.71 | 447.4 +- 378.51 | 235.0 +- 101.65 | 914.2 +- 1301.71 | -47.47 +- 49.91 | +289.02 +- 578.91 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 408.5 +- 635.21 | 453.91 +- 355.09 | 389.5 +- 337.82 | 623.11 +- 501.11 | -14.19 +- 100.23 | +59.98 +- 189.22 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 384.8 +- 618.76 | 491.44 +- 401.19 | 457.88 +- 423.92 | 720.2 +- 407.04 | -6.83 +- 115.0 | +57.29 +- 170.62 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 763.33 +- 878.79 | 455.09 +- 250.6 | 500.3 +- 238.86 | 734.3 +- 397.04 | +9.93 +- 80.12 | +46.77 +- 105.87 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 868.6 +- 1114.06 | 329.82 +- 106.57 | 293.44 +- 120.89 | 416.8 +- 253.04 | -11.03 +- 46.58 | +42.04 +- 104.21 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 664.0 +- 38.67 | 712.73 +- 100.32 | 834.6 +- 269.95 | 1150.3 +- 468.16 | +17.1 +- 41.31 | +37.83 +- 71.65 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 595.12 +- 90.45 | 919.36 +- 361.46 | 718.2 +- 57.53 | 935.62 +- 285.81 | -21.88 +- 31.34 | +30.27 +- 41.14 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 1673.3 +- 940.14 | 1431.27 +- 445.05 | 1039.1 +- 84.42 | 1346.89 +- 349.76 | -27.4 +- 23.33 | +29.62 +- 35.27 | | 64b-1t1c-eth-l2patch | 140.3 +- 20.13 | 387.55 +- 483.41 | 113.3 +- 21.1 | 137.22 +- 27.01 | -70.76 +- 36.87 | +21.11 +- 32.82 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | NT | 1245.64 +- 147.19 | 1193.2 +- 140.28 | 1434.4 +- 485.22 | -4.21 +- 15.97 | +20.21 +- 43.05 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | NT | 499.91 +- 58.95 | 507.33 +- 61.29 | 607.0 +- 302.12 | +1.49 +- 17.13 | +19.65 +- 61.28 | | 78b-1t1c-ethip6ip6-ip6base-srv6enc1sid | 493.67 +- 689.47 | 370.2 +- 264.18 | 523.56 +- 351.82 | 617.67 +- 392.21 | +41.43 +- 138.62 | +17.98 +- 109.07 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 670.4 +- 64.8 | 762.0 +- 96.27 | 857.89 +- 394.11 | 1004.5 +- 436.59 | +12.58 +- 53.64 | +17.09 +- 74.05 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | NT | 1699.3 +- 498.37 | 1537.33 +- 313.67 | 1682.22 +- 423.87 | -9.53 +- 32.32 | +9.42 +- 35.48 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 789.38 +- 1136.4 | 489.6 +- 361.04 | 315.7 +- 275.74 | 344.7 +- 160.94 | -35.52 +- 73.71 | +9.19 +- 108.13 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 1301.7 +- 797.7 | 1426.2 +- 296.2 | 1102.3 +- 259.63 | 1202.8 +- 354.03 | -22.71 +- 24.27 | +9.12 +- 41.13 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 1295.33 +- 1106.5 | 699.45 +- 308.53 | 631.67 +- 63.1 | 680.11 +- 66.69 | -9.69 +- 40.84 | +7.67 +- 15.07 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 2057.2 +- 1684.34 | 1197.73 +- 464.91 | 964.0 +- 110.63 | 1027.6 +- 150.9 | -19.51 +- 32.58 | +6.6 +- 19.87 | | 64b-1t1c-eth-l2xcbase | 219.33 +- 46.48 | 418.7 +- 339.82 | 307.12 +- 80.7 | 327.2 +- 59.93 | -26.65 +- 62.58 | +6.54 +- 34.12 | | 78b-1t1c-ethip6-ip6base | 429.89 +- 648.78 | 404.18 +- 331.02 | 393.9 +- 240.23 | 404.8 +- 225.71 | -2.54 +- 99.51 | +2.77 +- 84.92 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | NT | 4270.44 +- 563.01 | 4267.78 +- 533.21 | 4376.5 +- 571.66 | -0.06 +- 18.15 | +2.55 +- 18.54 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | NT | 1094.18 +- 561.11 | 1051.0 +- 524.32 | 1075.3 +- 525.47 | -3.95 +- 68.72 | +2.31 +- 71.45 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 2129.25 +- 867.98 | 1427.91 +- 189.39 | 1337.67 +- 122.11 | 1329.7 +- 125.52 | -6.32 +- 15.08 | -0.6 +- 13.05 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 181.2 +- 22.43 | 339.0 +- 324.6 | 510.44 +- 354.11 | 495.3 +- 351.72 | +50.57 +- 178.04 | -2.97 +- 96.33 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 1019.86 +- 171.5 | 1358.91 +- 372.01 | 1352.56 +- 640.64 | 1301.8 +- 595.82 | -0.47 +- 54.45 | -3.75 +- 63.39 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 1523.25 +- 859.76 | 1480.56 +- 363.98 | 1433.3 +- 277.24 | 1349.9 +- 338.27 | -3.19 +- 30.28 | -5.82 +- 29.81 | | 64b-1t1c-ethip4vxlan-l2xcbase | 543.12 +- 712.67 | 483.82 +- 319.6 | 350.8 +- 52.95 | 326.8 +- 55.42 | -27.49 +- 49.13 | -6.84 +- 21.15 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 428.25 +- 714.43 | 524.11 +- 391.98 | 397.3 +- 246.99 | 366.8 +- 261.14 | -24.2 +- 73.72 | -7.68 +- 87.26 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 1198.6 +- 247.44 | 1486.2 +- 260.02 | 1355.0 +- 352.07 | 1241.67 +- 252.79 | -8.83 +- 28.56 | -8.36 +- 30.25 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 455.0 +- 655.77 | 333.9 +- 318.81 | 417.2 +- 234.51 | 369.6 +- 138.54 | +24.95 +- 138.44 | -11.41 +- 59.85 | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids | 510.3 +- 634.17 | 536.78 +- 360.74 | 547.5 +- 337.58 | 483.7 +- 251.65 | +2.0 +- 93.03 | -11.65 +- 71.27 | | 64b-1t1c-ethip4-ip4base | 621.0 +- 851.0 | 516.91 +- 360.85 | 431.56 +- 242.82 | 377.0 +- 245.15 | -16.51 +- 74.86 | -12.64 +- 75.12 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 184.7 +- 24.0 | 471.0 +- 381.06 | 369.6 +- 409.67 | 318.0 +- 161.05 | -21.53 +- 107.68 | -13.96 +- 104.85 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 1621.3 +- 1308.82 | 1811.45 +- 749.16 | 1547.1 +- 696.89 | 1317.6 +- 173.98 | -14.59 +- 52.23 | -14.83 +- 39.98 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 445.0 +- 626.44 | 436.6 +- 327.6 | 444.67 +- 236.77 | 357.0 +- 36.35 | +1.85 +- 93.71 | -19.72 +- 43.52 | | 64b-1t1c-eth-l2bdbasemaclrn | 429.22 +- 663.18 | 296.3 +- 75.83 | 518.5 +- 377.11 | 408.6 +- 238.1 | +74.99 +- 134.92 | -21.2 +- 73.44 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | NT | 688.27 +- 378.39 | 821.9 +- 425.79 | 644.2 +- 274.05 | +19.41 +- 90.21 | -21.62 +- 52.54 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 1584.67 +- 1292.1 | 1861.27 +- 785.91 | 1530.0 +- 568.37 | 1142.7 +- 115.71 | -17.8 +- 46.23 | -25.31 +- 28.76 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 1171.62 +- 888.7 | 983.1 +- 75.91 | 1563.1 +- 622.67 | 1077.11 +- 119.29 | +59.0 +- 64.52 | -31.09 +- 28.49 | +-------------------------------------------------------------------+--------------------+-------------------+-------------------+--------------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "7" for CSIT rls2106, "8" for CSIT rls2110). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2106.0-8 vs 2106.0-7: Compares CSIT environment current vs previous with previous VPP code. 2110.0-8 vs 2106.0-8: Compares VPP code current vs previous in the current CSIT environment.