+-----------------------------------------------------+------------------+--------------------+------------------+-----------------+----------------------+----------------------+ | Test Case | 2101.0-7 | 2106.0-7 | 2106.0-8 | 2110.0-8 | 2106.0-8 vs 2106.0-7 | 2110.0-8 vs 2106.0-8 | +-----------------------------------------------------+------------------+--------------------+------------------+-----------------+----------------------+----------------------+ | 64b-1t1c-eth-l2bdscale1mmaclrn | 131.7 +- 21.83 | 4648.73 +- 1502.94 | 121.8 +- 17.1 | 222.0 +- 286.18 | -97.38 +- 0.92 | +82.27 +- 236.35 | | 64b-1t1c-eth-l2bdscale10kmaclrn | 126.0 +- 14.54 | 4597.73 +- 1494.39 | 93.1 +- 4.79 | 163.9 +- 239.71 | -97.98 +- 0.67 | +76.05 +- 257.63 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 146.0 +- 14.58 | 4629.64 +- 1492.38 | 129.4 +- 1.9 | 203.5 +- 248.99 | -97.2 +- 0.9 | +57.26 +- 192.43 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | NT | 4747.27 +- 1484.63 | 255.8 +- 33.02 | 345.5 +- 265.65 | -94.61 +- 1.82 | +35.07 +- 105.3 | | 64b-1t1c-eth-l2xcbase-eth-2memif-1dcr | NT | 4689.73 +- 1497.73 | 203.1 +- 43.15 | 268.6 +- 286.98 | -95.67 +- 1.66 | +32.25 +- 144.06 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 133.56 +- 19.42 | 4615.18 +- 1493.22 | 110.6 +- 3.41 | 143.4 +- 51.88 | -97.6 +- 0.78 | +29.66 +- 47.07 | | 78b-1t1c-ethip6-ip6scale2m | 140.2 +- 13.02 | 4715.55 +- 1543.24 | 95.9 +- 8.41 | 107.4 +- 14.58 | -97.97 +- 0.69 | +11.99 +- 18.1 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 149.4 +- 23.15 | 4691.09 +- 1520.58 | 133.6 +- 32.25 | 146.9 +- 42.7 | -97.15 +- 1.15 | +9.96 +- 41.54 | | 78b-1t1c-ethip6-ip6base-iacldstbase | 112.33 +- 11.75 | 4607.09 +- 1501.64 | 80.9 +- 6.79 | 85.1 +- 7.77 | -98.24 +- 0.59 | +5.19 +- 13.04 | | 64b-1t1c-ethip4-ip4base-eth-2memif-1dcr | NT | 4768.55 +- 1494.13 | 272.4 +- 27.03 | 284.5 +- 51.47 | -94.29 +- 1.88 | +4.44 +- 21.55 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 278.2 +- 443.86 | 4734.45 +- 1203.23 | 128.0 +- 3.3 | 130.7 +- 3.37 | -97.3 +- 0.69 | +2.11 +- 3.72 | | 78b-1t1c-ethip6-ip6scale20k | 102.6 +- 15.59 | 4613.36 +- 1504.26 | 76.9 +- 6.23 | 78.2 +- 7.11 | -98.33 +- 0.56 | +1.69 +- 12.39 | | 64b-1t1c-eth-l2bdbasemaclrn | 105.2 +- 14.64 | 4603.45 +- 1496.42 | 90.0 +- 2.79 | 91.4 +- 3.17 | -98.04 +- 0.64 | +1.56 +- 4.72 | | 64b-1t1c-af-xdp-eth-l2bdscale10kmaclrn | NT | 129.0 +- NaN | 134.2 +- 1.03 | 134.5 +- 1.65 | +4.03 +- NaN | +0.22 +- 1.45 | | 64b-1t1c-ethip4-ip4scale2m | 253.4 +- 403.11 | 4598.64 +- 1488.73 | 93.8 +- 11.45 | 94.0 +- 13.7 | -97.96 +- 0.71 | +0.21 +- 19.05 | | 64b-1t1c-af-xdp-eth-l2bdscale1mmaclrn | NT | 299.0 +- NaN | 162.9 +- 86.49 | 162.4 +- 82.18 | -45.52 +- NaN | -0.31 +- 73.12 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 141.8 +- 16.04 | 4710.91 +- 1545.21 | 118.6 +- 4.12 | 118.2 +- 3.52 | -97.48 +- 0.83 | -0.34 +- 4.56 | | 64b-1t1c-ethip4-ip4base-iacldstbase | 292.1 +- 487.22 | 4607.0 +- 1495.83 | 94.4 +- 5.95 | 93.0 +- 5.42 | -97.95 +- 0.68 | -1.48 +- 8.45 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 143.4 +- 15.7 | 4632.73 +- 1494.72 | 149.9 +- 34.71 | 146.5 +- 40.48 | -96.76 +- 1.29 | -2.27 +- 35.23 | | 64b-1t1c-eth-l2patch | 73.0 +- 11.2 | 4564.64 +- 1500.0 | 50.0 +- 3.74 | 48.4 +- 5.04 | -98.9 +- 0.37 | -3.2 +- 12.41 | | 78b-1t1c-ethip6-ip6scale200k | 338.7 +- 445.04 | 4749.36 +- 1560.49 | 94.4 +- 10.68 | 90.2 +- 7.6 | -98.01 +- 0.69 | -4.45 +- 13.48 | | 78b-1t1c-ethip6-ip6base | 110.7 +- 14.61 | 4587.82 +- 1499.42 | 80.9 +- 31.62 | 64.3 +- 4.45 | -98.24 +- 0.9 | -20.52 +- 31.55 | | 64b-1t1c-af-xdp-eth-l2bdscale100kmaclrn | NT | 535.0 +- NaN | 179.5 +- 96.74 | 130.2 +- 15.58 | -66.45 +- NaN | -27.47 +- 40.04 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 123.7 +- 7.32 | 4618.55 +- 1495.71 | 189.6 +- 248.61 | 115.0 +- 12.17 | -95.89 +- 5.54 | -39.35 +- 79.79 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 287.4 +- 464.97 | 4608.27 +- 1493.25 | 202.5 +- 326.97 | 106.6 +- 3.78 | -95.61 +- 7.24 | -47.36 +- 85.02 | | 64b-1t1c-eth-l2bdscale100kmaclrn | 501.6 +- 610.29 | 4607.82 +- 1491.5 | 171.9 +- 247.46 | 90.0 +- 4.59 | -96.27 +- 5.5 | -47.64 +- 75.42 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 117.0 +- 17.53 | 4608.73 +- 1490.08 | 181.2 +- 240.76 | 93.3 +- 4.06 | -96.07 +- 5.38 | -48.51 +- 68.45 | | 64b-1t1c-ethip4-ip4scale20k | 240.2 +- 401.67 | 4588.73 +- 1497.39 | 159.4 +- 250.1 | 75.9 +- 3.45 | -96.53 +- 5.57 | -52.38 +- 74.74 | | 64b-1t1c-eth-l2xcbase | 85.7 +- 9.33 | 4578.18 +- 1494.2 | 145.0 +- 243.19 | 65.0 +- 3.3 | -96.83 +- 5.41 | -55.17 +- 75.22 | | 64b-1t1c-ethip4-ip4base | 97.7 +- 12.18 | 4600.09 +- 1500.62 | 169.3 +- 283.47 | 75.8 +- 7.79 | -96.32 +- 6.28 | -55.23 +- 75.11 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 297.6 +- 461.89 | 4628.82 +- 1487.79 | 324.4 +- 391.43 | 116.1 +- 4.82 | -92.99 +- 8.75 | -64.21 +- 43.21 | | 64b-1t1c-ethip4-ip4scale200k | 116.3 +- 15.28 | 4592.09 +- 1487.59 | 293.89 +- 395.12 | 80.0 +- 5.29 | -93.6 +- 8.85 | -72.78 +- 36.64 | +-----------------------------------------------------+------------------+--------------------+------------------+-----------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "7" for CSIT rls2106, "8" for CSIT rls2110). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2106.0-8 vs 2106.0-7: Compares CSIT environment current vs previous with previous VPP code. 2110.0-8 vs 2106.0-8: Compares VPP code current vs previous in the current CSIT environment.