+--------------------------------------------------------------+----------------+--------------------+-----------------+-----------------+----------------------+----------------------+ | Test Case | 2101.0-7 | 2106.0-7 | 2106.0-8 | 2110.0-8 | 2106.0-8 vs 2106.0-7 | 2110.0-8 vs 2106.0-8 | +--------------------------------------------------------------+----------------+--------------------+-----------------+-----------------+----------------------+----------------------+ | 64b-2t1c-ethip4-ip4scale200k-rnd | 58.9 +- 3.57 | 4612.18 +- 1490.57 | 99.2 +- 4.64 | 134.2 +- 86.5 | -97.85 +- 0.7 | +35.28 +- 87.43 | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 109.3 +- 4.37 | 4913.82 +- 1837.58 | 132.1 +- 4.98 | 170.0 +- 8.97 | -97.31 +- 1.01 | +28.69 +- 8.34 | | 78b-2t1c-af-xdp-ethip6-ip6base | NT | 4582.44 +- 1682.98 | 600.7 +- 567.78 | 724.1 +- 388.76 | -86.89 +- 13.29 | +20.54 +- 131.03 | | 78b-2t1c-ethip6-ip6scale2m-rnd | 81.5 +- 4.99 | 4613.36 +- 1496.93 | 113.1 +- 19.63 | 132.4 +- 64.47 | -97.55 +- 0.9 | +17.06 +- 60.52 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 67.1 +- 5.67 | 4609.09 +- 1488.65 | 106.2 +- 18.92 | 123.1 +- 11.75 | -97.7 +- 0.85 | +15.91 +- 23.43 | | 64b-2t1c-avf-eth-l2patch | 24.7 +- 1.77 | 4555.45 +- 1499.6 | 32.6 +- 1.65 | 37.4 +- 6.19 | -99.28 +- 0.24 | +14.72 +- 19.84 | | 64b-2t1c-ethip4-ip4scale20k | 55.1 +- 2.33 | 4587.82 +- 1496.74 | 74.0 +- 3.06 | 83.0 +- 33.35 | -98.39 +- 0.53 | +12.16 +- 45.3 | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 91.67 +- 31.25 | 4625.45 +- 1448.73 | 94.4 +- 13.71 | 105.7 +- 32.72 | -97.96 +- 0.7 | +11.97 +- 38.29 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k-rnd | NT | 4534.33 +- 1655.42 | 478.1 +- 343.49 | 520.8 +- 337.09 | -89.46 +- 8.5 | +8.93 +- 105.34 | | 78b-2t1c-ethip6-ip6base | 49.1 +- 2.47 | 4589.18 +- 1495.86 | 73.7 +- 3.2 | 79.9 +- 7.28 | -98.39 +- 0.53 | +8.41 +- 10.94 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 215.5 +- 12.76 | 4820.8 +- 1550.6 | 376.5 +- 51.91 | 407.6 +- 42.52 | -92.19 +- 2.73 | +8.26 +- 18.72 | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 43.7 +- 1.64 | 4590.18 +- 1490.56 | 82.5 +- 14.59 | 87.2 +- 34.69 | -98.2 +- 0.66 | +5.7 +- 46.02 | | 78b-2t1c-ethip6-ip6scale200k | 134.7 +- 82.78 | 4676.64 +- 1394.35 | 256.4 +- 224.83 | 270.5 +- 243.52 | -94.52 +- 5.08 | +5.5 +- 132.58 | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 85.2 +- 37.87 | 4615.55 +- 1482.22 | 140.0 +- 67.1 | 147.4 +- 95.25 | -96.97 +- 1.75 | +5.29 +- 84.71 | | 64b-2t1c-af-xdp-ethip4-ip4base | NT | 5109.1 +- 57.65 | 409.7 +- 119.84 | 427.2 +- 156.7 | -91.98 +- 2.35 | +4.27 +- 48.92 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 70.8 +- 9.35 | 4614.18 +- 1487.91 | 112.3 +- 6.68 | 116.7 +- 8.06 | -97.57 +- 0.8 | +3.92 +- 9.47 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 117.7 +- 53.89 | 4622.36 +- 1491.3 | 121.8 +- 3.99 | 125.5 +- 9.78 | -97.36 +- 0.85 | +3.04 +- 8.71 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 62.5 +- 2.27 | 4595.36 +- 1497.92 | 87.1 +- 7.13 | 88.7 +- 13.43 | -98.1 +- 0.64 | +1.84 +- 17.53 | | 78b-2t1c-ethip6-ip6scale20k | 55.1 +- 3.28 | 4591.64 +- 1500.01 | 72.6 +- 6.93 | 73.7 +- 3.27 | -98.42 +- 0.54 | +1.52 +- 10.69 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 72.7 +- 3.65 | 4601.73 +- 1496.38 | 88.8 +- 8.12 | 89.9 +- 8.66 | -98.07 +- 0.65 | +1.24 +- 13.45 | | 64b-2t1c-avf-ethip4-ip4scale20k | 48.2 +- 2.49 | 4591.27 +- 1495.57 | 73.4 +- 6.31 | 74.1 +- 7.34 | -98.4 +- 0.54 | +0.95 +- 13.24 | | 64b-2t1c-eth-l2patch | 34.2 +- 1.23 | 4572.45 +- 1499.6 | 50.7 +- 2.06 | 51.0 +- 3.23 | -98.89 +- 0.37 | +0.59 +- 7.57 | | 64b-2t1c-ethip4-ip4base | 53.0 +- 1.33 | 4601.82 +- 1500.44 | 84.8 +- 11.58 | 84.7 +- 13.83 | -98.16 +- 0.65 | -0.12 +- 21.27 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 205.6 +- 12.94 | 4800.64 +- 1485.86 | 309.7 +- 25.08 | 309.1 +- 20.89 | -93.55 +- 2.06 | -0.19 +- 10.53 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 185.5 +- 4.35 | 4760.91 +- 1474.3 | 282.1 +- 11.4 | 281.4 +- 13.04 | -94.07 +- 1.85 | -0.25 +- 6.13 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k | NT | 4672.0 +- 1517.4 | 317.3 +- 161.06 | 316.5 +- 192.47 | -93.21 +- 4.09 | -0.25 +- 79.01 | | 78b-2t1c-avf-ethip6-ip6scale200k | 85.4 +- 24.49 | 4659.91 +- 1510.8 | 123.1 +- 44.77 | 122.1 +- 65.17 | -97.36 +- 1.29 | -0.81 +- 64.06 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 262.6 +- 13.89 | 4799.45 +- 1488.78 | 302.3 +- 13.33 | 299.1 +- 6.79 | -93.7 +- 1.97 | -1.06 +- 4.91 | | 64b-2t1c-eth-l2xcbase | 43.0 +- 1.15 | 4585.09 +- 1496.16 | 76.7 +- 9.9 | 75.8 +- 2.94 | -98.33 +- 0.59 | -1.17 +- 13.32 | | 64b-2t1c-ethip4-ip4scale2m | 61.3 +- 3.5 | 4605.36 +- 1497.96 | 88.6 +- 11.0 | 87.5 +- 8.96 | -98.08 +- 0.67 | -1.24 +- 15.89 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 120.5 +- 6.1 | 4715.27 +- 1489.93 | 223.6 +- 6.57 | 220.7 +- 12.57 | -95.26 +- 1.5 | -1.3 +- 6.33 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 158.3 +- 17.58 | 4719.0 +- 1489.51 | 221.2 +- 10.48 | 217.4 +- 8.0 | -95.31 +- 1.5 | -1.72 +- 5.9 | | 64b-2t1c-eth-l2bdbasemaclrn | 59.4 +- 2.84 | 4597.45 +- 1491.99 | 94.6 +- 10.18 | 92.7 +- 8.12 | -97.94 +- 0.7 | -2.01 +- 13.6 | | 78b-2t1c-ethip6-ip6scale2m | 96.4 +- 13.64 | 4596.91 +- 1501.75 | 86.9 +- 7.82 | 84.8 +- 4.73 | -98.11 +- 0.64 | -2.42 +- 10.34 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 57.0 +- 2.4 | 4591.73 +- 1495.05 | 83.0 +- 9.24 | 80.9 +- 8.33 | -98.19 +- 0.62 | -2.53 +- 14.78 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 265.4 +- 11.75 | 4675.91 +- 1479.85 | 236.3 +- 42.4 | 226.3 +- 15.24 | -94.95 +- 1.84 | -4.23 +- 18.35 | | 78b-2t1c-ethip6-ip6scale200k-rnd | 119.8 +- 77.16 | 4655.36 +- 1497.82 | 276.6 +- 264.79 | 264.8 +- 247.57 | -94.06 +- 6.0 | -4.27 +- 128.1 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 43.1 +- 1.91 | 4582.45 +- 1496.95 | 75.5 +- 10.73 | 71.8 +- 10.22 | -98.35 +- 0.59 | -4.9 +- 19.13 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 164.6 +- 11.29 | 4702.0 +- 1487.54 | 211.8 +- 24.37 | 200.1 +- 5.55 | -95.5 +- 1.52 | -5.52 +- 11.18 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 64.6 +- 2.88 | 4599.64 +- 1495.02 | 93.6 +- 15.84 | 88.4 +- 7.17 | -97.97 +- 0.75 | -5.56 +- 17.72 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 56.5 +- 3.14 | 4604.27 +- 1487.31 | 96.7 +- 8.59 | 91.3 +- 20.99 | -97.9 +- 0.7 | -5.58 +- 23.27 | | 64b-2t1c-eth-l2bdscale1mmaclrn | 98.8 +- 23.42 | 4636.45 +- 1488.39 | 189.4 +- 114.88 | 178.8 +- 108.98 | -95.91 +- 2.8 | -5.6 +- 81.17 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 69.3 +- 1.49 | 4599.73 +- 1497.04 | 97.6 +- 16.79 | 92.0 +- 7.12 | -97.88 +- 0.78 | -5.74 +- 17.78 | | 64b-2t1c-avf-ethip4-ip4base | 48.0 +- 3.74 | 4586.91 +- 1491.46 | 71.3 +- 7.02 | 66.0 +- 3.46 | -98.45 +- 0.53 | -7.43 +- 10.33 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k | NT | 4497.75 +- 1655.75 | 248.1 +- 97.19 | 228.9 +- 127.23 | -94.48 +- 2.97 | -7.74 +- 62.74 | | 64b-2t1c-ethip4-ip4scale200k | 55.2 +- 2.15 | 4591.45 +- 1497.28 | 79.7 +- 3.5 | 73.5 +- 5.32 | -98.26 +- 0.57 | -7.78 +- 7.8 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 44.6 +- 3.13 | 4592.64 +- 1498.67 | 79.4 +- 7.21 | 72.7 +- 6.15 | -98.27 +- 0.59 | -8.44 +- 11.36 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 150.0 +- 36.58 | 4665.55 +- 1493.05 | 174.4 +- 21.55 | 159.6 +- 24.19 | -96.26 +- 1.28 | -8.49 +- 17.9 | | 64b-2t1c-avf-eth-l2xcbase | 34.5 +- 1.84 | 4572.55 +- 1497.97 | 67.6 +- 11.83 | 61.7 +- 9.19 | -98.52 +- 0.55 | -8.73 +- 20.98 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 56.4 +- 2.22 | 4593.64 +- 1496.68 | 92.6 +- 24.56 | 83.9 +- 8.97 | -97.98 +- 0.85 | -9.4 +- 25.92 | | 78b-2t1c-avf-ethip6-ip6base | 43.1 +- 2.08 | 4585.55 +- 1496.31 | 74.0 +- 14.66 | 66.9 +- 4.98 | -98.39 +- 0.62 | -9.59 +- 19.13 | | 78b-2t1c-avf-ethip6-ip6scale20k | 50.3 +- 4.52 | 4587.73 +- 1500.36 | 84.1 +- 13.87 | 75.3 +- 13.38 | -98.17 +- 0.67 | -10.46 +- 21.7 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 100.5 +- 7.01 | 4692.09 +- 1494.88 | 194.2 +- 9.44 | 171.4 +- 12.52 | -95.86 +- 1.33 | -11.74 +- 7.74 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 50.0 +- 3.62 | 4589.64 +- 1494.02 | 84.0 +- 14.81 | 73.9 +- 8.43 | -98.17 +- 0.68 | -12.02 +- 18.47 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 145.7 +- 12.91 | 4767.55 +- 1466.68 | 252.6 +- 31.46 | 220.5 +- 16.93 | -94.7 +- 1.76 | -12.71 +- 12.77 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 177.7 +- 46.99 | 4612.18 +- 1492.89 | 132.3 +- 21.69 | 114.2 +- 4.76 | -97.13 +- 1.04 | -13.68 +- 14.6 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k-rnd | NT | 4659.0 +- 1414.6 | 582.0 +- 297.93 | 502.3 +- 382.62 | -87.51 +- 7.44 | -13.69 +- 79.21 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 48.2 +- 5.27 | 4598.64 +- 1483.15 | 101.8 +- 16.31 | 87.5 +- 11.97 | -97.79 +- 0.8 | -14.05 +- 18.11 | | 64b-2t1c-avf-ethip4-ip4scale2m | 54.1 +- 3.67 | 4606.73 +- 1501.11 | 98.5 +- 18.77 | 83.6 +- 8.45 | -97.86 +- 0.81 | -15.13 +- 18.31 | | 64b-2t1c-avf-ethip4-ip4scale200k | 49.1 +- 2.56 | 4595.27 +- 1492.58 | 92.8 +- 13.52 | 78.3 +- 7.96 | -97.98 +- 0.72 | -15.62 +- 14.99 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 169.5 +- 4.33 | 4841.09 +- 1492.12 | 354.2 +- 72.96 | 298.0 +- 22.32 | -92.68 +- 2.71 | -15.87 +- 18.44 | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 52.5 +- 2.22 | 4618.36 +- 1492.98 | 100.2 +- 44.02 | 83.5 +- 10.92 | -97.83 +- 1.18 | -16.67 +- 38.2 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 165.1 +- 23.09 | 4862.36 +- 1472.14 | 433.8 +- 161.34 | 336.0 +- 74.86 | -91.08 +- 4.28 | -22.54 +- 33.58 | | 78b-2t1c-avf-ethip6-ip6scale2m | 96.4 +- 18.54 | 4623.82 +- 1498.2 | 154.9 +- 113.03 | 119.8 +- 80.69 | -96.65 +- 2.67 | -22.66 +- 76.8 | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 68.4 +- 3.63 | 4617.18 +- 1485.25 | 154.2 +- 58.86 | 105.1 +- 26.59 | -96.66 +- 1.67 | -31.84 +- 31.21 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 54.3 +- 3.27 | 4596.18 +- 1495.53 | 141.0 +- 121.83 | 92.5 +- 2.42 | -96.93 +- 2.83 | -34.4 +- 56.71 | | 64b-2t1c-ethip4-ip4scale2m-rnd | 60.3 +- 3.47 | 4592.45 +- 1497.28 | 125.2 +- 124.95 | 81.6 +- 5.34 | -97.27 +- 2.86 | -34.82 +- 65.18 | +--------------------------------------------------------------+----------------+--------------------+-----------------+-----------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "7" for CSIT rls2106, "8" for CSIT rls2110). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2106.0-8 vs 2106.0-7: Compares CSIT environment current vs previous with previous VPP code. 2110.0-8 vs 2106.0-8: Compares VPP code current vs previous in the current CSIT environment.