+--------------------------------------------------------------+----------------+--------------------+-----------------+-----------------+----------------------+----------------------+ | Test Case | 2101.0-7 | 2106.0-7 | 2106.0-8 | 2110.0-8 | 2106.0-8 vs 2106.0-7 | 2110.0-8 vs 2106.0-8 | +--------------------------------------------------------------+----------------+--------------------+-----------------+-----------------+----------------------+----------------------+ | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 51.4 +- 1.58 | 4624.09 +- 1492.86 | 170.4 +- 97.87 | 281.4 +- 395.72 | -96.31 +- 2.43 | +65.14 +- 250.85 | | 64b-2t1c-avf-eth-l2xcbase | 40.4 +- 1.35 | 4585.27 +- 1498.54 | 79.5 +- 6.19 | 122.2 +- 105.79 | -98.27 +- 0.58 | +53.71 +- 133.6 | | 64b-2t1c-eth-l2xcbase | 42.3 +- 3.4 | 4590.64 +- 1494.36 | 114.0 +- 77.57 | 157.0 +- 116.67 | -97.52 +- 1.87 | +37.72 +- 138.77 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 51.6 +- 1.71 | 4610.55 +- 1500.45 | 141.2 +- 69.15 | 181.5 +- 105.3 | -96.94 +- 1.8 | +28.54 +- 97.59 | | 64b-2t1c-eth-l2patch | 36.1 +- 2.81 | 4573.09 +- 1498.48 | 72.6 +- 10.19 | 92.0 +- 74.89 | -98.41 +- 0.57 | +26.72 +- 104.68 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 74.4 +- 12.32 | 4630.18 +- 1493.88 | 135.2 +- 17.99 | 165.2 +- 84.44 | -97.08 +- 1.02 | +22.19 +- 64.54 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 45.4 +- 0.7 | 4591.82 +- 1499.39 | 125.7 +- 80.29 | 150.3 +- 111.75 | -97.26 +- 1.96 | +19.57 +- 117.2 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 95.0 +- 4.52 | 4629.55 +- 1489.35 | 148.5 +- 69.38 | 175.6 +- 93.53 | -96.79 +- 1.82 | +18.25 +- 83.78 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 125.2 +- 3.49 | 4756.45 +- 1493.34 | 288.9 +- 20.67 | 320.4 +- 79.13 | -93.93 +- 1.96 | +10.9 +- 28.52 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 62.0 +- 3.33 | 4611.36 +- 1499.93 | 134.7 +- 93.56 | 139.8 +- 82.55 | -97.08 +- 2.24 | +3.79 +- 94.62 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 268.8 +- 10.17 | 5075.09 +- 1501.27 | 655.5 +- 42.35 | 677.3 +- 47.82 | -87.08 +- 3.91 | +3.33 +- 9.89 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 49.1 +- 7.45 | 4629.73 +- 1496.5 | 134.0 +- 10.86 | 136.6 +- 78.92 | -97.11 +- 0.96 | +1.94 +- 59.47 | | 64b-2t1c-avf-ethip4-ip4base | 45.2 +- 1.23 | 4594.64 +- 1497.67 | 133.0 +- 77.9 | 134.4 +- 77.53 | -97.11 +- 1.94 | +1.05 +- 83.08 | | 78b-2t1c-avf-ethip6-ip6base | 48.3 +- 2.91 | 4594.73 +- 1489.41 | 149.1 +- 93.39 | 148.9 +- 105.82 | -96.75 +- 2.29 | -0.13 +- 94.6 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 112.8 +- 3.61 | 4751.73 +- 1489.75 | 279.3 +- 35.55 | 276.6 +- 16.78 | -94.12 +- 1.99 | -0.97 +- 13.96 | | 64b-2t1c-avf-eth-l2patch | 27.6 +- 1.26 | 4561.73 +- 1500.68 | 40.1 +- 1.6 | 39.3 +- 2.36 | -99.12 +- 0.29 | -2.0 +- 7.06 | | 64b-2t1c-eth-l2bdbasemaclrn | 46.5 +- 2.92 | 4614.82 +- 1500.93 | 152.3 +- 89.89 | 148.4 +- 104.66 | -96.7 +- 2.22 | -2.56 +- 89.61 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 220.8 +- 9.59 | 4806.91 +- 1485.42 | 328.0 +- 78.41 | 314.8 +- 98.22 | -93.18 +- 2.67 | -4.02 +- 37.72 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 133.5 +- 7.81 | 4787.27 +- 1489.98 | 338.9 +- 60.09 | 320.1 +- 72.16 | -92.92 +- 2.54 | -5.55 +- 27.09 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 162.7 +- 27.37 | 4679.36 +- 1489.98 | 218.5 +- 56.21 | 206.0 +- 8.33 | -95.33 +- 1.91 | -5.72 +- 24.55 | | 78b-2t1c-ethip6-ip6scale20k | 73.5 +- 10.99 | 4622.45 +- 1499.04 | 179.4 +- 115.2 | 165.7 +- 105.03 | -96.12 +- 2.79 | -7.64 +- 83.34 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 186.1 +- 15.03 | 4828.73 +- 1505.13 | 398.0 +- 104.28 | 364.2 +- 72.09 | -91.76 +- 3.36 | -8.49 +- 30.05 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 152.6 +- 10.7 | 4758.64 +- 1489.74 | 307.5 +- 78.99 | 279.8 +- 46.86 | -93.54 +- 2.62 | -9.01 +- 27.9 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 189.2 +- 10.76 | 4756.09 +- 1495.23 | 306.8 +- 111.27 | 279.0 +- 65.2 | -93.55 +- 3.1 | -9.06 +- 39.24 | | 78b-2t1c-avf-ethip6-ip6scale20k | 48.3 +- 1.64 | 4613.64 +- 1503.04 | 135.0 +- 83.64 | 122.7 +- 76.79 | -97.07 +- 2.05 | -9.11 +- 80.04 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 246.0 +- 8.26 | 4681.91 +- 1492.51 | 238.4 +- 96.01 | 215.1 +- 13.77 | -94.91 +- 2.62 | -9.77 +- 36.79 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 58.1 +- 1.85 | 4605.64 +- 1499.33 | 172.8 +- 108.11 | 153.0 +- 86.47 | -96.25 +- 2.65 | -11.46 +- 74.65 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 175.0 +- 6.62 | 4681.0 +- 1496.15 | 213.5 +- 65.7 | 186.7 +- 11.6 | -95.44 +- 2.02 | -12.55 +- 27.45 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 153.5 +- 6.96 | 4819.0 +- 1486.89 | 371.5 +- 56.64 | 315.1 +- 82.66 | -92.29 +- 2.65 | -15.18 +- 25.74 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 181.1 +- 8.76 | 4742.55 +- 1485.0 | 283.0 +- 48.28 | 237.8 +- 15.43 | -94.03 +- 2.13 | -15.97 +- 15.34 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 48.7 +- 2.54 | 4599.27 +- 1488.93 | 146.8 +- 93.55 | 121.5 +- 77.76 | -96.81 +- 2.28 | -17.23 +- 74.75 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 124.7 +- 13.85 | 4645.18 +- 1490.6 | 229.9 +- 92.97 | 189.0 +- 89.11 | -95.05 +- 2.55 | -17.79 +- 51.06 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 148.2 +- 8.56 | 4761.64 +- 1489.38 | 352.7 +- 99.38 | 279.4 +- 8.5 | -92.59 +- 3.12 | -20.78 +- 22.45 | | 64b-2t1c-ethip4-ip4scale20k | 49.4 +- 8.14 | 4613.18 +- 1495.56 | 190.6 +- 119.47 | 148.9 +- 84.12 | -95.87 +- 2.92 | -21.88 +- 65.92 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 57.5 +- 4.53 | 4613.18 +- 1499.6 | 203.3 +- 109.69 | 157.1 +- 21.15 | -95.59 +- 2.78 | -22.73 +- 42.97 | | 64b-2t1c-ethip4-ip4base | 49.6 +- 8.25 | 4628.0 +- 1489.55 | 167.0 +- 60.6 | 124.1 +- 15.6 | -96.39 +- 1.75 | -25.69 +- 28.53 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 64.8 +- 3.61 | 4616.36 +- 1494.93 | 162.2 +- 81.41 | 119.2 +- 20.18 | -96.49 +- 2.1 | -26.51 +- 38.93 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 45.0 +- 2.36 | 4598.45 +- 1497.95 | 170.6 +- 115.93 | 119.2 +- 80.06 | -96.29 +- 2.8 | -30.13 +- 66.76 | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 60.71 +- 3.3 | 4715.55 +- 1471.73 | 283.1 +- 82.91 | 179.4 +- 26.32 | -94.0 +- 2.57 | -36.63 +- 20.76 | | 64b-2t1c-avf-ethip4-ip4scale20k | 45.0 +- 1.56 | 4603.18 +- 1496.24 | 175.8 +- 105.82 | 109.3 +- 16.15 | -96.18 +- 2.61 | -37.83 +- 38.54 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 51.4 +- 4.86 | 4608.91 +- 1496.8 | 210.7 +- 125.01 | 124.9 +- 78.82 | -95.43 +- 3.09 | -40.72 +- 51.35 | | 78b-2t1c-ethip6-ip6base | 54.2 +- 12.33 | 4597.45 +- 1495.3 | 180.4 +- 92.18 | 102.9 +- 13.1 | -96.08 +- 2.38 | -42.96 +- 30.04 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 47.2 +- 1.99 | 4604.55 +- 1499.03 | 230.5 +- 132.6 | 119.8 +- 65.99 | -94.99 +- 3.31 | -48.03 +- 41.4 | +--------------------------------------------------------------+----------------+--------------------+-----------------+-----------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "7" for CSIT rls2106, "8" for CSIT rls2110). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2106.0-8 vs 2106.0-7: Compares CSIT environment current vs previous with previous VPP code. 2110.0-8 vs 2106.0-8: Compares VPP code current vs previous in the current CSIT environment.