+--------------------------------------------------------------+---------------+-------------------+----------------+----------------+----------------------+----------------------+ | Test Case | 2101.0-7 | 2106.0-7 | 2106.0-8 | 2110.0-8 | 2106.0-8 vs 2106.0-7 | 2110.0-8 vs 2106.0-8 | +--------------------------------------------------------------+---------------+-------------------+----------------+----------------+----------------------+----------------------+ | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 33.9 +- 2.23 | 1620.64 +- 520.69 | 56.3 +- 2.16 | 64.3 +- 8.64 | -96.53 +- 1.12 | +14.21 +- 15.96 | | 78b-2t1c-ethip6-ip6scale20k | 36.9 +- 0.99 | 2099.55 +- 677.11 | 57.0 +- 3.65 | 61.7 +- 1.49 | -97.29 +- 0.89 | +8.25 +- 7.41 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 34.6 +- 0.52 | 1618.0 +- 519.39 | 54.2 +- 2.15 | 58.5 +- 1.51 | -96.65 +- 1.08 | +7.93 +- 5.11 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 34.3 +- 2.21 | 1625.36 +- 518.2 | 60.5 +- 4.99 | 65.1 +- 2.85 | -96.28 +- 1.23 | +7.6 +- 10.05 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 31.4 +- 0.7 | 1622.18 +- 518.12 | 58.7 +- 3.83 | 63.1 +- 1.45 | -96.38 +- 1.18 | +7.5 +- 7.44 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 157.8 +- 5.53 | 1905.27 +- 544.91 | 344.5 +- 33.16 | 367.9 +- 46.59 | -81.92 +- 5.46 | +6.79 +- 16.99 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 41.4 +- 0.7 | 1606.36 +- 516.52 | 43.3 +- 1.83 | 44.8 +- 1.14 | -97.3 +- 0.87 | +3.46 +- 5.1 | | 78b-2t1c-avf-ethip6-ip6base | 30.0 +- 1.15 | 2088.0 +- 674.93 | 43.8 +- 1.4 | 45.3 +- 1.64 | -97.9 +- 0.68 | +3.42 +- 4.99 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 33.6 +- 0.7 | 1617.91 +- 520.03 | 53.2 +- 2.04 | 55.0 +- 1.05 | -96.71 +- 1.06 | +3.38 +- 4.44 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 48.0 +- 2.16 | 1618.36 +- 519.18 | 55.2 +- 2.49 | 56.6 +- 1.96 | -96.59 +- 1.1 | +2.54 +- 5.82 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 95.5 +- 8.3 | 1726.82 +- 521.0 | 159.1 +- 4.07 | 160.9 +- 6.14 | -90.79 +- 2.79 | +1.13 +- 4.64 | | 64b-2t1c-avf-ethip4-ip4scale20k | 28.1 +- 0.32 | 1612.0 +- 517.74 | 47.7 +- 1.57 | 48.0 +- 1.33 | -97.04 +- 0.96 | +0.63 +- 4.33 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 35.2 +- 0.79 | 1622.36 +- 518.52 | 57.7 +- 2.11 | 57.7 +- 1.89 | -96.44 +- 1.14 | +0.0 +- 4.91 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 83.1 +- 1.66 | 1739.45 +- 519.54 | 177.2 +- 3.97 | 177.1 +- 1.66 | -89.81 +- 3.05 | -0.06 +- 2.43 | | 64b-2t1c-ethip4-ip4scale20k | 27.9 +- 0.57 | 1615.73 +- 518.3 | 52.3 +- 1.57 | 52.2 +- 1.03 | -96.76 +- 1.04 | -0.19 +- 3.58 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 29.1 +- 0.57 | 1614.45 +- 518.55 | 52.2 +- 1.93 | 52.0 +- 1.41 | -96.77 +- 1.05 | -0.38 +- 4.58 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 31.4 +- 0.52 | 1615.0 +- 519.06 | 50.1 +- 0.57 | 49.9 +- 0.74 | -96.9 +- 1.0 | -0.4 +- 1.86 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 77.0 +- 0.82 | 1740.73 +- 518.98 | 177.6 +- 4.79 | 176.8 +- 4.18 | -89.8 +- 3.05 | -0.45 +- 3.57 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 78.2 +- 0.79 | 1732.82 +- 518.99 | 171.7 +- 2.83 | 170.7 +- 2.71 | -90.09 +- 2.97 | -0.58 +- 2.28 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 28.2 +- 0.42 | 1606.91 +- 518.36 | 43.8 +- 1.32 | 43.5 +- 0.85 | -97.27 +- 0.88 | -0.68 +- 3.56 | | 64b-2t1c-eth-l2xcbase | 24.1 +- 0.32 | 1605.73 +- 518.96 | 42.2 +- 0.92 | 41.7 +- 0.82 | -97.37 +- 0.85 | -1.18 +- 2.9 | | 64b-2t1c-avf-eth-l2patch | 17.1 +- 0.32 | 1586.09 +- 518.75 | 22.7 +- 0.67 | 22.4 +- 0.7 | -98.57 +- 0.47 | -1.32 +- 4.25 | | 64b-2t1c-eth-l2patch | 22.2 +- 0.63 | 1595.36 +- 518.85 | 31.5 +- 0.71 | 30.9 +- 0.88 | -98.03 +- 0.64 | -1.9 +- 3.55 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 51.3 +- 3.89 | 1628.27 +- 519.17 | 63.2 +- 4.64 | 61.8 +- 4.26 | -96.12 +- 1.27 | -2.22 +- 9.85 | | 64b-2t1c-eth-l2bdbasemaclrn | 26.3 +- 0.48 | 1608.91 +- 517.7 | 45.6 +- 0.7 | 44.5 +- 0.97 | -97.17 +- 0.91 | -2.41 +- 2.6 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 97.6 +- 3.34 | 1798.91 +- 522.06 | 232.1 +- 7.32 | 226.4 +- 12.95 | -87.1 +- 3.77 | -2.46 +- 6.37 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 28.2 +- 0.42 | 1614.82 +- 518.33 | 51.6 +- 1.71 | 50.3 +- 1.34 | -96.8 +- 1.03 | -2.52 +- 4.15 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 37.4 +- 1.07 | 2105.82 +- 677.53 | 61.2 +- 1.62 | 59.6 +- 1.51 | -97.09 +- 0.94 | -2.61 +- 3.56 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 79.8 +- 1.62 | 1674.27 +- 520.48 | 111.4 +- 3.44 | 108.3 +- 3.33 | -93.35 +- 2.08 | -2.78 +- 4.24 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 28.2 +- 0.42 | 1612.73 +- 518.31 | 47.0 +- 6.58 | 45.6 +- 4.97 | -97.09 +- 1.02 | -2.98 +- 17.22 | | 64b-2t1c-avf-ethip4-ip4base | 28.7 +- 0.48 | 1607.64 +- 517.94 | 44.1 +- 4.79 | 42.5 +- 1.58 | -97.26 +- 0.93 | -3.63 +- 11.07 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 84.7 +- 1.57 | 1747.73 +- 518.69 | 186.0 +- 5.96 | 179.0 +- 3.56 | -89.36 +- 3.18 | -3.76 +- 3.63 | | 64b-2t1c-avf-eth-l2xcbase | 26.8 +- 0.63 | 1605.45 +- 518.21 | 41.5 +- 1.27 | 39.8 +- 2.57 | -97.42 +- 0.84 | -4.1 +- 6.86 | | 78b-2t1c-avf-ethip6-ip6scale20k | 29.6 +- 0.52 | 2095.09 +- 678.28 | 49.3 +- 2.58 | 47.0 +- 0.82 | -97.65 +- 0.77 | -4.67 +- 5.26 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 129.4 +- 8.3 | 1699.0 +- 520.75 | 130.3 +- 8.29 | 123.5 +- 4.12 | -92.33 +- 2.4 | -5.22 +- 6.81 | | 78b-2t1c-ethip6-ip6base | 27.2 +- 0.63 | 2089.18 +- 676.99 | 46.6 +- 4.06 | 44.1 +- 0.74 | -97.77 +- 0.75 | -5.36 +- 8.4 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 30.5 +- 0.71 | 2090.27 +- 678.01 | 47.8 +- 0.79 | 45.2 +- 1.75 | -97.71 +- 0.74 | -5.44 +- 3.98 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 91.3 +- 1.7 | 1771.45 +- 518.88 | 209.6 +- 14.1 | 194.5 +- 3.81 | -88.17 +- 3.56 | -7.2 +- 6.5 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 83.9 +- 3.45 | 1669.0 +- 516.76 | 104.7 +- 6.72 | 96.6 +- 5.6 | -93.73 +- 1.98 | -7.74 +- 7.98 | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 29.0 +- 1.41 | 1629.91 +- 515.73 | 66.0 +- 5.54 | 58.0 +- 3.02 | -95.95 +- 1.33 | -12.12 +- 8.68 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 27.9 +- 0.57 | 1622.18 +- 519.13 | 59.0 +- 1.56 | 51.3 +- 0.67 | -96.36 +- 1.17 | -13.05 +- 2.57 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 88.3 +- 1.57 | 1781.09 +- 518.46 | 215.0 +- 10.11 | 178.2 +- 3.52 | -87.93 +- 3.56 | -17.12 +- 4.23 | | 64b-2t1c-ethip4-ip4base | 26.8 +- 0.63 | 1628.27 +- 517.22 | 68.6 +- 4.95 | 49.6 +- 4.17 | -95.79 +- 1.37 | -27.7 +- 8.01 | +--------------------------------------------------------------+---------------+-------------------+----------------+----------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "7" for CSIT rls2106, "8" for CSIT rls2110). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2106.0-8 vs 2106.0-7: Compares CSIT environment current vs previous with previous VPP code. 2110.0-8 vs 2106.0-8: Compares VPP code current vs previous in the current CSIT environment.