+--------------------------------------------------------------+---------------+-------------------+---------------+---------------+----------------------+----------------------+ | Test Case | 2101.0-7 | 2106.0-7 | 2106.0-8 | 2110.0-8 | 2106.0-8 vs 2106.0-7 | 2110.0-8 vs 2106.0-8 | +--------------------------------------------------------------+---------------+-------------------+---------------+---------------+----------------------+----------------------+ | 78b-2t1c-ethip6-ip6base | 19.3 +- 1.06 | 2063.91 +- 677.56 | 21.6 +- 0.84 | 23.7 +- 1.89 | -98.95 +- 0.35 | +9.72 +- 9.74 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 21.5 +- 2.27 | 1590.0 +- 518.39 | 30.5 +- 2.17 | 33.0 +- 4.52 | -98.08 +- 0.64 | +8.2 +- 16.71 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 23.2 +- 6.01 | 1589.36 +- 512.87 | 29.4 +- 2.72 | 31.6 +- 4.53 | -98.15 +- 0.62 | +7.48 +- 18.32 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 19.7 +- 0.82 | 1590.64 +- 517.27 | 28.5 +- 3.63 | 30.6 +- 2.37 | -98.21 +- 0.63 | +7.37 +- 15.99 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 21.4 +- 1.26 | 2067.18 +- 676.65 | 26.2 +- 2.25 | 28.1 +- 2.38 | -98.73 +- 0.43 | +7.25 +- 12.93 | | 64b-2t1c-ethip4-ip4scale20k | 19.0 +- 0.82 | 1585.0 +- 517.73 | 22.0 +- 3.46 | 23.5 +- 1.65 | -98.61 +- 0.5 | +6.82 +- 18.42 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 37.5 +- 2.32 | 1613.64 +- 519.27 | 48.4 +- 2.17 | 51.3 +- 1.83 | -97.0 +- 0.97 | +5.99 +- 6.07 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 17.7 +- 0.48 | 1585.0 +- 518.72 | 21.9 +- 1.91 | 23.1 +- 0.88 | -98.62 +- 0.47 | +5.48 +- 10.04 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 34.1 +- 2.81 | 1614.36 +- 517.85 | 52.3 +- 1.49 | 54.2 +- 1.93 | -96.76 +- 1.04 | +3.63 +- 4.73 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 34.0 +- 1.25 | 1614.45 +- 521.21 | 47.6 +- 2.91 | 49.3 +- 2.21 | -97.05 +- 0.97 | +3.57 +- 7.86 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 53.2 +- 4.39 | 1635.09 +- 516.44 | 67.7 +- 2.58 | 69.9 +- 3.54 | -95.86 +- 1.32 | +3.25 +- 6.55 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 35.4 +- 1.51 | 1608.64 +- 518.61 | 43.2 +- 1.48 | 44.6 +- 1.9 | -97.31 +- 0.87 | +3.24 +- 5.63 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 19.4 +- 0.52 | 1587.64 +- 518.6 | 25.9 +- 0.74 | 26.5 +- 1.43 | -98.37 +- 0.53 | +2.32 +- 6.26 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 45.6 +- 4.14 | 1612.64 +- 518.93 | 44.3 +- 2.54 | 45.2 +- 2.39 | -97.25 +- 0.9 | +2.03 +- 7.97 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 19.3 +- 0.48 | 1588.09 +- 518.42 | 25.4 +- 1.71 | 25.9 +- 1.66 | -98.4 +- 0.53 | +1.97 +- 9.5 | | 64b-2t1c-avf-eth-l2xcbase | 16.9 +- 0.32 | 1585.0 +- 518.72 | 21.4 +- 0.52 | 21.7 +- 1.06 | -98.65 +- 0.44 | +1.4 +- 5.52 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 38.3 +- 2.31 | 1609.27 +- 519.81 | 45.3 +- 1.64 | 45.9 +- 2.18 | -97.19 +- 0.91 | +1.32 +- 6.05 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 17.9 +- 0.57 | 1586.36 +- 518.51 | 23.3 +- 0.95 | 23.6 +- 2.27 | -98.53 +- 0.48 | +1.29 +- 10.58 | | 64b-2t1c-eth-l2xcbase | 16.9 +- 0.32 | 1583.73 +- 518.97 | 20.1 +- 0.32 | 20.3 +- 0.82 | -98.73 +- 0.42 | +1.0 +- 4.39 | | 64b-2t1c-eth-l2bdbasemaclrn | 18.7 +- 1.06 | 1585.73 +- 517.64 | 22.4 +- 0.7 | 22.6 +- 0.84 | -98.59 +- 0.46 | +0.89 +- 4.91 | | 64b-2t1c-avf-ethip4-ip4scale20k | 17.4 +- 0.84 | 1583.91 +- 518.36 | 22.6 +- 0.97 | 22.8 +- 0.79 | -98.57 +- 0.47 | +0.88 +- 5.55 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 18.4 +- 0.52 | 1587.36 +- 518.18 | 24.9 +- 1.2 | 25.1 +- 0.74 | -98.43 +- 0.52 | +0.8 +- 5.68 | | 78b-2t1c-avf-ethip6-ip6scale20k | 17.8 +- 0.42 | 2064.73 +- 677.5 | 22.8 +- 0.92 | 22.9 +- 1.2 | -98.9 +- 0.37 | +0.44 +- 6.63 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 17.9 +- 0.88 | 2065.0 +- 677.92 | 23.1 +- 0.99 | 23.2 +- 1.48 | -98.88 +- 0.37 | +0.43 +- 7.71 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 20.7 +- 3.37 | 1591.27 +- 514.5 | 31.4 +- 2.95 | 31.4 +- 3.92 | -98.03 +- 0.66 | +0.0 +- 15.63 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 20.8 +- 1.03 | 1588.27 +- 518.48 | 25.3 +- 0.67 | 25.2 +- 0.79 | -98.41 +- 0.52 | -0.4 +- 4.1 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 42.3 +- 4.14 | 1618.82 +- 514.69 | 60.6 +- 5.74 | 60.2 +- 7.8 | -96.26 +- 1.24 | -0.66 +- 15.94 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 19.3 +- 0.95 | 1586.73 +- 518.3 | 22.4 +- 0.97 | 22.2 +- 1.03 | -98.59 +- 0.47 | -0.89 +- 6.29 | | 64b-2t1c-avf-ethip4-ip4base | 17.3 +- 0.48 | 1584.91 +- 518.36 | 22.1 +- 0.99 | 21.9 +- 0.32 | -98.61 +- 0.46 | -0.9 +- 4.68 | | 64b-2t1c-ethip4-ip4base | 18.8 +- 1.03 | 1584.36 +- 518.18 | 21.6 +- 0.97 | 21.4 +- 0.84 | -98.64 +- 0.45 | -0.93 +- 5.91 | | 64b-2t1c-avf-eth-l2patch | 14.7 +- 0.48 | 1579.91 +- 518.36 | 17.2 +- 0.92 | 16.9 +- 0.88 | -98.91 +- 0.36 | -1.74 +- 7.31 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 37.6 +- 3.86 | 1607.45 +- 517.56 | 46.9 +- 4.65 | 46.0 +- 3.46 | -97.08 +- 0.98 | -1.92 +- 12.22 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 19.7 +- 1.16 | 1590.0 +- 518.4 | 28.1 +- 3.0 | 27.5 +- 1.58 | -98.23 +- 0.61 | -2.14 +- 11.86 | | 78b-2t1c-ethip6-ip6scale20k | 19.5 +- 0.71 | 2066.82 +- 676.53 | 26.3 +- 3.37 | 25.6 +- 4.65 | -98.73 +- 0.45 | -2.66 +- 21.63 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 17.8 +- 1.48 | 1585.09 +- 518.42 | 23.2 +- 0.79 | 22.5 +- 0.85 | -98.54 +- 0.48 | -3.02 +- 4.93 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 17.4 +- 1.9 | 1589.09 +- 518.42 | 25.4 +- 1.35 | 24.5 +- 0.71 | -98.4 +- 0.53 | -3.54 +- 5.83 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 47.6 +- 3.78 | 1628.0 +- 518.45 | 70.1 +- 11.57 | 67.2 +- 11.33 | -95.69 +- 1.54 | -4.14 +- 22.62 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 40.1 +- 3.73 | 1611.36 +- 518.85 | 46.1 +- 2.38 | 44.0 +- 2.4 | -97.14 +- 0.93 | -4.56 +- 7.17 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 42.5 +- 4.25 | 1617.18 +- 520.78 | 53.2 +- 4.49 | 50.5 +- 2.42 | -96.71 +- 1.1 | -5.08 +- 9.21 | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 22.57 +- 4.31 | 1593.0 +- 516.74 | 34.0 +- 4.55 | 32.2 +- 2.53 | -97.87 +- 0.75 | -5.29 +- 14.69 | | 64b-2t1c-eth-l2patch | 15.0 +- 0.0 | 1580.55 +- 518.58 | 17.8 +- 0.63 | 16.8 +- 1.4 | -98.87 +- 0.37 | -5.62 +- 8.54 | | 78b-2t1c-avf-ethip6-ip6base | 16.5 +- 1.27 | 2064.45 +- 677.74 | 22.2 +- 2.15 | 20.5 +- 0.85 | -98.92 +- 0.37 | -7.66 +- 9.73 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 18.8 +- 0.42 | 1585.36 +- 518.18 | 23.2 +- 1.4 | 19.9 +- 1.29 | -98.54 +- 0.49 | -14.22 +- 7.58 | +--------------------------------------------------------------+---------------+-------------------+---------------+---------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "7" for CSIT rls2106, "8" for CSIT rls2110). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2106.0-8 vs 2106.0-7: Compares CSIT environment current vs previous with previous VPP code. 2110.0-8 vs 2106.0-8: Compares VPP code current vs previous in the current CSIT environment.