+--------------------------------------------------------------+---------------+-------------------+--------------+--------------+----------------------+----------------------+ | Test Case | 2101.0-7 | 2106.0-7 | 2106.0-8 | 2110.0-8 | 2106.0-8 vs 2106.0-7 | 2110.0-8 vs 2106.0-8 | +--------------------------------------------------------------+---------------+-------------------+--------------+--------------+----------------------+----------------------+ | 78b-2t1c-ethip6-ip6scale200k-rnd | 20.9 +- 1.52 | 2064.73 +- 677.83 | 23.4 +- 3.2 | 26.1 +- 3.28 | -98.87 +- 0.4 | +11.54 +- 20.73 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 17.9 +- 0.74 | 1583.64 +- 518.6 | 20.3 +- 1.77 | 21.6 +- 1.96 | -98.72 +- 0.43 | +6.4 +- 13.36 | | 78b-2t1c-ethip6-ip6scale200k | 20.7 +- 2.06 | 2064.73 +- 676.84 | 23.5 +- 1.72 | 24.9 +- 3.35 | -98.86 +- 0.38 | +5.96 +- 16.21 | | 64b-2t1c-eth-l2bdbasemaclrn | 16.9 +- 1.29 | 1582.82 +- 518.33 | 20.3 +- 1.42 | 21.5 +- 1.08 | -98.72 +- 0.43 | +5.91 +- 9.11 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 21.5 +- 2.42 | 1590.73 +- 516.31 | 30.8 +- 4.47 | 32.5 +- 4.4 | -98.06 +- 0.69 | +5.52 +- 20.94 | | 78b-2t1c-avf-ethip6-ip6scale20k | 16.8 +- 0.42 | 2063.73 +- 677.83 | 21.9 +- 1.45 | 23.1 +- 1.66 | -98.94 +- 0.36 | +5.48 +- 10.32 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 18.5 +- 0.85 | 1587.0 +- 517.4 | 23.9 +- 0.88 | 25.1 +- 2.02 | -98.49 +- 0.49 | +5.02 +- 9.3 | | 64b-2t1c-ethip4-ip4scale2m-rnd | 20.1 +- 1.37 | 1583.0 +- 517.73 | 20.7 +- 0.95 | 21.7 +- 1.42 | -98.69 +- 0.43 | +4.83 +- 8.37 | | 64b-2t1c-eth-l2bdscale1mmaclrn | 20.3 +- 1.34 | 1586.45 +- 518.88 | 22.0 +- 0.67 | 22.8 +- 0.92 | -98.61 +- 0.46 | +3.64 +- 5.23 | | 64b-2t1c-af-xdp-ethip4-ip4base | NT | 1760.8 +- 3.05 | 15.1 +- 0.57 | 15.6 +- 1.35 | -99.14 +- 0.03 | +3.31 +- 9.75 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k | NT | 2013.88 +- 793.53 | 15.1 +- 0.32 | 15.6 +- 0.7 | -99.25 +- 0.3 | +3.31 +- 5.11 | | 64b-2t1c-avf-ethip4-ip4scale200k | 16.5 +- 0.71 | 1581.73 +- 517.97 | 19.2 +- 0.79 | 19.8 +- 0.79 | -98.79 +- 0.4 | +3.12 +- 5.9 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 35.7 +- 2.71 | 1599.27 +- 518.48 | 36.1 +- 0.74 | 37.2 +- 0.92 | -97.74 +- 0.73 | +3.05 +- 3.3 | | 64b-2t1c-ethip4-ip4scale2m | 18.9 +- 1.37 | 1583.09 +- 518.09 | 19.9 +- 2.64 | 20.5 +- 1.18 | -98.74 +- 0.44 | +3.02 +- 14.91 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 18.7 +- 1.49 | 1585.18 +- 517.46 | 21.2 +- 1.23 | 21.8 +- 1.81 | -98.66 +- 0.44 | +2.83 +- 10.43 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 19.9 +- 3.45 | 1588.18 +- 516.8 | 26.3 +- 4.37 | 27.0 +- 4.97 | -98.34 +- 0.61 | +2.66 +- 25.46 | | 78b-2t1c-af-xdp-ethip6-ip6base | NT | 2039.67 +- 748.75 | 15.3 +- 0.82 | 15.7 +- 1.16 | -99.25 +- 0.28 | +2.61 +- 9.38 | | 64b-2t1c-ethip4-ip4scale200k | 17.6 +- 1.17 | 1582.64 +- 518.27 | 20.0 +- 0.82 | 20.5 +- 1.18 | -98.74 +- 0.42 | +2.5 +- 7.23 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 17.2 +- 0.42 | 1585.09 +- 517.43 | 21.9 +- 1.66 | 22.4 +- 2.01 | -98.62 +- 0.46 | +2.28 +- 12.03 | | 64b-2t1c-eth-l2xcbase | 15.7 +- 0.48 | 1580.27 +- 518.15 | 17.9 +- 0.57 | 18.3 +- 0.95 | -98.87 +- 0.37 | +2.23 +- 6.21 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 41.9 +- 5.11 | 1595.7 +- 544.16 | 45.1 +- 2.02 | 46.0 +- 2.11 | -97.17 +- 0.97 | +2.0 +- 6.54 | | 64b-2t1c-eth-l2patch | 13.9 +- 0.32 | 1578.09 +- 517.76 | 15.9 +- 0.99 | 16.2 +- 0.63 | -98.99 +- 0.34 | +1.89 +- 7.51 | | 78b-2t1c-ethip6-ip6scale2m | 21.8 +- 1.62 | 2064.27 +- 677.35 | 22.5 +- 1.96 | 22.9 +- 1.79 | -98.91 +- 0.37 | +1.78 +- 11.91 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 40.3 +- 6.62 | 1610.0 +- 519.39 | 46.3 +- 2.83 | 47.1 +- 4.46 | -97.12 +- 0.94 | +1.73 +- 11.46 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 19.8 +- 1.14 | 1590.55 +- 517.91 | 30.0 +- 2.45 | 30.5 +- 4.6 | -98.11 +- 0.63 | +1.67 +- 17.44 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 16.1 +- 0.57 | 1582.64 +- 518.27 | 19.7 +- 0.95 | 20.0 +- 0.82 | -98.76 +- 0.41 | +1.52 +- 6.41 | | 78b-2t1c-avf-ethip6-ip6base | 16.6 +- 0.7 | 2063.0 +- 676.92 | 22.4 +- 2.07 | 22.7 +- 1.77 | -98.91 +- 0.37 | +1.34 +- 12.23 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k-rnd | NT | 2071.8 +- 711.09 | 15.3 +- 0.48 | 15.5 +- 0.85 | -99.26 +- 0.25 | +1.31 +- 6.41 | | 78b-2t1c-avf-ethip6-ip6scale200k | 17.1 +- 1.97 | 2064.0 +- 677.26 | 23.1 +- 2.69 | 23.4 +- 2.37 | -98.88 +- 0.39 | +1.3 +- 15.61 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 39.6 +- 3.86 | 1605.0 +- 517.4 | 41.6 +- 1.07 | 42.0 +- 2.4 | -97.41 +- 0.84 | +0.96 +- 6.34 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 16.7 +- 0.82 | 2062.64 +- 677.47 | 21.6 +- 1.43 | 21.7 +- 1.77 | -98.95 +- 0.35 | +0.46 +- 10.54 | | 78b-2t1c-ethip6-ip6scale2m-rnd | 23.2 +- 1.62 | 2066.18 +- 677.65 | 23.3 +- 1.64 | 23.4 +- 1.58 | -98.87 +- 0.38 | +0.43 +- 9.78 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k-rnd | NT | 1572.33 +- 574.26 | 15.4 +- 0.7 | 15.4 +- 0.52 | -99.02 +- 0.36 | +0.0 +- 5.64 | | 64b-2t1c-avf-eth-l2xcbase | 14.9 +- 0.32 | 1581.18 +- 518.12 | 18.7 +- 0.67 | 18.7 +- 0.95 | -98.82 +- 0.39 | +0.0 +- 6.23 | | 64b-2t1c-ethip4-ip4base | 17.4 +- 1.17 | 1582.18 +- 518.12 | 19.7 +- 1.64 | 19.7 +- 1.25 | -98.75 +- 0.42 | +0.0 +- 10.46 | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 17.2 +- 1.14 | 2063.91 +- 676.56 | 23.7 +- 0.95 | 23.7 +- 2.06 | -98.85 +- 0.38 | +0.0 +- 9.56 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 18.3 +- 0.48 | 1585.64 +- 518.28 | 23.2 +- 1.4 | 23.1 +- 1.6 | -98.54 +- 0.49 | -0.43 +- 9.13 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 40.6 +- 4.06 | 1605.36 +- 518.84 | 41.4 +- 1.96 | 41.1 +- 1.73 | -97.42 +- 0.84 | -0.72 +- 6.28 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 19.0 +- 1.41 | 2062.55 +- 676.78 | 21.8 +- 1.4 | 21.6 +- 1.07 | -98.94 +- 0.35 | -0.92 +- 8.04 | | 78b-2t1c-ethip6-ip6scale20k | 19.0 +- 0.67 | 2062.64 +- 677.14 | 21.4 +- 1.78 | 21.2 +- 1.4 | -98.96 +- 0.35 | -0.93 +- 10.5 | | 64b-2t1c-avf-ethip4-ip4scale20k | 16.3 +- 0.48 | 1581.82 +- 518.33 | 19.5 +- 0.97 | 19.3 +- 0.67 | -98.77 +- 0.41 | -1.03 +- 6.03 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k | NT | 1606.27 +- 518.82 | 15.1 +- 0.88 | 14.9 +- 0.74 | -99.06 +- 0.31 | -1.32 +- 7.52 | | 64b-2t1c-avf-eth-l2patch | 13.2 +- 0.42 | 1577.18 +- 518.12 | 14.8 +- 1.32 | 14.6 +- 0.97 | -99.06 +- 0.32 | -1.35 +- 10.94 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 37.2 +- 3.26 | 1609.27 +- 518.82 | 48.0 +- 4.0 | 47.1 +- 4.95 | -97.02 +- 0.99 | -1.88 +- 13.17 | | 64b-2t1c-ethip4-ip4scale20k | 17.7 +- 0.95 | 1582.55 +- 518.24 | 20.3 +- 1.25 | 19.9 +- 1.45 | -98.72 +- 0.43 | -1.97 +- 9.35 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 41.3 +- 3.68 | 1605.82 +- 519.33 | 43.5 +- 1.08 | 42.6 +- 2.72 | -97.29 +- 0.88 | -2.07 +- 6.7 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 19.0 +- 0.94 | 1589.27 +- 518.15 | 30.4 +- 3.31 | 29.6 +- 2.72 | -98.09 +- 0.66 | -2.63 +- 13.86 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 17.4 +- 0.7 | 1582.64 +- 517.61 | 21.8 +- 1.32 | 21.2 +- 2.94 | -98.62 +- 0.46 | -2.75 +- 14.69 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 15.9 +- 0.74 | 1583.45 +- 518.21 | 21.4 +- 1.51 | 20.8 +- 0.63 | -98.65 +- 0.45 | -2.8 +- 7.45 | | 78b-2t1c-ethip6-ip6base | 18.2 +- 0.92 | 2062.55 +- 677.77 | 21.1 +- 1.45 | 20.5 +- 1.08 | -98.98 +- 0.34 | -2.84 +- 8.41 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 41.8 +- 3.05 | 1605.45 +- 519.21 | 40.0 +- 2.45 | 38.8 +- 2.04 | -97.51 +- 0.82 | -3.0 +- 7.84 | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 27.3 +- 2.5 | 1604.0 +- 517.07 | 41.7 +- 4.99 | 40.4 +- 3.75 | -97.4 +- 0.89 | -3.12 +- 14.67 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 17.1 +- 3.14 | 1590.0 +- 515.08 | 32.3 +- 2.06 | 31.2 +- 2.35 | -97.97 +- 0.67 | -3.41 +- 9.52 | | 78b-2t1c-avf-ethip6-ip6scale2m | 18.0 +- 0.67 | 2065.09 +- 676.95 | 26.3 +- 2.11 | 25.4 +- 2.12 | -98.73 +- 0.43 | -3.42 +- 11.18 | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 18.33 +- 0.87 | 1585.18 +- 518.45 | 23.1 +- 1.79 | 22.1 +- 1.73 | -98.54 +- 0.49 | -4.33 +- 10.54 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 18.9 +- 1.37 | 1583.64 +- 517.94 | 22.6 +- 1.35 | 21.4 +- 1.17 | -98.57 +- 0.47 | -5.31 +- 7.68 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 40.6 +- 4.43 | 1612.82 +- 519.0 | 52.1 +- 4.79 | 49.2 +- 3.74 | -96.77 +- 1.08 | -5.57 +- 11.27 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 18.9 +- 2.88 | 1587.18 +- 517.46 | 25.2 +- 1.62 | 23.6 +- 2.22 | -98.41 +- 0.53 | -6.35 +- 10.67 | | 64b-2t1c-avf-ethip4-ip4base | 16.0 +- 0.67 | 1582.09 +- 518.09 | 20.2 +- 0.92 | 18.8 +- 0.63 | -98.72 +- 0.42 | -6.93 +- 5.27 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 30.0 +- 1.89 | 1599.64 +- 516.95 | 38.9 +- 1.29 | 36.1 +- 2.77 | -97.57 +- 0.79 | -7.2 +- 7.75 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 35.9 +- 3.41 | 1606.36 +- 514.87 | 47.3 +- 5.38 | 43.4 +- 5.02 | -97.06 +- 1.0 | -8.25 +- 14.87 | | 64b-2t1c-avf-ethip4-ip4scale2m | 17.2 +- 0.92 | 1584.36 +- 516.85 | 22.1 +- 2.42 | 20.1 +- 1.66 | -98.61 +- 0.48 | -9.05 +- 12.5 | | 64b-2t1c-ethip4-ip4scale200k-rnd | 18.9 +- 0.99 | 1583.45 +- 518.21 | 22.6 +- 1.84 | 20.5 +- 2.76 | -98.57 +- 0.48 | -9.29 +- 14.26 | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 18.7 +- 5.96 | 2066.82 +- 677.53 | 30.0 +- 5.35 | 25.3 +- 3.65 | -98.55 +- 0.54 | -15.67 +- 19.36 | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 15.5 +- 0.85 | 1583.0 +- 518.06 | 21.6 +- 1.43 | 18.0 +- 2.4 | -98.64 +- 0.46 | -16.67 +- 12.42 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 31.9 +- 6.4 | 1602.0 +- 518.39 | 44.4 +- 6.2 | 36.2 +- 3.12 | -97.23 +- 0.98 | -18.47 +- 13.38 | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 17.3 +- 0.82 | 1584.09 +- 517.76 | 24.7 +- 3.13 | 18.0 +- 2.91 | -98.44 +- 0.55 | -27.13 +- 14.95 | +--------------------------------------------------------------+---------------+-------------------+--------------+--------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "7" for CSIT rls2106, "8" for CSIT rls2110). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2106.0-8 vs 2106.0-7: Compares CSIT environment current vs previous with previous VPP code. 2110.0-8 vs 2106.0-8: Compares VPP code current vs previous in the current CSIT environment.