+--------------------------------------------------------------+----------------+-------------------+----------------+----------------+----------------------+----------------------+ | Test Case | 2101.0-7 | 2106.0-7 | 2106.0-8 | 2110.0-8 | 2106.0-8 vs 2106.0-7 | 2110.0-8 vs 2106.0-8 | +--------------------------------------------------------------+----------------+-------------------+----------------+----------------+----------------------+----------------------+ | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 61.7 +- 2.36 | 1628.45 +- 517.88 | 66.6 +- 1.35 | 85.0 +- 1.15 | -95.91 +- 1.3 | +27.63 +- 3.11 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k | NT | 1635.64 +- 522.55 | 16.6 +- 0.97 | 20.0 +- 5.77 | -98.99 +- 0.33 | +20.48 +- 35.48 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 37.5 +- 2.37 | 1613.45 +- 515.65 | 51.6 +- 7.04 | 59.3 +- 4.55 | -96.8 +- 1.11 | +14.92 +- 17.99 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 30.3 +- 1.25 | 2084.73 +- 677.83 | 41.6 +- 2.99 | 46.3 +- 1.06 | -98.0 +- 0.66 | +11.3 +- 8.39 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 120.7 +- 13.04 | 1772.8 +- 540.79 | 210.9 +- 28.82 | 228.0 +- 18.23 | -88.1 +- 3.98 | +8.11 +- 17.12 | | 78b-2t1c-ethip6-ip6base | 27.0 +- 0.47 | 2082.91 +- 677.23 | 38.8 +- 1.14 | 41.3 +- 2.0 | -98.14 +- 0.61 | +6.44 +- 6.03 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 36.3 +- 4.52 | 1614.27 +- 518.15 | 50.8 +- 1.55 | 53.9 +- 3.51 | -96.85 +- 1.01 | +6.1 +- 7.63 | | 64b-2t1c-eth-l2xcbase | 25.5 +- 0.53 | 1601.09 +- 518.43 | 37.8 +- 2.53 | 39.0 +- 1.49 | -97.64 +- 0.78 | +3.17 +- 7.95 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 40.3 +- 0.82 | 1614.91 +- 518.69 | 51.3 +- 0.67 | 52.9 +- 1.1 | -96.82 +- 1.02 | +3.12 +- 2.54 | | 78b-2t1c-ethip6-ip6scale20k | 31.3 +- 1.16 | 2081.36 +- 678.37 | 39.5 +- 2.32 | 40.6 +- 1.58 | -98.1 +- 0.63 | +2.78 +- 7.24 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 45.1 +- 6.57 | 1603.55 +- 516.91 | 43.6 +- 2.27 | 44.6 +- 1.71 | -97.28 +- 0.89 | +2.29 +- 6.62 | | 64b-2t1c-avf-eth-l2xcbase | 23.8 +- 0.79 | 1594.27 +- 518.48 | 31.3 +- 0.48 | 32.0 +- 0.47 | -98.04 +- 0.64 | +2.24 +- 2.18 | | 64b-2t1c-ethip4-ip4scale2m | 33.7 +- 1.34 | 1610.27 +- 518.88 | 44.7 +- 5.1 | 45.3 +- 3.83 | -97.22 +- 0.95 | +1.34 +- 14.39 | | 78b-2t1c-ethip6-ip6scale200k | 32.7 +- 2.58 | 2086.45 +- 678.07 | 44.7 +- 2.0 | 45.3 +- 2.41 | -97.86 +- 0.7 | +1.34 +- 7.04 | | 64b-2t1c-avf-ethip4-ip4scale200k | 28.4 +- 0.84 | 1608.18 +- 518.46 | 45.0 +- 2.49 | 45.5 +- 2.42 | -97.2 +- 0.92 | +1.11 +- 7.76 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 38.3 +- 1.77 | 1610.09 +- 517.76 | 48.0 +- 0.82 | 48.5 +- 1.84 | -97.02 +- 0.96 | +1.04 +- 4.2 | | 64b-2t1c-avf-ethip4-ip4scale20k | 27.8 +- 0.92 | 1608.18 +- 517.8 | 43.8 +- 2.2 | 44.1 +- 3.38 | -97.28 +- 0.89 | +0.68 +- 9.23 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k | NT | 2035.75 +- 805.19 | 17.2 +- 1.4 | 17.3 +- 2.21 | -99.16 +- 0.34 | +0.58 +- 15.25 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 82.9 +- 2.08 | 1686.91 +- 519.02 | 121.2 +- 3.01 | 121.6 +- 3.63 | -92.82 +- 2.22 | +0.33 +- 3.89 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 33.2 +- 0.63 | 1606.64 +- 518.61 | 44.1 +- 1.2 | 44.2 +- 1.93 | -97.26 +- 0.89 | +0.23 +- 5.16 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 90.2 +- 3.77 | 1750.18 +- 518.18 | 181.0 +- 9.99 | 181.1 +- 7.09 | -89.66 +- 3.11 | +0.06 +- 6.77 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k-rnd | NT | 1594.78 +- 572.4 | 17.3 +- 1.95 | 17.3 +- 2.41 | -98.92 +- 0.41 | +0.0 +- 17.89 | | 64b-2t1c-ethip4-ip4scale200k-rnd | 32.3 +- 1.34 | 1611.27 +- 517.16 | 47.7 +- 1.16 | 47.7 +- 2.31 | -97.04 +- 0.95 | +0.0 +- 5.42 | | 78b-2t1c-ethip6-ip6scale200k-rnd | 33.8 +- 4.18 | 2092.18 +- 677.32 | 49.0 +- 2.4 | 48.9 +- 2.02 | -97.66 +- 0.77 | -0.2 +- 6.41 | | 78b-2t1c-ethip6-ip6scale2m | 31.6 +- 1.07 | 2083.09 +- 679.28 | 40.9 +- 3.07 | 40.8 +- 2.2 | -98.04 +- 0.66 | -0.24 +- 9.22 | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 27.0 +- 1.05 | 1603.45 +- 518.87 | 40.1 +- 0.99 | 40.0 +- 1.56 | -97.5 +- 0.81 | -0.25 +- 4.62 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 81.9 +- 1.29 | 1719.0 +- 517.09 | 159.7 +- 4.08 | 159.3 +- 3.74 | -90.71 +- 2.8 | -0.25 +- 3.46 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 25.5 +- 0.53 | 1601.27 +- 518.15 | 37.4 +- 0.52 | 37.2 +- 1.32 | -97.66 +- 0.76 | -0.53 +- 3.78 | | 64b-2t1c-af-xdp-ethip4-ip4base | NT | 1805.6 +- 40.81 | 18.2 +- 2.66 | 18.1 +- 2.13 | -98.99 +- 0.15 | -0.55 +- 18.66 | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 29.3 +- 1.57 | 1603.36 +- 518.18 | 39.9 +- 1.1 | 39.6 +- 1.26 | -97.51 +- 0.81 | -0.75 +- 4.19 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 122.5 +- 17.86 | 1751.45 +- 520.54 | 181.3 +- 5.1 | 179.9 +- 3.07 | -89.65 +- 3.09 | -0.77 +- 3.27 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 101.0 +- 3.56 | 1718.0 +- 518.08 | 156.1 +- 4.75 | 154.7 +- 5.79 | -90.91 +- 2.75 | -0.9 +- 4.78 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 41.8 +- 0.79 | 1613.64 +- 518.6 | 50.7 +- 0.95 | 50.2 +- 1.32 | -96.86 +- 1.01 | -0.99 +- 3.19 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 94.2 +- 3.97 | 1719.55 +- 517.25 | 157.1 +- 3.03 | 155.4 +- 2.91 | -90.86 +- 2.75 | -1.08 +- 2.66 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k-rnd | NT | 2094.9 +- 711.88 | 17.8 +- 2.35 | 17.6 +- 1.71 | -99.15 +- 0.31 | -1.12 +- 16.21 | | 78b-2t1c-ethip6-ip6scale2m-rnd | 39.6 +- 1.43 | 2092.09 +- 677.95 | 48.9 +- 1.29 | 48.3 +- 1.34 | -97.66 +- 0.76 | -1.23 +- 3.77 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 31.2 +- 1.32 | 1604.0 +- 517.73 | 39.9 +- 2.18 | 39.4 +- 2.46 | -97.51 +- 0.81 | -1.25 +- 8.2 | | 78b-2t1c-avf-ethip6-ip6scale20k | 30.3 +- 0.82 | 2083.09 +- 678.28 | 39.3 +- 1.25 | 38.8 +- 1.03 | -98.11 +- 0.62 | -1.27 +- 4.1 | | 64b-2t1c-ethip4-ip4scale2m-rnd | 31.7 +- 1.49 | 1605.0 +- 518.72 | 41.4 +- 1.26 | 40.8 +- 0.92 | -97.42 +- 0.84 | -1.45 +- 3.74 | | 64b-2t1c-avf-eth-l2patch | 15.8 +- 0.42 | 1582.09 +- 518.09 | 18.7 +- 0.95 | 18.4 +- 0.7 | -98.82 +- 0.39 | -1.6 +- 6.24 | | 64b-2t1c-eth-l2bdscale1mmaclrn | 39.3 +- 5.58 | 1618.45 +- 518.55 | 56.7 +- 1.64 | 55.7 +- 2.54 | -96.5 +- 1.13 | -1.76 +- 5.3 | | 64b-2t1c-avf-ethip4-ip4base | 28.5 +- 1.43 | 1604.18 +- 519.12 | 39.1 +- 0.88 | 38.3 +- 1.16 | -97.56 +- 0.79 | -2.05 +- 3.69 | | 64b-2t1c-eth-l2patch | 22.3 +- 0.67 | 1592.45 +- 519.21 | 29.2 +- 0.92 | 28.6 +- 1.26 | -98.17 +- 0.6 | -2.05 +- 5.32 | | 78b-2t1c-avf-ethip6-ip6base | 26.3 +- 0.48 | 2081.55 +- 677.77 | 38.6 +- 1.17 | 37.8 +- 1.23 | -98.15 +- 0.61 | -2.07 +- 4.36 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 33.6 +- 1.96 | 1605.82 +- 513.05 | 50.5 +- 6.55 | 49.4 +- 2.84 | -96.86 +- 1.08 | -2.18 +- 13.88 | | 64b-2t1c-ethip4-ip4scale20k | 30.8 +- 1.23 | 1601.73 +- 518.96 | 39.2 +- 1.48 | 38.3 +- 1.57 | -97.55 +- 0.8 | -2.3 +- 5.43 | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 35.89 +- 2.42 | 1609.55 +- 518.57 | 46.1 +- 1.29 | 45.0 +- 1.05 | -97.14 +- 0.93 | -2.39 +- 3.56 | | 64b-2t1c-ethip4-ip4base | 28.5 +- 0.85 | 1608.91 +- 520.39 | 43.1 +- 4.84 | 41.8 +- 5.57 | -97.32 +- 0.92 | -3.02 +- 16.91 | | 78b-2t1c-avf-ethip6-ip6scale200k | 30.3 +- 1.34 | 2086.27 +- 678.35 | 41.5 +- 2.37 | 40.2 +- 1.32 | -98.01 +- 0.66 | -3.13 +- 6.37 | | 64b-2t1c-ethip4-ip4scale200k | 31.3 +- 1.34 | 1603.55 +- 518.57 | 40.8 +- 1.14 | 39.4 +- 1.71 | -97.46 +- 0.83 | -3.43 +- 4.98 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 30.9 +- 1.29 | 2083.64 +- 677.47 | 40.9 +- 1.29 | 39.4 +- 1.43 | -98.04 +- 0.64 | -3.67 +- 4.63 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 35.7 +- 1.83 | 1612.18 +- 518.45 | 49.5 +- 1.27 | 47.5 +- 0.97 | -96.93 +- 0.99 | -4.04 +- 3.15 | | 78b-2t1c-avf-ethip6-ip6scale2m | 33.0 +- 2.62 | 2083.45 +- 676.43 | 41.9 +- 2.08 | 40.2 +- 3.33 | -97.99 +- 0.66 | -4.06 +- 9.26 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 38.9 +- 0.57 | 1613.91 +- 518.7 | 50.9 +- 0.88 | 48.8 +- 0.92 | -96.85 +- 1.02 | -4.13 +- 2.45 | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 31.8 +- 2.53 | 2089.82 +- 678.19 | 46.2 +- 1.14 | 44.2 +- 1.75 | -97.79 +- 0.72 | -4.33 +- 4.46 | | 78b-2t1c-af-xdp-ethip6-ip6base | NT | 2066.56 +- 750.58 | 20.5 +- 5.58 | 19.5 +- 2.84 | -99.01 +- 0.45 | -4.88 +- 29.37 | | 64b-2t1c-avf-ethip4-ip4scale2m | 29.8 +- 0.79 | 1618.55 +- 521.03 | 49.9 +- 12.63 | 47.2 +- 5.31 | -96.92 +- 1.26 | -5.41 +- 26.19 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 41.3 +- 1.34 | 1601.91 +- 517.7 | 42.7 +- 3.59 | 40.0 +- 1.49 | -97.33 +- 0.89 | -6.32 +- 8.62 | | 64b-2t1c-eth-l2bdbasemaclrn | 33.0 +- 0.67 | 1607.0 +- 517.4 | 45.8 +- 4.71 | 42.7 +- 3.09 | -97.15 +- 0.96 | -6.77 +- 11.73 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 74.9 +- 1.97 | 1657.64 +- 517.97 | 97.6 +- 4.58 | 89.4 +- 3.2 | -94.11 +- 1.86 | -8.4 +- 5.41 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 27.4 +- 0.84 | 1606.0 +- 519.05 | 43.2 +- 2.3 | 38.7 +- 1.34 | -97.31 +- 0.88 | -10.42 +- 5.69 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 28.8 +- 2.25 | 1611.45 +- 510.99 | 54.9 +- 14.76 | 47.5 +- 4.72 | -96.59 +- 1.42 | -13.48 +- 24.8 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 82.1 +- 3.6 | 1741.0 +- 510.55 | 169.9 +- 24.93 | 146.7 +- 17.37 | -90.24 +- 3.2 | -13.66 +- 16.28 | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 34.1 +- 1.79 | 2097.91 +- 677.23 | 55.6 +- 2.32 | 47.4 +- 1.07 | -97.35 +- 0.86 | -14.75 +- 4.05 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 66.1 +- 1.29 | 1684.73 +- 520.69 | 123.8 +- 7.97 | 105.5 +- 1.96 | -92.65 +- 2.32 | -14.78 +- 5.71 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 101.7 +- 3.3 | 1801.36 +- 505.89 | 264.4 +- 67.02 | 214.7 +- 36.01 | -85.32 +- 5.55 | -18.8 +- 24.68 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 104.4 +- 1.71 | 1795.82 +- 518.82 | 238.1 +- 58.08 | 190.5 +- 20.72 | -86.74 +- 5.01 | -19.99 +- 21.37 | +--------------------------------------------------------------+----------------+-------------------+----------------+----------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "7" for CSIT rls2106, "8" for CSIT rls2110). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2106.0-8 vs 2106.0-7: Compares CSIT environment current vs previous with previous VPP code. 2110.0-8 vs 2106.0-8: Compares VPP code current vs previous in the current CSIT environment.