+--------------------------------------------------------------+----------------+-------------------+-----------------+------------------+----------------------+----------------------+ | Test Case | 2101.0-7 | 2106.0-7 | 2106.0-8 | 2110.0-8 | 2106.0-8 vs 2106.0-7 | 2110.0-8 vs 2106.0-8 | +--------------------------------------------------------------+----------------+-------------------+-----------------+------------------+----------------------+----------------------+ | 64b-2t1c-af-xdp-ethip4-ip4base | NT | 223.11 +- 165.25 | 290.1 +- 299.19 | 547.62 +- 289.25 | +30.02 +- 165.1 | +88.77 +- 218.73 | | 78b-2t1c-ethip6-ip6scale200k-rnd | 163.0 +- 42.75 | 205.55 +- 189.21 | 102.9 +- 25.36 | 172.4 +- 161.68 | -49.94 +- 47.71 | +67.54 +- 162.46 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k | NT | 823.7 +- 1908.66 | 264.4 +- 149.06 | 364.25 +- 205.12 | -67.9 +- 76.55 | +37.76 +- 109.78 | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 79.9 +- 34.1 | 91.0 +- 34.4 | 80.9 +- 11.08 | 100.5 +- 43.29 | -11.1 +- 35.74 | +24.23 +- 56.15 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 142.6 +- 21.95 | 75.82 +- 8.0 | 70.4 +- 3.1 | 83.3 +- 8.17 | -7.15 +- 10.61 | +18.32 +- 12.71 | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 110.8 +- 29.23 | 97.55 +- 14.51 | 93.7 +- 12.26 | 109.8 +- 44.62 | -3.94 +- 19.03 | +17.18 +- 50.02 | | 64b-2t1c-avf-ethip4-ip4scale2m | 92.7 +- 36.57 | 90.82 +- 15.11 | 91.9 +- 14.04 | 103.6 +- 23.21 | +1.19 +- 22.86 | +12.73 +- 30.57 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 123.7 +- 44.87 | 90.91 +- 12.05 | 83.0 +- 7.75 | 91.2 +- 12.24 | -8.7 +- 14.8 | +9.88 +- 17.96 | | 78b-2t1c-ethip6-ip6scale20k | 103.1 +- 41.61 | 66.18 +- 5.78 | 66.1 +- 3.11 | 72.6 +- 8.42 | -0.12 +- 9.9 | +9.83 +- 13.75 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 110.2 +- 46.7 | 77.82 +- 5.02 | 80.3 +- 7.76 | 87.7 +- 10.17 | +3.19 +- 11.99 | +9.22 +- 16.48 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 239.6 +- 13.66 | 223.91 +- 17.42 | 222.7 +- 22.19 | 240.4 +- 52.14 | -0.54 +- 12.57 | +7.95 +- 25.77 | | 78b-2t1c-ethip6-ip6scale2m | 137.6 +- 34.34 | 85.27 +- 9.57 | 80.5 +- 3.78 | 85.5 +- 7.18 | -5.6 +- 11.49 | +6.21 +- 10.22 | | 78b-2t1c-ethip6-ip6base | 98.8 +- 44.26 | 69.55 +- 4.61 | 71.6 +- 4.43 | 74.5 +- 3.5 | +2.95 +- 9.34 | +4.05 +- 8.08 | | 64b-2t1c-ethip4-ip4scale2m-rnd | 119.1 +- 48.48 | 80.55 +- 7.15 | 79.1 +- 5.61 | 82.1 +- 9.53 | -1.79 +- 11.15 | +3.79 +- 14.11 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 75.3 +- 19.56 | 83.64 +- 12.04 | 82.0 +- 6.99 | 84.5 +- 11.47 | -1.96 +- 16.4 | +3.05 +- 16.52 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 117.5 +- 41.95 | 87.45 +- 13.36 | 82.2 +- 11.96 | 84.5 +- 12.68 | -6.01 +- 19.83 | +2.8 +- 21.49 | | 64b-2t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 200.4 +- 31.95 | 336.27 +- 31.83 | 316.2 +- 42.56 | 324.0 +- 41.48 | -5.97 +- 15.47 | +2.47 +- 19.03 | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 88.9 +- 33.02 | 80.45 +- 16.56 | 94.7 +- 46.54 | 96.8 +- 48.22 | +17.71 +- 62.72 | +2.22 +- 71.53 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 195.9 +- 14.88 | 241.73 +- 14.92 | 241.2 +- 13.63 | 245.8 +- 19.89 | -0.22 +- 8.35 | +1.91 +- 10.06 | | 64b-2t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 181.6 +- 30.57 | 172.0 +- 19.29 | 165.8 +- 11.54 | 168.9 +- 5.0 | -3.6 +- 12.72 | +1.87 +- 7.7 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 219.2 +- 28.46 | 315.82 +- 41.09 | 310.3 +- 39.2 | 315.3 +- 26.91 | -1.75 +- 17.82 | +1.61 +- 15.49 | | 64b-2t1c-avf-eth-l2patch | 37.7 +- 10.14 | 40.64 +- 12.01 | 39.2 +- 7.97 | 39.6 +- 8.4 | -3.53 +- 34.61 | +1.02 +- 29.67 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 114.5 +- 37.79 | 91.55 +- 9.96 | 87.4 +- 8.64 | 87.6 +- 12.76 | -4.53 +- 14.04 | +0.23 +- 17.64 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 156.1 +- 42.63 | 182.55 +- 11.06 | 184.2 +- 7.42 | 183.5 +- 6.45 | +0.91 +- 7.34 | -0.38 +- 5.33 | | 64b-2t1c-eth-l2xcbase | 84.2 +- 34.4 | 69.55 +- 3.56 | 70.7 +- 4.81 | 70.2 +- 3.91 | +1.66 +- 8.65 | -0.71 +- 8.73 | | 64b-2t1c-ethip4-ip4scale2m | 115.9 +- 43.76 | 87.55 +- 13.91 | 92.5 +- 14.27 | 91.7 +- 11.54 | +5.66 +- 23.4 | -0.86 +- 19.73 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k-rnd | NT | 377.56 +- 211.77 | 644.1 +- 326.7 | 638.5 +- 342.08 | +70.6 +- 129.01 | -0.87 +- 73.14 | | 64b-2t1c-ethip4-ip4scale20k | 103.7 +- 46.54 | 69.27 +- 6.21 | 71.3 +- 5.96 | 70.6 +- 4.14 | +2.93 +- 12.62 | -0.98 +- 10.12 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 202.7 +- 18.23 | 244.09 +- 5.97 | 247.5 +- 15.83 | 242.5 +- 12.44 | +1.4 +- 6.94 | -2.02 +- 8.03 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 157.9 +- 39.52 | 195.27 +- 9.56 | 187.4 +- 5.4 | 183.5 +- 5.99 | -4.03 +- 5.45 | -2.08 +- 4.26 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 196.6 +- 41.02 | 305.0 +- 57.8 | 270.3 +- 21.28 | 264.2 +- 18.27 | -11.38 +- 18.19 | -2.26 +- 10.24 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 154.2 +- 40.19 | 117.73 +- 5.64 | 122.8 +- 15.67 | 120.0 +- 9.08 | +4.31 +- 14.22 | -2.28 +- 14.5 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 93.8 +- 35.72 | 90.27 +- 13.02 | 88.3 +- 10.67 | 85.9 +- 7.2 | -2.19 +- 18.41 | -2.72 +- 14.31 | | 64b-2t1c-avf-ethip4-ip4base | 77.9 +- 40.88 | 78.64 +- 15.05 | 73.2 +- 10.9 | 71.2 +- 7.38 | -6.91 +- 22.57 | -2.73 +- 17.65 | | 64b-2t1c-ethip4-ip4scale200k-rnd | 104.2 +- 46.94 | 148.18 +- 105.59 | 92.5 +- 6.1 | 89.7 +- 9.72 | -37.58 +- 44.67 | -3.03 +- 12.3 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 197.5 +- 34.36 | 180.18 +- 7.35 | 191.1 +- 32.45 | 184.7 +- 8.58 | +6.06 +- 18.52 | -3.35 +- 17.01 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 106.6 +- 43.64 | 98.18 +- 53.36 | 91.5 +- 11.94 | 88.4 +- 7.07 | -6.81 +- 52.09 | -3.39 +- 14.79 | | 64b-2t1c-eth-l2patch | 79.0 +- 48.65 | 50.55 +- 3.8 | 50.4 +- 2.99 | 48.6 +- 1.84 | -0.29 +- 9.55 | -3.57 +- 6.78 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 180.0 +- 38.94 | 184.55 +- 6.56 | 189.5 +- 8.8 | 182.7 +- 14.23 | +2.68 +- 6.0 | -3.59 +- 8.74 | | 64b-2t1c-eth-l2bdbasemaclrn | 103.2 +- 38.01 | 89.36 +- 6.9 | 86.0 +- 7.36 | 82.3 +- 8.64 | -3.76 +- 11.1 | -4.3 +- 12.97 | | 78b-2t1c-avf-ethip6-ip6scale200k | 108.4 +- 39.01 | 121.36 +- 27.95 | 142.5 +- 93.59 | 136.0 +- 76.81 | +17.42 +- 81.72 | -4.56 +- 82.67 | | 64b-2t1c-avf-ethip4-ip4scale20k | 74.9 +- 30.34 | 77.27 +- 10.79 | 76.9 +- 9.27 | 73.3 +- 8.99 | -0.48 +- 18.36 | -4.68 +- 16.39 | | 64b-2t1c-avf-eth-l2xcbase | 48.0 +- 10.27 | 52.91 +- 6.36 | 57.1 +- 8.9 | 54.0 +- 4.67 | +7.92 +- 21.25 | -5.43 +- 16.85 | | 78b-2t1c-avf-ethip6-ip6base | 91.5 +- 45.9 | 71.09 +- 11.11 | 72.5 +- 9.81 | 68.5 +- 6.08 | +1.98 +- 21.09 | -5.52 +- 15.29 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 150.5 +- 42.25 | 110.18 +- 16.45 | 110.5 +- 10.35 | 101.3 +- 6.43 | +0.29 +- 17.68 | -8.33 +- 10.37 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 111.8 +- 37.31 | 106.0 +- 14.02 | 139.6 +- 105.37 | 127.0 +- 68.6 | +31.7 +- 100.92 | -9.03 +- 84.44 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 83.2 +- 42.19 | 73.27 +- 6.36 | 78.9 +- 6.59 | 71.6 +- 7.04 | +7.68 +- 12.97 | -9.25 +- 11.71 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 250.1 +- 14.55 | 276.27 +- 15.66 | 275.9 +- 14.3 | 249.3 +- 21.86 | -0.13 +- 7.67 | -9.64 +- 9.21 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 80.4 +- 39.36 | 74.64 +- 9.72 | 75.1 +- 10.25 | 66.9 +- 5.17 | +0.62 +- 18.98 | -10.92 +- 13.97 | | 78b-2t1c-ethip6-ip6scale2m-rnd | 170.9 +- 22.6 | 102.36 +- 6.71 | 105.0 +- 8.27 | 92.9 +- 4.53 | +2.58 +- 10.51 | -11.52 +- 8.2 | | 78b-2t1c-avf-ethip6-ip6scale20k | 83.8 +- 35.12 | 74.45 +- 6.17 | 87.7 +- 28.45 | 77.4 +- 13.23 | +17.79 +- 39.43 | -11.74 +- 32.36 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 178.4 +- 35.21 | 163.27 +- 15.75 | 169.6 +- 19.13 | 149.3 +- 7.33 | +3.88 +- 15.42 | -11.97 +- 10.83 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 75.7 +- 33.92 | 84.36 +- 11.27 | 86.6 +- 17.1 | 75.1 +- 10.85 | +2.65 +- 24.48 | -13.28 +- 21.22 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k-rnd | NT | 379.11 +- 193.96 | 592.5 +- 392.75 | 512.25 +- 398.01 | +56.29 +- 130.86 | -13.54 +- 88.3 | | 64b-2t1c-avf-ethip4-ip4scale200k | 88.4 +- 39.25 | 86.73 +- 11.25 | 94.2 +- 28.51 | 81.1 +- 7.89 | +8.62 +- 35.77 | -13.91 +- 27.37 | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 129.9 +- 24.96 | 403.91 +- 937.02 | 191.2 +- 226.23 | 159.9 +- 8.69 | -52.66 +- 123.28 | -16.37 +- 99.06 | | 64b-2t1c-ethip4-ip4base | 103.3 +- 40.68 | 84.55 +- 12.42 | 88.6 +- 12.35 | 72.9 +- 8.25 | +4.8 +- 21.22 | -17.72 +- 14.77 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k | NT | 192.0 +- 145.56 | 297.6 +- 189.83 | 241.75 +- 156.51 | +55.0 +- 153.57 | -18.77 +- 73.83 | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 159.2 +- 11.47 | 144.73 +- 75.99 | 116.9 +- 23.08 | 94.5 +- 9.42 | -19.23 +- 45.31 | -19.16 +- 17.88 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 200.6 +- 45.64 | 324.0 +- 86.77 | 304.0 +- 63.21 | 244.6 +- 30.74 | -6.17 +- 31.81 | -19.54 +- 19.55 | | 78b-2t1c-avf-ethip6-ip6scale2m | 135.5 +- 16.07 | 126.73 +- 77.72 | 130.1 +- 79.69 | 103.8 +- 88.12 | +2.66 +- 88.99 | -20.22 +- 83.52 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 105.6 +- 28.47 | 80.73 +- 12.26 | 90.5 +- 21.41 | 71.7 +- 9.06 | +12.11 +- 31.52 | -20.77 +- 21.25 | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 124.7 +- 21.22 | 169.45 +- 103.53 | 120.0 +- 51.97 | 92.4 +- 12.19 | -29.18 +- 53.03 | -23.0 +- 34.86 | | 64b-2t1c-ethip4-ip4scale200k | 111.0 +- 49.45 | 75.0 +- 7.69 | 98.9 +- 76.22 | 73.0 +- 5.73 | +31.87 +- 102.53 | -26.19 +- 57.18 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 106.5 +- 45.9 | 73.36 +- 6.7 | 98.7 +- 57.57 | 72.0 +- 5.56 | +34.54 +- 79.42 | -27.05 +- 42.92 | | 78b-2t1c-ethip6-ip6scale200k | 126.0 +- 29.36 | 255.36 +- 230.8 | 192.7 +- 157.5 | 133.1 +- 96.98 | -24.54 +- 91.95 | -30.93 +- 75.63 | | 64b-2t1c-eth-l2bdscale1mmaclrn | 135.3 +- 36.45 | 126.09 +- 19.22 | 206.3 +- 148.06 | 134.5 +- 21.09 | +63.61 +- 120.04 | -34.8 +- 47.9 | | 78b-2t1c-af-xdp-ethip6-ip6base | NT | 152.8 +- 80.66 | 575.9 +- 358.18 | 274.75 +- 268.67 | +276.9 +- 307.45 | -52.29 +- 55.29 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 178.4 +- 41.81 | 230.0 +- 57.21 | 476.7 +- 141.24 | 212.5 +- 31.49 | +107.26 +- 80.18 | -55.42 +- 14.77 | +--------------------------------------------------------------+----------------+-------------------+-----------------+------------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "7" for CSIT rls2106, "8" for CSIT rls2110). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2106.0-8 vs 2106.0-7: Compares CSIT environment current vs previous with previous VPP code. 2110.0-8 vs 2106.0-8: Compares VPP code current vs previous in the current CSIT environment.