+--------------------------------------------------------------+-----------------+-----------------+-----------------+-----------------+----------------------+----------------------+ | Test Case | 2106.0-8 | 2110.0-8 | 2110.0-9 | 2202.0-9 | 2110.0-9 vs 2110.0-8 | 2202.0-9 vs 2110.0-9 | +--------------------------------------------------------------+-----------------+-----------------+-----------------+-----------------+----------------------+----------------------+ | 78b-2t1c-ethip6-ip6scale20k | 179.4 +- 115.2 | 165.7 +- 105.03 | 135.5 +- 65.0 | 169.1 +- 126.8 | -18.23 +- 65.0 | +24.8 +- 111.09 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 328.0 +- 78.41 | 314.8 +- 98.22 | 286.8 +- 38.28 | 344.8 +- 132.31 | -8.89 +- 30.92 | +20.22 +- 48.84 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 170.4 +- 97.87 | 281.4 +- 395.72 | 159.9 +- 88.0 | 188.7 +- 107.99 | -43.18 +- 85.81 | +18.01 +- 93.7 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 172.8 +- 108.11 | 153.0 +- 86.47 | 130.2 +- 19.71 | 147.7 +- 69.9 | -14.9 +- 49.79 | +13.44 +- 56.37 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 338.9 +- 60.09 | 320.1 +- 72.16 | 318.9 +- 18.91 | 345.5 +- 23.28 | -0.37 +- 23.22 | +8.34 +- 9.73 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 141.2 +- 69.15 | 181.5 +- 105.3 | 129.0 +- 59.78 | 135.1 +- 77.52 | -28.93 +- 52.77 | +4.73 +- 77.24 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 288.9 +- 20.67 | 320.4 +- 79.13 | 301.5 +- 65.98 | 308.5 +- 57.07 | -5.9 +- 31.05 | +2.32 +- 29.32 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 148.5 +- 69.38 | 175.6 +- 93.53 | 170.0 +- 91.78 | 166.1 +- 104.93 | -3.19 +- 73.42 | -2.29 +- 81.19 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 218.5 +- 56.21 | 206.0 +- 8.33 | 207.6 +- 33.5 | 188.4 +- 12.69 | +0.78 +- 16.76 | -9.25 +- 15.87 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 125.7 +- 80.29 | 150.3 +- 111.75 | 128.6 +- 73.39 | 115.0 +- 64.34 | -14.44 +- 80.19 | -10.58 +- 71.47 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 203.3 +- 109.69 | 157.1 +- 21.15 | 233.8 +- 176.56 | 208.2 +- 125.62 | +48.82 +- 114.16 | -10.95 +- 86.08 | | 64b-2t1c-eth-l2patch | 72.6 +- 10.19 | 92.0 +- 74.89 | 73.1 +- 7.84 | 63.9 +- 77.01 | -20.54 +- 65.24 | -12.59 +- 105.76 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 146.8 +- 93.55 | 121.5 +- 77.76 | 172.6 +- 114.84 | 149.7 +- 95.57 | +42.06 +- 131.15 | -13.27 +- 79.98 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 162.2 +- 81.41 | 119.2 +- 20.18 | 130.1 +- 15.34 | 112.3 +- 13.61 | +9.14 +- 22.51 | -13.68 +- 14.6 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 655.5 +- 42.35 | 677.3 +- 47.82 | 617.7 +- 36.64 | 532.9 +- 22.85 | -8.8 +- 8.41 | -13.73 +- 6.31 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 306.8 +- 111.27 | 279.0 +- 65.2 | 286.4 +- 67.81 | 243.8 +- 36.22 | +2.65 +- 34.15 | -14.87 +- 23.8 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 134.0 +- 10.86 | 136.6 +- 78.92 | 120.4 +- 6.62 | 100.3 +- 82.77 | -11.86 +- 51.15 | -16.69 +- 68.9 | | 64b-2t1c-avf-ethip4-ip4scale20k | 175.8 +- 105.82 | 109.3 +- 16.15 | 156.0 +- 98.14 | 129.8 +- 78.78 | +42.73 +- 92.23 | -16.79 +- 72.74 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 238.4 +- 96.01 | 215.1 +- 13.77 | 222.6 +- 56.32 | 184.2 +- 16.07 | +3.49 +- 27.01 | -17.25 +- 22.15 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 279.3 +- 35.55 | 276.6 +- 16.78 | 316.7 +- 94.74 | 258.6 +- 69.5 | +14.5 +- 34.95 | -18.35 +- 32.84 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 213.5 +- 65.7 | 186.7 +- 11.6 | 217.1 +- 76.8 | 176.7 +- 12.28 | +16.28 +- 41.76 | -18.61 +- 29.34 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 398.0 +- 104.28 | 364.2 +- 72.09 | 423.0 +- 104.3 | 334.4 +- 43.01 | +16.14 +- 36.72 | -20.95 +- 21.99 | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 283.1 +- 82.91 | 179.4 +- 26.32 | 206.7 +- 71.1 | 161.4 +- 29.17 | +15.22 +- 43.09 | -21.92 +- 30.34 | | 78b-2t1c-avf-ethip6-ip6base | 149.1 +- 93.39 | 148.9 +- 105.82 | 126.5 +- 61.51 | 98.4 +- 12.77 | -15.04 +- 73.16 | -22.21 +- 39.15 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 371.5 +- 56.64 | 315.1 +- 82.66 | 343.2 +- 98.51 | 260.9 +- 73.75 | +8.92 +- 42.35 | -23.98 +- 30.63 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 170.6 +- 115.93 | 119.2 +- 80.06 | 133.4 +- 84.78 | 99.4 +- 11.64 | +11.91 +- 103.48 | -25.49 +- 48.15 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 134.7 +- 93.56 | 139.8 +- 82.55 | 153.2 +- 70.33 | 112.0 +- 13.19 | +9.59 +- 81.96 | -26.89 +- 34.65 | | 64b-2t1c-eth-l2bdbasemaclrn | 152.3 +- 89.89 | 148.4 +- 104.66 | 171.1 +- 102.02 | 124.6 +- 121.3 | +15.3 +- 106.48 | -27.18 +- 83.14 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 307.5 +- 78.99 | 279.8 +- 46.86 | 307.6 +- 75.75 | 218.3 +- 46.41 | +9.94 +- 32.74 | -29.03 +- 23.09 | | 64b-2t1c-avf-ethip4-ip4base | 133.0 +- 77.9 | 134.4 +- 77.53 | 155.4 +- 119.22 | 107.8 +- 7.8 | +15.62 +- 110.99 | -30.63 +- 53.46 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 229.9 +- 92.97 | 189.0 +- 89.11 | 202.8 +- 85.08 | 139.5 +- 112.1 | +7.3 +- 67.72 | -31.21 +- 62.36 | | 64b-2t1c-ethip4-ip4scale20k | 190.6 +- 119.47 | 148.9 +- 84.12 | 148.6 +- 81.61 | 102.0 +- 88.9 | -0.2 +- 78.63 | -31.36 +- 70.71 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 352.7 +- 99.38 | 279.4 +- 8.5 | 321.4 +- 83.59 | 215.1 +- 10.6 | +15.03 +- 30.12 | -33.07 +- 17.71 | | 64b-2t1c-avf-eth-l2xcbase | 79.5 +- 6.19 | 122.2 +- 105.79 | 150.1 +- 113.43 | 99.9 +- 67.41 | +22.83 +- 141.15 | -33.44 +- 67.43 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 283.0 +- 48.28 | 237.8 +- 15.43 | 358.9 +- 158.21 | 237.7 +- 16.83 | +50.93 +- 67.25 | -33.77 +- 29.57 | | 64b-2t1c-ethip4-ip4base | 167.0 +- 60.6 | 124.1 +- 15.6 | 140.7 +- 80.63 | 92.4 +- 72.65 | +13.38 +- 66.51 | -34.33 +- 63.89 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 230.5 +- 132.6 | 119.8 +- 65.99 | 193.4 +- 130.03 | 123.2 +- 60.53 | +61.44 +- 140.32 | -36.3 +- 53.05 | | 78b-2t1c-avf-ethip6-ip6scale20k | 135.0 +- 83.64 | 122.7 +- 76.79 | 206.3 +- 121.32 | 122.4 +- 65.8 | +68.13 +- 144.38 | -40.67 +- 47.27 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 135.2 +- 17.99 | 165.2 +- 84.44 | 250.7 +- 130.61 | 144.4 +- 108.27 | +51.76 +- 110.76 | -42.4 +- 52.59 | | 78b-2t1c-ethip6-ip6base | 180.4 +- 92.18 | 102.9 +- 13.1 | 183.2 +- 118.21 | 94.5 +- 83.02 | +78.04 +- 117.09 | -48.42 +- 56.23 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 210.7 +- 125.01 | 124.9 +- 78.82 | 146.1 +- 78.74 | 73.3 +- 6.29 | +16.97 +- 97.07 | -49.83 +- 27.38 | | 64b-2t1c-eth-l2xcbase | 114.0 +- 77.57 | 157.0 +- 116.67 | 121.6 +- 79.71 | 51.7 +- 3.97 | -22.55 +- 76.75 | -57.48 +- 28.06 | | 64b-2t1c-avf-eth-l2patch | 40.1 +- 1.6 | 39.3 +- 2.36 | 154.9 +- 148.9 | 39.8 +- 3.19 | +294.15 +- 379.62 | -74.31 +- 24.78 | +--------------------------------------------------------------+-----------------+-----------------+-----------------+-----------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-zn2 with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "8" for CSIT rls2110, "9" for CSIT rls2202). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2110.0-9 vs 2110.0-8: Compares CSIT environment current vs previous with previous VPP code. 2202.0-9 vs 2110.0-9: Compares VPP code current vs previous in the current CSIT environment.