+--------------------------------------------------------------+---------------+----------------+--------------+----------------------+----------------------+ | Test Case | 2101.0-6 | 2101.0-7 | 2101.1-7 | 2101.0-7 vs 2101.0-6 | 2101.1-7 vs 2101.0-7 | +--------------------------------------------------------------+---------------+----------------+--------------+----------------------+----------------------+ | 78b-2t1c-avf-ethip6-ip6scale2m | 135.5 +- 16.1 | 145.1 +- 107.1 | 211.0 +- NaN | +7.1 +- 80.1 | +45.4 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 79.9 +- 34.1 | 67.0 +- 3.3 | 85.0 +- NaN | -16.1 +- 36.0 | +26.9 +- NaN | | 78b-2t1c-ethip6-ip6scale200k | 126.0 +- 29.4 | 340.6 +- 249.5 | 418.0 +- NaN | +170.3 +- 207.8 | +22.7 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 178.4 +- 41.8 | 299.4 +- 115.8 | 358.0 +- NaN | +67.8 +- 75.9 | +19.6 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 196.6 +- 41.0 | 249.0 +- 12.1 | 285.0 +- NaN | +26.7 +- 27.1 | +14.5 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 156.1 +- 42.6 | 153.9 +- 4.9 | 169.0 +- NaN | -1.4 +- 27.1 | +9.8 +- NaN | | 64b-2t1c-ethip4-ip4scale200k | 111.0 +- 49.5 | 71.2 +- 6.2 | 77.0 +- NaN | -35.9 +- 29.1 | +8.1 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 137.1 +- 35.4 | 315.9 +- 46.0 | 341.0 +- NaN | +130.4 +- 68.4 | +7.9 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h262144-p63-s16515072-udir | 159.5 +- 29.8 | 175.3 +- 18.6 | 189.0 +- NaN | +9.9 +- 23.6 | +7.8 +- NaN | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 75.7 +- 33.9 | 88.6 +- 10.5 | 95.0 +- NaN | +17.0 +- 54.3 | +7.2 +- NaN | | 64b-2t1c-eth-l2patch | 79.0 +- 48.6 | 50.1 +- 2.6 | 53.0 +- NaN | -36.6 +- 39.2 | +5.8 +- NaN | | 78b-2t1c-ethip6-ip6scale2m-rnd | 170.9 +- 22.6 | 99.3 +- 7.6 | 105.0 +- NaN | -41.9 +- 8.9 | +5.7 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale20k | 74.9 +- 30.3 | 63.5 +- 3.9 | 66.0 +- NaN | -15.2 +- 34.7 | +3.9 +- NaN | | 64b-2t1c-ethip4-ip4scale20k | 103.7 +- 46.5 | 69.5 +- 6.7 | 72.0 +- NaN | -33.0 +- 30.8 | +3.6 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 197.5 +- 34.4 | 182.6 +- 6.5 | 189.0 +- NaN | -7.5 +- 16.4 | +3.5 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 80.4 +- 39.4 | 62.9 +- 4.1 | 65.0 +- NaN | -21.8 +- 38.6 | +3.3 +- NaN | | 64b-2t1c-ethip4-ip4scale200k-rnd | 104.2 +- 46.9 | 105.1 +- 38.5 | 108.0 +- NaN | +0.9 +- 58.6 | +2.8 +- NaN | | 64b-2t1c-eth-l2bdscale1mmaclrn | 135.3 +- 36.5 | 123.6 +- 15.3 | 126.0 +- NaN | -8.6 +- 27.1 | +1.9 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 178.4 +- 35.2 | 173.8 +- 17.2 | 177.0 +- NaN | -2.6 +- 21.5 | +1.8 +- NaN | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 110.8 +- 29.2 | 110.2 +- 21.8 | 112.0 +- NaN | -0.5 +- 32.8 | +1.6 +- NaN | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 250.1 +- 14.5 | 213.2 +- 7.1 | 216.0 +- NaN | -14.8 +- 5.7 | +1.3 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 200.6 +- 45.6 | 232.2 +- 4.6 | 235.0 +- NaN | +15.8 +- 26.4 | +1.2 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 154.2 +- 40.2 | 109.7 +- 4.6 | 110.0 +- NaN | -28.9 +- 18.8 | +0.3 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 202.7 +- 18.2 | 247.2 +- 12.8 | 247.0 +- NaN | +22.0 +- 12.7 | -0.1 +- NaN | | 64b-2t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 200.4 +- 31.9 | 269.6 +- 15.6 | 269.0 +- NaN | +34.5 +- 22.8 | -0.2 +- NaN | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 75.3 +- 19.6 | 76.2 +- 4.6 | 76.0 +- NaN | +1.2 +- 27.0 | -0.3 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 150.5 +- 42.2 | 108.6 +- 7.4 | 108.0 +- NaN | -27.8 +- 20.8 | -0.6 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 123.7 +- 44.9 | 76.7 +- 2.1 | 76.0 +- NaN | -38.0 +- 22.6 | -0.9 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 219.2 +- 28.5 | 273.4 +- 18.6 | 270.0 +- NaN | +24.7 +- 18.3 | -1.2 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 124.7 +- 21.2 | 90.2 +- 18.5 | 89.0 +- NaN | -27.7 +- 19.3 | -1.3 +- NaN | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 93.8 +- 35.7 | 76.2 +- 3.6 | 75.0 +- NaN | -18.8 +- 31.2 | -1.6 +- NaN | | 64b-2t1c-eth-l2bdscale100kmaclrn | 111.8 +- 37.3 | 98.7 +- 9.3 | 97.0 +- NaN | -11.7 +- 30.6 | -1.7 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 88.9 +- 33.0 | 74.9 +- 6.1 | 73.0 +- NaN | -15.7 +- 32.0 | -2.5 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 105.6 +- 28.5 | 74.9 +- 2.6 | 73.0 +- NaN | -29.1 +- 19.3 | -2.5 +- NaN | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 195.9 +- 14.9 | 195.4 +- 6.9 | 190.0 +- NaN | -0.3 +- 8.4 | -2.8 +- NaN | | 64b-2t1c-ethip4-ip4scale20k-rnd | 106.5 +- 45.9 | 73.1 +- 6.7 | 71.0 +- NaN | -31.4 +- 30.2 | -2.9 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 114.5 +- 37.8 | 80.4 +- 3.3 | 78.0 +- NaN | -29.8 +- 23.4 | -3.0 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 239.6 +- 13.7 | 235.9 +- 32.3 | 228.0 +- NaN | -1.5 +- 14.6 | -3.3 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 157.9 +- 39.5 | 187.5 +- 5.3 | 179.0 +- NaN | +18.7 +- 29.9 | -4.5 +- NaN | | 64b-2t1c-ethip4-ip4scale2m | 115.9 +- 43.8 | 83.8 +- 11.0 | 80.0 +- NaN | -27.7 +- 28.9 | -4.5 +- NaN | | 64b-2t1c-ethip4-ip4scale2m-rnd | 119.1 +- 48.5 | 83.2 +- 10.0 | 79.0 +- NaN | -30.1 +- 29.6 | -5.0 +- NaN | | 64b-2t1c-eth-l2xcbase | 84.2 +- 34.4 | 71.9 +- 3.7 | 68.0 +- NaN | -14.6 +- 35.2 | -5.4 +- NaN | | 64b-2t1c-eth-l2bdscale10kmaclrn | 110.2 +- 46.7 | 85.3 +- 5.1 | 80.0 +- NaN | -22.6 +- 33.1 | -6.2 +- NaN | | 78b-2t1c-ethip6-ip6base | 98.8 +- 44.3 | 69.4 +- 2.5 | 65.0 +- NaN | -29.8 +- 31.6 | -6.3 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h65536-p63-s4128768-udir | 175.3 +- 36.9 | 176.7 +- 10.6 | 165.0 +- NaN | +0.8 +- 22.1 | -6.6 +- NaN | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 180.0 +- 38.9 | 185.6 +- 5.9 | 173.0 +- NaN | +3.1 +- 22.5 | -6.8 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 117.5 +- 41.9 | 77.5 +- 12.2 | 72.0 +- NaN | -34.0 +- 25.7 | -7.1 +- NaN | | 64b-2t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 181.6 +- 30.6 | 167.6 +- 13.0 | 155.0 +- NaN | -7.7 +- 17.1 | -7.5 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale200k | 88.4 +- 39.2 | 68.4 +- 3.7 | 63.0 +- NaN | -22.6 +- 34.6 | -7.9 +- NaN | | 78b-2t1c-ethip6-ip6scale20k | 103.1 +- 41.6 | 71.8 +- 9.2 | 65.0 +- NaN | -30.4 +- 29.5 | -9.5 +- NaN | | 64b-2t1c-avf-ethip4-ip4base | 77.9 +- 40.9 | 66.4 +- 9.8 | 60.0 +- NaN | -14.8 +- 46.5 | -9.6 +- NaN | | 78b-2t1c-avf-ethip6-ip6base | 91.5 +- 45.9 | 65.3 +- 3.8 | 59.0 +- NaN | -28.6 +- 36.0 | -9.6 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 83.2 +- 42.2 | 66.7 +- 7.5 | 59.0 +- NaN | -19.8 +- 41.6 | -11.5 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 106.6 +- 43.6 | 92.1 +- 56.6 | 80.0 +- NaN | -13.6 +- 63.8 | -13.1 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 159.2 +- 11.5 | 106.6 +- 26.9 | 92.0 +- NaN | -33.0 +- 17.5 | -13.7 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale2m | 92.7 +- 36.6 | 84.1 +- 18.0 | 71.0 +- NaN | -9.3 +- 40.7 | -15.6 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale20k | 83.8 +- 35.1 | 87.2 +- 56.7 | 73.0 +- NaN | +4.1 +- 80.5 | -16.3 +- NaN | | 64b-2t1c-avf-eth-l2patch | 37.7 +- 10.1 | 37.3 +- 8.9 | 30.0 +- NaN | -1.1 +- 35.6 | -19.6 +- NaN | | 64b-2t1c-avf-eth-l2xcbase | 48.0 +- 10.3 | 62.3 +- 10.9 | 50.0 +- NaN | +29.8 +- 35.9 | -19.7 +- NaN | | 64b-2t1c-ethip4-ip4base | 103.3 +- 40.7 | 92.8 +- 20.7 | 72.0 +- NaN | -10.2 +- 40.7 | -22.4 +- NaN | | 78b-2t1c-ethip6-ip6scale20k-rnd | 142.6 +- 21.9 | 93.7 +- 42.9 | 70.0 +- NaN | -34.3 +- 31.8 | -25.3 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn | 103.2 +- 38.0 | 92.9 +- 11.4 | 66.0 +- NaN | -10.0 +- 34.9 | -29.0 +- NaN | | 78b-2t1c-ethip6-ip6scale2m | 137.6 +- 34.3 | 123.2 +- 130.8 | 84.0 +- NaN | -10.5 +- 97.7 | -31.8 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale200k | 108.4 +- 39.0 | 161.7 +- 106.8 | 83.0 +- NaN | +49.2 +- 112.2 | -48.7 +- NaN | | 78b-2t1c-ethip6-ip6scale200k-rnd | 163.0 +- 42.7 | 213.7 +- 198.8 | 95.0 +- NaN | +31.1 +- 126.7 | -55.5 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 129.9 +- 25.0 | 226.4 +- 391.0 | 96.0 +- NaN | +74.3 +- 302.8 | -57.6 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h16384-p63-s1032192-udir | 181.2 +- 11.5 | 615.9 +- 733.7 | 166.0 +- NaN | +239.9 +- 405.5 | -73.0 +- NaN | +--------------------------------------------------------------+---------------+----------------+--------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "6" for CSIT rls2101, "7" for CSIT rls2106). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2101.0-7 vs 2101.0-6: Compares CSIT environment current vs previous with previous VPP code. 2101.1-7 vs 2101.0-7: Compares VPP code current vs previous in the current CSIT environment.