+--------------------------------------------------------------+---------------+----------------+----------------+----------------------+----------------------+ | Test Case | 2101.0-6 | 2101.0-7 | 2101.1-7 | 2101.0-7 vs 2101.0-6 | 2101.1-7 vs 2101.0-7 | +--------------------------------------------------------------+---------------+----------------+----------------+----------------------+----------------------+ | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 104.4 +- 1.7 | 1906.6 +- 9.8 | 198.2 +- 28.3 | +1726.2 +- 31.4 | -89.6 +- 1.5 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 90.2 +- 3.8 | 1888.3 +- 3.0 | 169.6 +- 3.4 | +1993.5 +- 87.5 | -91.0 +- 0.2 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 81.9 +- 1.3 | 1877.0 +- 3.8 | 164.4 +- 30.9 | +2191.8 +- 36.3 | -91.2 +- 1.6 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 101.7 +- 3.3 | 1890.1 +- 25.9 | 165.2 +- 24.7 | +1758.5 +- 65.5 | -91.3 +- 1.3 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 120.7 +- 13.0 | 1882.7 +- 3.0 | 157.8 +- 2.4 | +1459.8 +- 168.5 | -91.6 +- 0.1 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 122.5 +- 17.9 | 1877.6 +- 3.0 | 154.0 +- 4.9 | +1432.7 +- 223.5 | -91.8 +- 0.3 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 94.2 +- 4.0 | 1870.3 +- 9.4 | 143.2 +- 7.7 | +1885.5 +- 84.2 | -92.3 +- 0.4 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 101.0 +- 3.6 | 1860.6 +- 3.5 | 140.0 +- 2.5 | +1742.1 +- 65.0 | -92.5 +- 0.1 | | 64b-2t1c-avf-ethip4udp-nat44ed-h65536-p63-s4128768-udir | 69.1 +- 3.8 | 1796.0 +- 6.9 | 128.0 +- 129.3 | +2499.1 +- 143.8 | -92.9 +- 7.2 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 82.1 +- 3.6 | 1850.4 +- 7.1 | 124.2 +- 13.8 | +2153.9 +- 99.3 | -93.3 +- 0.7 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 82.9 +- 2.1 | 1842.4 +- 2.8 | 122.2 +- 3.2 | +2122.5 +- 55.8 | -93.4 +- 0.2 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 66.1 +- 1.3 | 1828.2 +- 7.7 | 119.4 +- 14.0 | +2665.8 +- 55.1 | -93.5 +- 0.8 | | 64b-2t1c-avf-ethip4udp-nat44ed-h262144-p63-s16515072-udir | 71.4 +- 2.1 | 1791.6 +- 5.4 | 108.4 +- 93.9 | +2409.2 +- 73.0 | -93.9 +- 5.2 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 74.9 +- 2.0 | 1802.1 +- 28.1 | 95.2 +- 18.3 | +2306.0 +- 73.6 | -94.7 +- 1.0 | | 64b-2t1c-avf-ethip4udp-nat44ed-h16384-p63-s1032192-udir | 66.4 +- 5.3 | 1788.0 +- 7.0 | 65.0 +- 3.4 | +2592.8 +- 215.9 | -96.4 +- 0.2 | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 61.7 +- 2.4 | 1780.8 +- 3.1 | 61.4 +- 8.7 | +2786.2 +- 110.5 | -96.6 +- 0.5 | | 64b-2t1c-eth-l2bdscale1mmaclrn | 39.3 +- 5.6 | 1773.9 +- 4.0 | 54.6 +- 1.9 | +4413.7 +- 640.8 | -96.9 +- 0.1 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 36.3 +- 4.5 | 1769.1 +- 3.2 | 51.2 +- 1.3 | +4773.6 +- 607.3 | -97.1 +- 0.1 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 40.3 +- 0.8 | 1774.9 +- 3.3 | 50.8 +- 2.4 | +4304.2 +- 90.3 | -97.1 +- 0.1 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 37.5 +- 2.4 | 1782.4 +- 5.5 | 50.4 +- 12.5 | +4653.2 +- 300.6 | -97.2 +- 0.7 | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 36.4 +- 2.5 | 1765.6 +- 2.6 | 49.6 +- 17.3 | +4750.5 +- 333.7 | -97.2 +- 1.0 | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 35.9 +- 2.4 | 1768.9 +- 1.6 | 49.4 +- 0.9 | +4828.8 +- 332.5 | -97.2 +- 0.1 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 35.7 +- 1.8 | 1768.7 +- 1.9 | 49.2 +- 2.3 | +4854.2 +- 253.8 | -97.2 +- 0.1 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 41.8 +- 0.8 | 1773.8 +- 2.6 | 48.4 +- 4.1 | +4143.5 +- 80.3 | -97.3 +- 0.2 | | 64b-2t1c-avf-ethip4-ip4scale2m | 29.8 +- 0.8 | 1766.0 +- 5.0 | 48.0 +- 6.0 | +5826.2 +- 157.8 | -97.3 +- 0.3 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 38.9 +- 0.6 | 1768.6 +- 1.7 | 47.8 +- 2.5 | +4446.4 +- 66.5 | -97.3 +- 0.1 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 41.3 +- 1.3 | 1759.3 +- 2.3 | 47.2 +- 14.7 | +4159.9 +- 138.1 | -97.3 +- 0.8 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 33.6 +- 2.0 | 1762.0 +- 3.5 | 46.2 +- 7.9 | +5144.0 +- 305.3 | -97.4 +- 0.4 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 33.2 +- 0.6 | 1765.3 +- 1.1 | 45.4 +- 1.9 | +5217.3 +- 101.3 | -97.4 +- 0.1 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 38.3 +- 1.8 | 1767.1 +- 1.7 | 45.4 +- 2.1 | +4513.9 +- 212.9 | -97.4 +- 0.1 | | 64b-2t1c-ethip4-ip4scale200k-rnd | 32.3 +- 1.3 | 1765.7 +- 3.8 | 44.4 +- 4.0 | +5366.5 +- 226.7 | -97.5 +- 0.2 | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 29.3 +- 1.6 | 1762.8 +- 1.1 | 44.2 +- 3.4 | +5916.3 +- 321.8 | -97.5 +- 0.2 | | 64b-2t1c-eth-l2bdbasemaclrn | 33.0 +- 0.7 | 1762.3 +- 6.6 | 43.8 +- 2.2 | +5240.4 +- 109.7 | -97.5 +- 0.1 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 28.8 +- 2.3 | 1762.1 +- 3.5 | 42.0 +- 5.1 | +6018.4 +- 478.4 | -97.6 +- 0.3 | | 64b-2t1c-ethip4-ip4base | 28.5 +- 0.8 | 1766.7 +- 6.2 | 41.8 +- 4.3 | +6098.8 +- 186.1 | -97.6 +- 0.2 | | 64b-2t1c-avf-ethip4-ip4scale200k | 28.4 +- 0.8 | 1761.8 +- 4.1 | 41.2 +- 2.2 | +6103.4 +- 184.8 | -97.7 +- 0.1 | | 64b-2t1c-ethip4-ip4scale2m-rnd | 31.7 +- 1.5 | 1762.4 +- 3.5 | 41.2 +- 1.6 | +5459.8 +- 262.3 | -97.7 +- 0.1 | | 64b-2t1c-ethip4-ip4scale2m | 33.7 +- 1.3 | 1762.9 +- 4.1 | 41.0 +- 4.1 | +5131.1 +- 208.0 | -97.7 +- 0.2 | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 27.0 +- 1.1 | 1761.6 +- 2.2 | 40.8 +- 1.5 | +6424.3 +- 254.8 | -97.7 +- 0.1 | | 64b-2t1c-avf-ethip4-ip4scale20k | 27.8 +- 0.9 | 1761.3 +- 1.9 | 40.2 +- 1.1 | +6235.7 +- 209.5 | -97.7 +- 0.1 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 25.5 +- 0.5 | 1759.4 +- 1.7 | 39.6 +- 1.9 | +6799.8 +- 142.8 | -97.7 +- 0.1 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 31.2 +- 1.3 | 1760.7 +- 2.8 | 39.6 +- 3.1 | +5543.2 +- 238.3 | -97.8 +- 0.2 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 27.4 +- 0.8 | 1761.6 +- 6.1 | 39.6 +- 3.0 | +6329.0 +- 199.1 | -97.8 +- 0.2 | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 34.1 +- 1.8 | 2299.7 +- 2.3 | 51.2 +- 8.9 | +6643.9 +- 354.5 | -97.8 +- 0.4 | | 64b-2t1c-ethip4-ip4scale200k | 31.3 +- 1.3 | 1758.4 +- 3.2 | 38.8 +- 2.3 | +5518.0 +- 240.3 | -97.8 +- 0.1 | | 64b-2t1c-avf-ethip4-ip4base | 28.5 +- 1.4 | 1758.0 +- 1.3 | 38.0 +- 1.2 | +6068.4 +- 310.3 | -97.8 +- 0.1 | | 78b-2t1c-ethip6-ip6scale200k-rnd | 33.8 +- 4.2 | 2298.6 +- 2.8 | 49.6 +- 4.6 | +6700.5 +- 842.0 | -97.8 +- 0.2 | | 64b-2t1c-eth-l2xcbase | 25.5 +- 0.5 | 1757.4 +- 2.8 | 37.6 +- 1.1 | +6791.9 +- 142.9 | -97.9 +- 0.1 | | 78b-2t1c-ethip6-ip6scale2m-rnd | 39.6 +- 1.4 | 2298.2 +- 3.1 | 48.8 +- 0.8 | +5703.6 +- 209.7 | -97.9 +- 0.0 | | 64b-2t1c-ethip4-ip4scale20k | 30.8 +- 1.2 | 1755.3 +- 1.2 | 36.4 +- 1.3 | +5599.1 +- 227.5 | -97.9 +- 0.1 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 45.1 +- 6.6 | 1758.3 +- 2.6 | 35.6 +- 2.5 | +3798.7 +- 568.3 | -98.0 +- 0.1 | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 31.8 +- 2.5 | 2294.3 +- 2.2 | 46.0 +- 3.7 | +7114.9 +- 574.0 | -98.0 +- 0.2 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 30.3 +- 1.3 | 2289.2 +- 3.7 | 44.2 +- 4.7 | +7455.2 +- 312.3 | -98.1 +- 0.2 | | 78b-2t1c-ethip6-ip6scale200k | 32.7 +- 2.6 | 2288.2 +- 1.5 | 43.4 +- 3.4 | +6897.6 +- 553.0 | -98.1 +- 0.2 | | 64b-2t1c-avf-eth-l2xcbase | 23.8 +- 0.8 | 1754.9 +- 3.4 | 33.2 +- 1.3 | +7273.5 +- 244.8 | -98.1 +- 0.1 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 30.9 +- 1.3 | 2293.2 +- 1.5 | 43.2 +- 1.9 | +7321.4 +- 309.1 | -98.1 +- 0.1 | | 78b-2t1c-avf-ethip6-ip6scale200k | 30.3 +- 1.3 | 2292.0 +- 4.6 | 42.6 +- 4.4 | +7464.4 +- 334.2 | -98.1 +- 0.2 | | 78b-2t1c-ethip6-ip6scale20k | 31.3 +- 1.2 | 2283.7 +- 2.4 | 41.4 +- 2.4 | +7196.1 +- 270.4 | -98.2 +- 0.1 | | 78b-2t1c-avf-ethip6-ip6scale2m | 33.0 +- 2.6 | 2291.0 +- 3.5 | 41.0 +- 2.0 | +6842.4 +- 552.3 | -98.2 +- 0.1 | | 78b-2t1c-ethip6-ip6scale2m | 31.6 +- 1.1 | 2287.6 +- 3.4 | 40.6 +- 2.5 | +7139.1 +- 246.5 | -98.2 +- 0.1 | | 78b-2t1c-avf-ethip6-ip6base | 26.3 +- 0.5 | 2288.4 +- 1.3 | 40.0 +- 2.1 | +8601.3 +- 159.9 | -98.3 +- 0.1 | | 78b-2t1c-avf-ethip6-ip6scale20k | 30.3 +- 0.8 | 2287.4 +- 1.2 | 39.0 +- 1.2 | +7449.3 +- 205.2 | -98.3 +- 0.1 | | 78b-2t1c-ethip6-ip6base | 27.0 +- 0.5 | 2286.0 +- 1.4 | 38.8 +- 1.1 | +8366.7 +- 147.9 | -98.3 +- 0.0 | | 64b-2t1c-eth-l2patch | 22.3 +- 0.7 | 1749.3 +- 1.9 | 29.0 +- 0.7 | +7744.5 +- 237.6 | -98.3 +- 0.0 | | 64b-2t1c-avf-eth-l2patch | 15.8 +- 0.4 | 1738.4 +- 0.9 | 19.6 +- 0.5 | +10902.8 +- 293.7 | -98.9 +- 0.0 | +--------------------------------------------------------------+---------------+----------------+----------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "6" for CSIT rls2101, "7" for CSIT rls2106). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2101.0-7 vs 2101.0-6: Compares CSIT environment current vs previous with previous VPP code. 2101.1-7 vs 2101.0-7: Compares VPP code current vs previous in the current CSIT environment.