+--------------------------------------------------------------+---------------+----------------+--------------+----------------------+----------------------+ | Test Case | 2101.0-6 | 2101.0-7 | 2106.0-7 | 2101.0-7 vs 2101.0-6 | 2106.0-7 vs 2101.0-7 | +--------------------------------------------------------------+---------------+----------------+--------------+----------------------+----------------------+ | 78b-2t1c-ethip6-ip6scale200k-rnd | 163.0 +- 42.7 | 213.7 +- 198.8 | 551.0 +- NaN | +31.1 +- 126.7 | +157.8 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 159.2 +- 11.5 | 106.6 +- 26.9 | 213.0 +- NaN | -33.0 +- 17.5 | +99.8 +- NaN | | 64b-2t1c-avf-ethip4-ip4base | 77.9 +- 40.9 | 66.4 +- 9.8 | 101.0 +- NaN | -14.8 +- 46.5 | +52.1 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale20k | 74.9 +- 30.3 | 63.5 +- 3.9 | 95.0 +- NaN | -15.2 +- 34.7 | +49.6 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 150.5 +- 42.2 | 108.6 +- 7.4 | 155.0 +- NaN | -27.8 +- 20.8 | +42.7 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale200k | 88.4 +- 39.2 | 68.4 +- 3.7 | 97.0 +- NaN | -22.6 +- 34.6 | +41.8 +- NaN | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 250.1 +- 14.5 | 213.2 +- 7.1 | 300.0 +- NaN | -14.8 +- 5.7 | +40.7 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 79.9 +- 34.1 | 67.0 +- 3.3 | 94.0 +- NaN | -16.1 +- 36.0 | +40.3 +- NaN | | 78b-2t1c-avf-ethip6-ip6base | 91.5 +- 45.9 | 65.3 +- 3.8 | 91.0 +- NaN | -28.6 +- 36.0 | +39.4 +- NaN | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 195.9 +- 14.9 | 195.4 +- 6.9 | 257.0 +- NaN | -0.3 +- 8.4 | +31.5 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 123.7 +- 44.9 | 76.7 +- 2.1 | 100.0 +- NaN | -38.0 +- 22.6 | +30.4 +- NaN | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 93.8 +- 35.7 | 76.2 +- 3.6 | 95.0 +- NaN | -18.8 +- 31.2 | +24.7 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 137.1 +- 35.4 | 315.9 +- 46.0 | 388.0 +- NaN | +130.4 +- 68.4 | +22.8 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 117.5 +- 41.9 | 77.5 +- 12.2 | 94.0 +- NaN | -34.0 +- 25.7 | +21.3 +- NaN | | 78b-2t1c-ethip6-ip6scale2m-rnd | 170.9 +- 22.6 | 99.3 +- 7.6 | 114.0 +- NaN | -41.9 +- 8.9 | +14.8 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 80.4 +- 39.4 | 62.9 +- 4.1 | 72.0 +- NaN | -21.8 +- 38.6 | +14.5 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 156.1 +- 42.6 | 153.9 +- 4.9 | 174.0 +- NaN | -1.4 +- 27.1 | +13.1 +- NaN | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 75.3 +- 19.6 | 76.2 +- 4.6 | 86.0 +- NaN | +1.2 +- 27.0 | +12.9 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 114.5 +- 37.8 | 80.4 +- 3.3 | 90.0 +- NaN | -29.8 +- 23.4 | +11.9 +- NaN | | 64b-2t1c-eth-l2patch | 79.0 +- 48.6 | 50.1 +- 2.6 | 56.0 +- NaN | -36.6 +- 39.2 | +11.8 +- NaN | | 64b-2t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 200.4 +- 31.9 | 269.6 +- 15.6 | 301.0 +- NaN | +34.5 +- 22.8 | +11.6 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 219.2 +- 28.5 | 273.4 +- 18.6 | 300.0 +- NaN | +24.7 +- 18.3 | +9.7 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 196.6 +- 41.0 | 249.0 +- 12.1 | 268.0 +- NaN | +26.7 +- 27.1 | +7.6 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 200.6 +- 45.6 | 232.2 +- 4.6 | 245.0 +- NaN | +15.8 +- 26.4 | +5.5 +- NaN | | 64b-2t1c-ethip4-ip4scale200k | 111.0 +- 49.5 | 71.2 +- 6.2 | 75.0 +- NaN | -35.9 +- 29.1 | +5.3 +- NaN | | 78b-2t1c-ethip6-ip6base | 98.8 +- 44.3 | 69.4 +- 2.5 | 73.0 +- NaN | -29.8 +- 31.6 | +5.2 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 83.2 +- 42.2 | 66.7 +- 7.5 | 70.0 +- NaN | -19.8 +- 41.6 | +4.9 +- NaN | | 64b-2t1c-ethip4-ip4scale20k | 103.7 +- 46.5 | 69.5 +- 6.7 | 72.0 +- NaN | -33.0 +- 30.8 | +3.6 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 239.6 +- 13.7 | 235.9 +- 32.3 | 244.0 +- NaN | -1.5 +- 14.6 | +3.4 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 154.2 +- 40.2 | 109.7 +- 4.6 | 113.0 +- NaN | -28.9 +- 18.8 | +3.0 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 197.5 +- 34.4 | 182.6 +- 6.5 | 186.0 +- NaN | -7.5 +- 16.4 | +1.9 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 157.9 +- 39.5 | 187.5 +- 5.3 | 190.0 +- NaN | +18.7 +- 29.9 | +1.3 +- NaN | | 64b-2t1c-eth-l2bdscale100kmaclrn | 111.8 +- 37.3 | 98.7 +- 9.3 | 99.0 +- NaN | -11.7 +- 30.6 | +0.3 +- NaN | | 64b-2t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 181.6 +- 30.6 | 167.6 +- 13.0 | 168.0 +- NaN | -7.7 +- 17.1 | +0.2 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 105.6 +- 28.5 | 74.9 +- 2.6 | 75.0 +- NaN | -29.1 +- 19.3 | +0.1 +- NaN | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 180.0 +- 38.9 | 185.6 +- 5.9 | 185.0 +- NaN | +3.1 +- 22.5 | -0.3 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 202.7 +- 18.2 | 247.2 +- 12.8 | 246.0 +- NaN | +22.0 +- 12.7 | -0.5 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 124.7 +- 21.2 | 90.2 +- 18.5 | 89.0 +- NaN | -27.7 +- 19.3 | -1.3 +- NaN | | 64b-2t1c-eth-l2xcbase | 84.2 +- 34.4 | 71.9 +- 3.7 | 69.0 +- NaN | -14.6 +- 35.2 | -4.0 +- NaN | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 106.6 +- 43.6 | 92.1 +- 56.6 | 88.0 +- NaN | -13.6 +- 63.8 | -4.5 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 178.4 +- 41.8 | 299.4 +- 115.8 | 284.0 +- NaN | +67.8 +- 75.9 | -5.1 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 88.9 +- 33.0 | 74.9 +- 6.1 | 71.0 +- NaN | -15.7 +- 32.0 | -5.2 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn | 103.2 +- 38.0 | 92.9 +- 11.4 | 87.0 +- NaN | -10.0 +- 34.9 | -6.4 +- NaN | | 64b-2t1c-ethip4-ip4scale2m | 115.9 +- 43.8 | 83.8 +- 11.0 | 77.0 +- NaN | -27.7 +- 28.9 | -8.1 +- NaN | | 64b-2t1c-ethip4-ip4scale20k-rnd | 106.5 +- 45.9 | 73.1 +- 6.7 | 67.0 +- NaN | -31.4 +- 30.2 | -8.3 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale2m | 92.7 +- 36.6 | 84.1 +- 18.0 | 77.0 +- NaN | -9.3 +- 40.7 | -8.4 +- NaN | | 64b-2t1c-avf-eth-l2patch | 37.7 +- 10.1 | 37.3 +- 8.9 | 34.0 +- NaN | -1.1 +- 35.6 | -8.8 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 178.4 +- 35.2 | 173.8 +- 17.2 | 157.0 +- NaN | -2.6 +- 21.5 | -9.7 +- NaN | | 64b-2t1c-ethip4-ip4scale2m-rnd | 119.1 +- 48.5 | 83.2 +- 10.0 | 73.0 +- NaN | -30.1 +- 29.6 | -12.3 +- NaN | | 64b-2t1c-eth-l2bdscale10kmaclrn | 110.2 +- 46.7 | 85.3 +- 5.1 | 74.0 +- NaN | -22.6 +- 33.1 | -13.2 +- NaN | | 64b-2t1c-eth-l2bdscale1mmaclrn | 135.3 +- 36.5 | 123.6 +- 15.3 | 102.0 +- NaN | -8.6 +- 27.1 | -17.5 +- NaN | | 64b-2t1c-ethip4-ip4base | 103.3 +- 40.7 | 92.8 +- 20.7 | 75.0 +- NaN | -10.2 +- 40.7 | -19.2 +- NaN | | 78b-2t1c-ethip6-ip6scale20k | 103.1 +- 41.6 | 71.8 +- 9.2 | 58.0 +- NaN | -30.4 +- 29.5 | -19.2 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h262144-p63-s16515072-udir | 159.5 +- 29.8 | 175.3 +- 18.6 | 141.0 +- NaN | +9.9 +- 23.6 | -19.6 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale20k | 83.8 +- 35.1 | 87.2 +- 56.7 | 70.0 +- NaN | +4.1 +- 80.5 | -19.7 +- NaN | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 75.7 +- 33.9 | 88.6 +- 10.5 | 71.0 +- NaN | +17.0 +- 54.3 | -19.9 +- NaN | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 110.8 +- 29.2 | 110.2 +- 21.8 | 84.0 +- NaN | -0.5 +- 32.8 | -23.8 +- NaN | | 78b-2t1c-ethip6-ip6scale20k-rnd | 142.6 +- 21.9 | 93.7 +- 42.9 | 71.0 +- NaN | -34.3 +- 31.8 | -24.2 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h65536-p63-s4128768-udir | 175.3 +- 36.9 | 176.7 +- 10.6 | 133.0 +- NaN | +0.8 +- 22.1 | -24.7 +- NaN | | 64b-2t1c-ethip4-ip4scale200k-rnd | 104.2 +- 46.9 | 105.1 +- 38.5 | 78.0 +- NaN | +0.9 +- 58.6 | -25.8 +- NaN | | 64b-2t1c-avf-eth-l2xcbase | 48.0 +- 10.3 | 62.3 +- 10.9 | 45.0 +- NaN | +29.8 +- 35.9 | -27.8 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale2m | 135.5 +- 16.1 | 145.1 +- 107.1 | 102.0 +- NaN | +7.1 +- 80.1 | -29.7 +- NaN | | 78b-2t1c-ethip6-ip6scale2m | 137.6 +- 34.3 | 123.2 +- 130.8 | 82.0 +- NaN | -10.5 +- 97.7 | -33.4 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale200k | 108.4 +- 39.0 | 161.7 +- 106.8 | 100.0 +- NaN | +49.2 +- 112.2 | -38.2 +- NaN | | 78b-2t1c-ethip6-ip6scale200k | 126.0 +- 29.4 | 340.6 +- 249.5 | 186.0 +- NaN | +170.3 +- 207.8 | -45.4 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 129.9 +- 25.0 | 226.4 +- 391.0 | 111.0 +- NaN | +74.3 +- 302.8 | -51.0 +- NaN | | 64b-2t1c-avf-ethip4udp-nat44ed-h16384-p63-s1032192-udir | 181.2 +- 11.5 | 615.9 +- 733.7 | 173.0 +- NaN | +239.9 +- 405.5 | -71.9 +- NaN | +--------------------------------------------------------------+---------------+----------------+--------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-skx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "6" for CSIT rls2101, "7" for CSIT rls2106). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2101.0-7 vs 2101.0-6: Compares CSIT environment current vs previous with previous VPP code. 2106.0-7 vs 2101.0-7: Compares VPP code current vs previous in the current CSIT environment.