+--------------------------------------------------------------+---------------+-----------------+------------------+----------------------+----------------------+ | Test Case | 2101.0-6 | 2101.0-7 | 2101.1-7 | 2101.0-7 vs 2101.0-6 | 2101.1-7 vs 2101.0-7 | +--------------------------------------------------------------+---------------+-----------------+------------------+----------------------+----------------------+ | 64b-2t1c-avf-ethip4udp-nat44ed-h16384-p63-s1032192-udir | 193.6 +- 21.6 | 5356.7 +- 701.9 | 1146.8 +- 1317.7 | +2666.9 +- 475.9 | -78.6 +- 24.8 | | 64b-2t1c-avf-ethip4udp-nat44ed-h65536-p63-s4128768-udir | 155.7 +- 25.0 | 5113.6 +- 21.0 | 414.2 +- 532.3 | +3184.2 +- 528.2 | -91.9 +- 10.4 | | 64b-2t1c-avf-ethip4udp-nat44ed-h262144-p63-s16515072-udir | 135.4 +- 12.6 | 5103.8 +- 8.3 | 388.8 +- 513.2 | +3669.4 +- 350.5 | -92.4 +- 10.1 | | 64b-2t1c-avf-ethip4udp-nat44det-h262144-p63-s16515072 | 84.7 +- 11.7 | 5126.4 +- 29.3 | 376.0 +- 228.4 | +5952.5 +- 835.4 | -92.7 +- 4.5 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 265.4 +- 11.7 | 5138.6 +- 26.8 | 341.0 +- 178.6 | +1836.2 +- 86.3 | -93.4 +- 3.5 | | 78b-2t1c-ethip6-ip6scale200k | 134.7 +- 82.8 | 5050.8 +- 7.8 | 324.8 +- 301.1 | +3649.6 +- 2304.4 | -93.6 +- 6.0 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 169.5 +- 4.3 | 5244.8 +- 12.0 | 327.0 +- 39.0 | +2994.3 +- 79.3 | -93.8 +- 0.7 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 165.1 +- 23.1 | 5286.4 +- 92.9 | 305.6 +- 25.3 | +3102.0 +- 451.3 | -94.2 +- 0.5 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 215.5 +- 12.8 | 5224.4 +- 22.1 | 295.0 +- 10.4 | +2324.3 +- 143.9 | -94.4 +- 0.2 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 120.5 +- 6.1 | 5174.2 +- 9.7 | 281.8 +- 134.3 | +4194.0 +- 217.4 | -94.6 +- 2.6 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 205.6 +- 12.9 | 5216.4 +- 9.9 | 278.4 +- 12.4 | +2437.2 +- 159.7 | -94.7 +- 0.2 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 177.7 +- 47.0 | 5070.9 +- 6.7 | 253.8 +- 190.2 | +2753.6 +- 754.6 | -95.0 +- 3.8 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 158.3 +- 17.6 | 5166.2 +- 10.0 | 254.0 +- 88.8 | +3163.6 +- 362.4 | -95.1 +- 1.7 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 262.6 +- 13.9 | 5205.3 +- 13.0 | 254.0 +- 5.3 | +1882.2 +- 105.0 | -95.1 +- 0.1 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 145.7 +- 12.9 | 5183.4 +- 34.2 | 249.6 +- 44.9 | +3457.6 +- 316.1 | -95.2 +- 0.9 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 150.0 +- 36.6 | 5140.6 +- 68.1 | 243.6 +- 81.1 | +3327.0 +- 837.0 | -95.3 +- 1.6 | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 185.5 +- 4.4 | 5182.2 +- 9.6 | 241.2 +- 9.9 | +2693.7 +- 65.8 | -95.3 +- 0.2 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 100.5 +- 7.0 | 5134.6 +- 16.1 | 221.0 +- 41.1 | +5009.0 +- 356.8 | -95.7 +- 0.8 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 164.6 +- 11.3 | 5154.9 +- 8.1 | 200.0 +- 2.9 | +3031.8 +- 214.8 | -96.1 +- 0.1 | | 78b-2t1c-avf-ethip6-ip6scale2m | 96.4 +- 18.5 | 5072.4 +- 31.6 | 196.2 +- 165.7 | +5161.9 +- 1012.6 | -96.1 +- 3.3 | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 91.7 +- 31.3 | 5057.4 +- 3.8 | 195.0 +- 80.6 | +5417.2 +- 1881.1 | -96.1 +- 1.6 | | 78b-2t1c-avf-ethip6-ip6scale200k | 85.4 +- 24.5 | 5090.1 +- 86.9 | 162.8 +- 112.4 | +5860.3 +- 1712.0 | -96.8 +- 2.2 | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 109.3 +- 4.4 | 5072.9 +- 7.6 | 140.0 +- 48.9 | +4541.3 +- 185.8 | -97.2 +- 1.0 | | 64b-2t1c-eth-l2bdscale1mmaclrn | 98.8 +- 23.4 | 5186.2 +- 157.7 | 138.6 +- 10.2 | +5149.2 +- 1254.4 | -97.3 +- 0.2 | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 68.4 +- 3.6 | 5064.6 +- 4.7 | 133.2 +- 83.8 | +7304.3 +- 392.7 | -97.4 +- 1.7 | | 78b-2t1c-ethip6-ip6scale2m-rnd | 81.5 +- 5.0 | 5103.2 +- 71.4 | 119.0 +- 20.9 | +6161.6 +- 393.6 | -97.7 +- 0.4 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 70.8 +- 9.4 | 5062.7 +- 8.2 | 113.6 +- 7.2 | +7050.7 +- 944.9 | -97.8 +- 0.1 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 117.7 +- 53.9 | 5076.9 +- 6.5 | 112.8 +- 3.1 | +4213.4 +- 1975.1 | -97.8 +- 0.1 | | 78b-2t1c-ethip6-ip6scale200k-rnd | 119.8 +- 77.2 | 5105.0 +- 123.2 | 111.8 +- 11.4 | +4161.3 +- 2746.7 | -97.8 +- 0.2 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 56.5 +- 3.1 | 5048.8 +- 3.4 | 105.0 +- 37.5 | +8835.9 +- 496.0 | -97.9 +- 0.7 | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 85.2 +- 37.9 | 5093.3 +- 77.9 | 105.8 +- 33.8 | +5878.1 +- 2659.0 | -97.9 +- 0.7 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 64.6 +- 2.9 | 5048.6 +- 5.3 | 103.4 +- 52.4 | +7715.1 +- 347.9 | -98.0 +- 1.0 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 67.1 +- 5.7 | 5081.9 +- 8.4 | 103.6 +- 30.1 | +7473.6 +- 639.6 | -98.0 +- 0.6 | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 52.5 +- 2.2 | 5062.0 +- 51.1 | 102.8 +- 36.3 | +9541.9 +- 419.8 | -98.0 +- 0.7 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 69.3 +- 1.5 | 5061.7 +- 8.6 | 100.2 +- 25.5 | +7204.0 +- 158.0 | -98.0 +- 0.5 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 62.5 +- 2.3 | 5045.7 +- 3.1 | 96.6 +- 33.7 | +7973.1 +- 293.6 | -98.1 +- 0.7 | | 64b-2t1c-avf-ethip4-ip4scale2m | 54.1 +- 3.7 | 5047.7 +- 8.1 | 96.4 +- 11.3 | +9230.3 +- 632.3 | -98.1 +- 0.2 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 56.4 +- 2.2 | 5047.8 +- 5.0 | 95.4 +- 25.7 | +8850.0 +- 352.6 | -98.1 +- 0.5 | | 64b-2t1c-eth-l2bdbasemaclrn | 59.4 +- 2.8 | 5048.8 +- 16.5 | 94.2 +- 11.8 | +8399.6 +- 406.8 | -98.1 +- 0.2 | | 64b-2t1c-ethip4-ip4scale2m-rnd | 60.3 +- 3.5 | 5049.0 +- 4.8 | 92.8 +- 14.9 | +8273.1 +- 481.3 | -98.2 +- 0.3 | | 64b-2t1c-ethip4-ip4scale200k-rnd | 58.9 +- 3.6 | 5095.3 +- 121.9 | 93.4 +- 13.7 | +8550.8 +- 564.1 | -98.2 +- 0.3 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 72.7 +- 3.7 | 5054.9 +- 2.1 | 91.6 +- 13.3 | +6853.1 +- 349.4 | -98.2 +- 0.3 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 48.2 +- 5.3 | 5040.2 +- 3.5 | 90.6 +- 34.5 | +10356.9 +- 1142.5 | -98.2 +- 0.7 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 50.0 +- 3.6 | 5048.8 +- 8.2 | 89.2 +- 23.1 | +9997.6 +- 731.4 | -98.2 +- 0.5 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 54.3 +- 3.3 | 5080.0 +- 88.0 | 88.6 +- 13.2 | +9255.4 +- 585.8 | -98.3 +- 0.3 | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 43.7 +- 1.6 | 5041.6 +- 7.0 | 87.2 +- 24.8 | +11436.7 +- 432.3 | -98.3 +- 0.5 | | 78b-2t1c-ethip6-ip6scale2m | 96.4 +- 13.6 | 5047.1 +- 7.4 | 86.0 +- 2.3 | +5135.6 +- 740.8 | -98.3 +- 0.0 | | 64b-2t1c-ethip4-ip4scale200k | 55.2 +- 2.1 | 5041.6 +- 4.8 | 85.0 +- 14.8 | +9033.3 +- 355.8 | -98.3 +- 0.3 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 43.1 +- 1.9 | 5037.1 +- 3.7 | 83.0 +- 21.1 | +11587.0 +- 518.5 | -98.4 +- 0.4 | | 78b-2t1c-ethip6-ip6scale20k | 55.1 +- 3.3 | 5039.6 +- 6.9 | 81.6 +- 8.2 | +9046.2 +- 544.8 | -98.4 +- 0.2 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 57.0 +- 2.4 | 5044.0 +- 6.6 | 80.6 +- 6.4 | +8749.1 +- 373.3 | -98.4 +- 0.1 | | 64b-2t1c-avf-ethip4-ip4scale200k | 49.1 +- 2.6 | 5042.4 +- 9.3 | 79.0 +- 16.4 | +10169.7 +- 535.4 | -98.4 +- 0.3 | | 64b-2t1c-ethip4-ip4base | 53.0 +- 1.3 | 5057.7 +- 15.9 | 78.8 +- 10.5 | +9442.8 +- 241.9 | -98.4 +- 0.2 | | 78b-2t1c-avf-ethip6-ip6scale20k | 50.3 +- 4.5 | 5042.0 +- 6.4 | 77.8 +- 15.7 | +9923.9 +- 901.4 | -98.5 +- 0.3 | | 64b-2t1c-ethip4-ip4scale2m | 61.3 +- 3.5 | 5049.4 +- 4.7 | 77.0 +- 8.7 | +8137.3 +- 470.1 | -98.5 +- 0.2 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 44.6 +- 3.1 | 5037.0 +- 7.2 | 76.4 +- 21.5 | +11193.7 +- 793.8 | -98.5 +- 0.4 | | 78b-2t1c-avf-ethip6-ip6base | 43.1 +- 2.1 | 5043.3 +- 6.3 | 76.0 +- 16.4 | +11601.5 +- 564.6 | -98.5 +- 0.3 | | 64b-2t1c-avf-ethip4-ip4scale20k | 48.2 +- 2.5 | 5039.4 +- 3.8 | 75.6 +- 11.9 | +10355.3 +- 539.2 | -98.5 +- 0.2 | | 78b-2t1c-ethip6-ip6base | 49.1 +- 2.5 | 5039.4 +- 3.0 | 75.6 +- 5.4 | +10163.6 +- 516.3 | -98.5 +- 0.1 | | 64b-2t1c-avf-ethip4-ip4base | 48.0 +- 3.7 | 5035.2 +- 2.3 | 73.2 +- 20.9 | +10390.0 +- 817.7 | -98.5 +- 0.4 | | 64b-2t1c-eth-l2xcbase | 43.0 +- 1.2 | 5038.1 +- 5.3 | 72.4 +- 4.3 | +11616.5 +- 314.9 | -98.6 +- 0.1 | | 64b-2t1c-ethip4-ip4scale20k | 55.1 +- 2.3 | 5034.1 +- 2.8 | 70.4 +- 4.1 | +9036.3 +- 386.5 | -98.6 +- 0.1 | | 64b-2t1c-avf-eth-l2xcbase | 34.5 +- 1.8 | 5030.0 +- 4.1 | 58.6 +- 8.0 | +14479.7 +- 778.1 | -98.8 +- 0.2 | | 64b-2t1c-eth-l2patch | 34.2 +- 1.2 | 5022.8 +- 4.0 | 50.0 +- 2.0 | +14586.5 +- 528.0 | -99.0 +- 0.0 | | 64b-2t1c-avf-eth-l2patch | 24.7 +- 1.8 | 5008.8 +- 2.4 | 37.4 +- 5.8 | +20178.5 +- 1450.7 | -99.3 +- 0.1 | +--------------------------------------------------------------+---------------+-----------------+------------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 2n-clx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "6" for CSIT rls2101, "7" for CSIT rls2106). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2101.0-7 vs 2101.0-6: Compares CSIT environment current vs previous with previous VPP code. 2101.1-7 vs 2101.0-7: Compares VPP code current vs previous in the current CSIT environment.