+--------------------------------------------------------------+----------------+----------------+----------------+-----------------------+------------------------+ | Test Case | 2202.0-9 | 2202.0-10 | 2206.0-10 | 2202.0-10 vs 2202.0-9 | 2206.0-10 vs 2202.0-10 | +--------------------------------------------------------------+----------------+----------------+----------------+-----------------------+------------------------+ | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 49.6 +- 0.7 | 51.1 +- 2.23 | 98.5 +- 1.35 | +3.02 +- 4.73 | +92.76 +- 8.83 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 60.2 +- 1.23 | 60.1 +- 2.92 | 110.0 +- 7.18 | -0.17 +- 5.27 | +83.03 +- 14.9 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 65.4 +- 0.84 | 69.3 +- 1.77 | 112.1 +- 8.69 | +5.96 +- 3.03 | +61.76 +- 13.19 | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 64.1 +- 2.6 | 63.8 +- 3.36 | 102.1 +- 2.08 | -0.47 +- 6.62 | +60.03 +- 9.04 | | 64b-2t1c-eth-l2bdscale100kmaclrn | 25.9 +- 0.88 | 27.0 +- 2.71 | 36.4 +- 1.17 | +4.25 +- 11.03 | +34.81 +- 14.2 | | 64b-2t1c-eth-l2bdbasemaclrn | 23.0 +- 1.33 | 24.7 +- 0.48 | 31.2 +- 1.23 | +7.39 +- 6.57 | +26.32 +- 5.56 | | 78b-2t1c-ethip6-ip6base | 24.0 +- 0.67 | 26.1 +- 1.2 | 32.8 +- 1.4 | +8.75 +- 5.83 | +25.67 +- 7.87 | | 64b-2t1c-ethip4-ip4base | 22.4 +- 0.7 | 25.0 +- 0.82 | 31.3 +- 1.06 | +11.61 +- 5.04 | +25.2 +- 5.89 | | 64b-2t1c-eth-l2bdscale1mmaclrn | 26.8 +- 0.63 | 29.6 +- 2.55 | 36.2 +- 1.03 | +10.45 +- 9.86 | +22.3 +- 11.09 | | 64b-2t1c-eth-l2xcbase | 21.6 +- 1.07 | 21.0 +- 0.67 | 25.5 +- 1.27 | -2.78 +- 5.74 | +21.43 +- 7.17 | | 64b-2t1c-eth-l2bdscale10kmaclrn | 24.2 +- 1.14 | 28.1 +- 2.13 | 34.0 +- 1.49 | +16.12 +- 10.36 | +21.0 +- 10.6 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k-rnd | 16.4 +- 1.17 | 15.0 +- 1.33 | 18.0 +- 7.09 | -8.54 +- 10.44 | +20.0 +- 48.43 | | 64b-2t1c-ethip4-ip4scale20k | 23.8 +- 1.4 | 25.7 +- 1.42 | 30.5 +- 1.84 | +7.98 +- 8.7 | +18.68 +- 9.71 | | 78b-2t1c-ethip6-ip6scale20k | 25.7 +- 0.48 | 27.6 +- 1.78 | 32.5 +- 3.54 | +7.39 +- 7.2 | +17.75 +- 14.88 | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 64.6 +- 2.72 | 73.7 +- 10.71 | 86.5 +- 4.35 | +14.09 +- 17.26 | +17.37 +- 18.05 | | 78b-2t1c-ethip6-ip6scale20k-rnd | 25.9 +- 0.74 | 28.4 +- 2.41 | 32.7 +- 1.95 | +9.65 +- 9.83 | +15.14 +- 11.94 | | 64b-2t1c-ethip4-ip4scale20k-rnd | 23.7 +- 0.95 | 25.6 +- 1.07 | 29.4 +- 1.35 | +8.02 +- 6.27 | +14.84 +- 7.15 | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 26.9 +- 2.6 | 28.8 +- 2.3 | 31.8 +- 2.35 | +7.06 +- 13.43 | +10.42 +- 12.01 | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 101.9 +- 1.66 | 120.3 +- 3.97 | 127.0 +- 6.57 | +18.06 +- 4.35 | +5.57 +- 6.48 | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 31.0 +- 0.94 | 37.3 +- 0.95 | 39.3 +- 1.64 | +20.32 +- 4.77 | +5.36 +- 5.14 | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 30.9 +- 3.41 | 38.1 +- 1.37 | 39.9 +- 0.99 | +23.3 +- 14.33 | +4.72 +- 4.58 | | 64b-2t1c-eth-l2patch | 17.4 +- 1.65 | 19.1 +- 0.57 | 19.9 +- 1.29 | +9.77 +- 10.89 | +4.19 +- 7.41 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sl-10kflows | 34.3 +- 0.67 | 41.2 +- 3.55 | 42.8 +- 3.91 | +20.12 +- 10.62 | +3.88 +- 13.05 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sf-10kflows | 31.5 +- 1.27 | 37.6 +- 5.32 | 38.9 +- 4.18 | +19.37 +- 17.55 | +3.46 +- 18.37 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1dcr | 93.9 +- 5.09 | 110.6 +- 2.17 | 114.4 +- 3.98 | +17.78 +- 6.79 | +3.44 +- 4.13 | | 64b-2t1c-avf-ethip4udp-ip4base-oacl50sf-10kflows | 31.7 +- 0.48 | 38.4 +- 1.35 | 39.7 +- 3.56 | +21.14 +- 4.64 | +3.39 +- 9.96 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 83.2 +- 11.78 | 97.0 +- 7.48 | 100.1 +- 10.73 | +16.59 +- 18.8 | +3.2 +- 13.63 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 70.4 +- 2.32 | 79.5 +- 6.47 | 82.0 +- 4.59 | +12.93 +- 9.91 | +3.14 +- 10.19 | | 78b-2t1c-avf-ethip6-ip6base | 30.0 +- 1.56 | 34.7 +- 1.34 | 35.7 +- 1.25 | +15.67 +- 7.5 | +2.88 +- 5.36 | | 64b-2t1c-avf-ethip4udp-nat44det-h1024-p63-s64512 | 26.7 +- 1.06 | 40.5 +- 5.74 | 41.5 +- 5.21 | +51.69 +- 22.32 | +2.47 +- 19.4 | | 78b-2t1c-avf-ethip6-ip6scale200k-rnd | 31.4 +- 0.97 | 36.2 +- 1.23 | 37.0 +- 3.37 | +15.29 +- 5.28 | +2.21 +- 9.93 | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 79.9 +- 2.13 | 96.2 +- 2.62 | 98.1 +- 2.56 | +20.4 +- 4.59 | +1.98 +- 3.84 | | 64b-2t1c-avf-eth-l2patch | 16.0 +- 1.49 | 16.2 +- 0.42 | 16.4 +- 0.7 | +1.25 +- 9.79 | +1.23 +- 5.06 | | 64b-2t1c-avf-ethip4-ip4scale2m-rnd | 31.6 +- 1.17 | 35.1 +- 1.52 | 35.5 +- 1.27 | +11.08 +- 6.35 | +1.14 +- 5.69 | | 64b-2t1c-avf-ethip4-ip4base | 31.0 +- 1.89 | 36.1 +- 2.73 | 36.5 +- 3.44 | +16.45 +- 11.29 | +1.11 +- 12.21 | | 64b-2t1c-avf-eth-l2xcbase | 18.9 +- 1.29 | 22.3 +- 0.48 | 22.5 +- 0.53 | +17.99 +- 8.43 | +0.9 +- 3.22 | | 78b-2t1c-af-xdp-ethip6-ip6scale20k | 15.9 +- 1.97 | 15.3 +- 2.45 | 15.4 +- 1.9 | -3.77 +- 19.49 | +0.65 +- 20.35 | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 75.1 +- 5.92 | 94.7 +- 7.72 | 95.3 +- 7.02 | +26.1 +- 14.29 | +0.63 +- 11.06 | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 28.2 +- 1.23 | 31.7 +- 2.0 | 31.8 +- 1.48 | +12.41 +- 8.63 | +0.32 +- 7.86 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k-rnd | 15.7 +- 2.71 | 16.2 +- 3.19 | 16.2 +- 3.88 | +3.18 +- 27.02 | +0.0 +- 31.01 | | 64b-2t1c-avf-ethip4-ip4scale200k | 32.0 +- 1.41 | 33.6 +- 0.7 | 33.5 +- 1.51 | +5.0 +- 5.13 | -0.3 +- 4.95 | | 64b-2t1c-avf-ethip4udp-nat44det-h65536-p63-s4128758 | 29.1 +- 3.98 | 42.78 +- 8.84 | 42.3 +- 6.18 | +47.0 +- 36.45 | -1.12 +- 25.03 | | 64b-2t1c-avf-ethip4-ip4scale20k | 31.7 +- 1.57 | 34.1 +- 1.45 | 33.7 +- 1.77 | +7.57 +- 7.01 | -1.17 +- 6.67 | | 78b-2t1c-avf-ethip6-ip6scale20k | 28.7 +- 0.67 | 33.5 +- 2.55 | 33.0 +- 1.89 | +16.72 +- 9.3 | -1.49 +- 9.37 | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 30.6 +- 2.17 | 38.9 +- 2.47 | 38.2 +- 1.87 | +27.12 +- 12.1 | -1.8 +- 7.88 | | 64b-2t1c-avf-ethip4-ip4scale2m | 34.4 +- 1.9 | 37.1 +- 2.64 | 36.4 +- 1.43 | +7.85 +- 9.72 | -1.89 +- 7.98 | | 64b-2t1c-avf-ethip4udp-nat44det-h16384-p63-s1032192 | 28.6 +- 1.07 | 38.6 +- 3.69 | 37.6 +- 5.87 | +34.97 +- 13.86 | -2.59 +- 17.83 | | 64b-2t1c-avf-ethip4-ip4scale200k-rnd | 29.6 +- 0.52 | 33.5 +- 0.85 | 32.5 +- 1.27 | +13.18 +- 3.48 | -2.99 +- 4.52 | | 64b-2t1c-avf-ethip4-ip4scale20k-rnd | 30.2 +- 1.14 | 32.9 +- 0.88 | 31.8 +- 1.03 | +8.94 +- 5.02 | -3.34 +- 4.06 | | 78b-2t1c-avf-ethip6-ip6scale20k-rnd | 29.7 +- 0.95 | 34.8 +- 1.69 | 33.2 +- 0.92 | +17.17 +- 6.8 | -4.6 +- 5.32 | | 78b-2t1c-avf-ethip6-ip6scale2m | 30.3 +- 1.77 | 34.0 +- 2.98 | 32.4 +- 2.5 | +12.21 +- 11.82 | -4.71 +- 11.14 | | 78b-2t1c-avf-ethip6-ip6scale2m-rnd | 36.4 +- 1.26 | 38.0 +- 4.19 | 35.6 +- 4.81 | +4.4 +- 12.07 | -6.32 +- 16.34 | | 64b-2t1c-avf-ethip4udp-nat44ed-h1024-p63-s64512-udir | 61.5 +- 1.35 | 73.1 +- 4.07 | 68.4 +- 7.24 | +18.86 +- 7.11 | -6.43 +- 11.2 | | 64b-2t1c-af-xdp-ethip4-ip4base | 17.5 +- 3.66 | 15.9 +- 3.63 | 14.8 +- 0.79 | -9.14 +- 28.15 | -6.92 +- 21.85 | | 78b-2t1c-avf-ethip6-ip6scale200k | 29.3 +- 1.16 | 35.2 +- 2.25 | 32.7 +- 0.95 | +20.14 +- 9.03 | -7.1 +- 6.52 | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 86.8 +- 12.87 | 102.0 +- 7.47 | 94.4 +- 4.9 | +17.51 +- 19.44 | -7.45 +- 8.31 | | 64b-2t1c-af-xdp-ethip4-ip4scale20k | 14.9 +- 1.29 | 17.5 +- 6.49 | 16.0 +- 2.0 | +17.45 +- 44.69 | -8.57 +- 35.76 | | 64b-2t1c-avf-ethip4udp-ip4base-iacl50sl-10kflows | 33.0 +- 3.02 | 42.8 +- 4.66 | 39.1 +- 4.31 | +29.7 +- 18.45 | -8.64 +- 14.15 | | 78b-2t1c-af-xdp-ethip6-ip6base | 15.3 +- 1.16 | 18.3 +- 12.21 | 15.2 +- 1.87 | +19.61 +- 80.33 | -16.94 +- 56.36 | +--------------------------------------------------------------+----------------+----------------+----------------+-----------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 2n-icx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code. 2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.