+---------------------------------------------------------------+---------------+---------------+---------------+---------------+-----------------------+------------------------+ | Test Case | 2110.0-9 | 2202.0-9 | 2202.0-10 | 2206.0-10 | 2202.0-10 vs 2202.0-9 | 2206.0-10 vs 2202.0-10 | +---------------------------------------------------------------+---------------+---------------+---------------+---------------+-----------------------+------------------------+ | 64b-2t1c-rdma-dot1q-l2bdbasemaclrn | 13.06 +- 0.34 | 12.38 +- 0.2 | 12.4 +- 0.25 | 13.28 +- 0.3 | +0.17 +- 2.57 | +7.07 +- 3.22 | | 64b-2t1c-rdma-eth-l2bdbasemaclrn | 21.2 +- 0.15 | 19.65 +- 0.35 | 19.41 +- 0.45 | 19.88 +- 0.9 | -1.2 +- 2.89 | +2.4 +- 5.21 | | 64b-2t1c-rdma-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 7.45 +- 0.18 | 6.93 +- 0.19 | 6.85 +- 0.13 | 7.0 +- 0.2 | -1.22 +- 3.22 | +2.26 +- 3.44 | | 64b-2t1c-rdma-ethip4-ip4base-eth-2memif-1dcr | 7.78 +- 0.1 | 7.96 +- 0.24 | 7.76 +- 0.2 | 7.89 +- 0.26 | -2.46 +- 3.93 | +1.62 +- 4.23 | | 64b-2t1c-rdma-ethip4udp-ip4base-oacl50sl-10kflows | 8.43 +- 0.14 | 8.51 +- 0.02 | 8.65 +- 0.15 | 8.62 +- 0.33 | +1.69 +- 1.72 | -0.3 +- 4.13 | | 64b-2t1c-rdma-eth-l2bdbasemaclrn-eth-2memif-1dcr | 9.62 +- 0.1 | 8.86 +- 0.06 | 8.82 +- 0.02 | 8.77 +- 0.02 | -0.45 +- 0.76 | -0.55 +- 0.37 | | 64b-2t1c-rdma-eth-l2patch | 37.88 +- 0.08 | 38.02 +- 0.03 | 42.47 +- 0.1 | 42.0 +- 0.12 | +11.71 +- 0.27 | -1.1 +- 0.36 | | 64b-2t1c-rdma-eth-l2xcbase-eth-2memif-1dcr | 13.56 +- 0.08 | 13.22 +- 0.3 | 13.53 +- 0.44 | 13.36 +- 0.43 | +2.31 +- 4.01 | -1.27 +- 4.5 | | 64b-2t1c-rdma-ethip4udp-ip4base-iacl50sf-10kflows | 10.06 +- 0.01 | 10.52 +- 0.01 | 10.52 +- 0.01 | 10.37 +- 0.02 | -0.06 +- 0.15 | -1.39 +- 0.25 | | 64b-2t1c-rdma-ethip4udp-ip4base-iacl50sl-10kflows | 8.54 +- 0.01 | 9.08 +- 0.14 | 9.08 +- 0.12 | 8.87 +- 0.18 | -0.06 +- 2.0 | -2.27 +- 2.33 | | 64b-2t1c-rdma-eth-l2xcbase | 30.52 +- 0.08 | 29.76 +- 0.28 | 29.74 +- 0.21 | 28.98 +- 0.08 | -0.06 +- 1.17 | -2.57 +- 0.74 | | 64b-2t1c-rdma-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 7.18 +- 0.04 | 6.83 +- 0.03 | 6.76 +- 0.01 | 6.55 +- 0.46 | -1.03 +- 0.5 | -3.06 +- 6.75 | | 64b-2t1c-rdma-ethip4-ip4scale20k-rnd | 15.49 +- 0.14 | 16.34 +- 0.09 | 16.13 +- 0.05 | 15.53 +- 0.02 | -1.28 +- 0.61 | -3.71 +- 0.3 | | 64b-2t1c-rdma-ethip4-ip4scale20k | 15.61 +- 0.14 | 16.33 +- 0.1 | 16.19 +- 0.05 | 15.54 +- 0.04 | -0.86 +- 0.66 | -3.99 +- 0.38 | | 78b-2t1c-rdma-ethip6-ip6scale20k-rnd | 13.9 +- 0.07 | 14.24 +- 0.08 | 14.08 +- 0.03 | 13.49 +- 0.27 | -1.09 +- 0.6 | -4.23 +- 1.91 | | 64b-2t1c-rdma-ethip4udp-ip4base-oacl50sf-10kflows | 9.83 +- 0.01 | 10.3 +- 0.02 | 10.3 +- 0.05 | 9.78 +- 0.02 | +0.01 +- 0.49 | -5.03 +- 0.47 | | 78b-2t1c-rdma-ethip6-ip6base | 17.12 +- 0.25 | 16.75 +- 0.23 | 17.15 +- 0.12 | 16.27 +- 0.04 | +2.39 +- 1.57 | -5.14 +- 0.71 | | 64b-2t1c-rdma-ethip4-ip4base | 17.34 +- 0.18 | 18.31 +- 0.18 | 18.22 +- 0.15 | 17.25 +- 0.05 | -0.49 +- 1.27 | -5.3 +- 0.81 | | 64b-2t1c-rdma-eth-l2bdscale10kmaclrn | 16.26 +- 0.63 | 16.44 +- 0.04 | 16.61 +- 0.18 | 15.7 +- 0.31 | +1.06 +- 1.14 | -5.52 +- 2.14 | | 64b-2t1c-rdma-eth-l2bdscale100kmaclrn | 15.34 +- 0.11 | 15.18 +- 0.07 | 14.75 +- 0.05 | 13.88 +- 0.41 | -2.8 +- 0.54 | -5.88 +- 2.78 | | 64b-2t1c-rdma-eth-l2bdscale1mmaclrn | 12.87 +- 0.15 | 13.04 +- 0.09 | 12.54 +- 0.1 | 11.77 +- 0.12 | -3.82 +- 1.02 | -6.18 +- 1.18 | | 78b-2t1c-rdma-ethip6-ip6scale20k | 13.76 +- 0.04 | 14.15 +- 0.06 | 14.0 +- 0.02 | 12.85 +- 0.46 | -1.03 +- 0.45 | -8.2 +- 3.26 | +---------------------------------------------------------------+---------------+---------------+---------------+---------------+-----------------------+------------------------+ Test Case: Test cases executed for: MRR throughput on 2n-clx with cx556a. YYMM.V-E: [Mpps +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code. 2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.