+--------------------------------------------------------------------+----------------+----------------+---------------+----------------+-----------------------+------------------------+ | Test Case | 2110.0-9 | 2202.0-9 | 2202.0-10 | 2206.0-10 | 2202.0-10 vs 2202.0-9 | 2206.0-10 vs 2202.0-10 | +--------------------------------------------------------------------+----------------+----------------+---------------+----------------+-----------------------+------------------------+ | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 26.3 +- 1.77 | 28.7 +- 8.56 | 21.6 +- 5.19 | 33.6 +- 5.66 | -24.74 +- 28.83 | +55.56 +- 45.65 | | 64b-1t1c-ethip4ipsec1000spe-ip4base-policy-outbound-nocrypto | 103.5 +- 8.42 | 101.5 +- 17.78 | 81.3 +- 18.28 | 109.0 +- 18.62 | -19.9 +- 22.83 | +34.07 +- 37.86 | | 64b-1t1c-eth-l2bdscale10kmaclrn | 22.8 +- 1.23 | 21.7 +- 3.47 | 21.2 +- 2.49 | 26.5 +- 2.99 | -2.3 +- 19.36 | +25.0 +- 20.34 | | 64b-1t1c-ethip4-ip4base-eth-2memif-1dcr | 30.9 +- 11.69 | 31.1 +- 3.7 | 33.9 +- 5.57 | 39.5 +- 6.45 | +9.0 +- 22.09 | +16.52 +- 26.98 | | 64b-1t1c-ethip4ipsec100spe-cache-ip4base-policy-outbound-nocrypto | NT | 23.0 +- 2.58 | 28.3 +- 4.72 | 32.9 +- 6.05 | +23.04 +- 24.72 | +16.25 +- 28.84 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 23.1 +- 1.45 | 30.5 +- 9.14 | 25.9 +- 4.31 | 29.3 +- 4.57 | -15.08 +- 29.11 | +13.13 +- 25.79 | | 64b-1t1c-ethip4ipsec100spe-ip4base-policy-outbound-nocrypto | 25.5 +- 3.87 | 26.9 +- 5.07 | 40.7 +- 8.08 | 45.9 +- 8.06 | +51.3 +- 41.41 | +12.78 +- 29.9 | | 64b-1t1c-ethip4ipsec1spe-ip4base-policy-outbound-nocrypto | 22.1 +- 1.73 | 24.1 +- 3.73 | 25.1 +- 4.09 | 28.3 +- 3.37 | +4.15 +- 23.41 | +12.75 +- 22.77 | | 64b-1t1c-eth-l2bdscale100kmaclrn | 22.3 +- 2.41 | 23.0 +- 1.15 | 22.4 +- 3.5 | 25.2 +- 4.24 | -2.61 +- 15.99 | +12.5 +- 25.83 | | 64b-1t1c-eth-l2xcbase | 20.0 +- 2.21 | 18.1 +- 0.99 | 20.2 +- 2.04 | 22.5 +- 2.27 | +11.6 +- 12.85 | +11.39 +- 15.93 | | 64b-1t1c-ethip4ipsec1000spe-cache-ip4base-policy-outbound-nocrypto | NT | 24.3 +- 2.26 | 28.3 +- 3.59 | 31.3 +- 7.8 | +16.46 +- 18.33 | +10.6 +- 30.94 | | 64b-1t1c-ethip4-ip4base | 20.7 +- 2.11 | 18.6 +- 1.58 | 21.8 +- 3.68 | 24.0 +- 2.58 | +17.2 +- 22.12 | +10.09 +- 22.02 | | 78b-1t1c-ethip6-ip6base-iacldstbase | 23.6 +- 2.55 | 20.6 +- 2.88 | 23.9 +- 1.79 | 26.3 +- 3.33 | +16.02 +- 18.38 | +10.04 +- 16.21 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 21.7 +- 2.21 | 20.7 +- 1.77 | 23.0 +- 1.83 | 25.0 +- 2.58 | +11.11 +- 12.95 | +8.7 +- 14.16 | | 78b-1t1c-ethip6-ip6scale200k | 23.5 +- 9.38 | 22.0 +- 2.11 | 23.5 +- 4.25 | 24.9 +- 9.75 | +6.82 +- 21.86 | +5.96 +- 45.68 | | 64b-1t1c-ethip4-ip4base-iacldstbase | 22.7 +- 2.63 | 20.9 +- 1.29 | 24.1 +- 2.56 | 25.4 +- 3.06 | +15.31 +- 14.15 | +5.39 +- 16.93 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 23.8 +- 1.75 | 31.1 +- 11.45 | 28.0 +- 9.4 | 29.5 +- 5.66 | -9.97 +- 44.86 | +5.36 +- 40.76 | | 64b-1t1c-eth-l2patch | 15.5 +- 1.43 | 16.8 +- 1.87 | 17.9 +- 0.99 | 18.8 +- 2.66 | +6.55 +- 13.28 | +5.03 +- 15.96 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 25.1 +- 3.0 | 25.1 +- 2.47 | 32.2 +- 9.11 | 33.1 +- 7.22 | +28.29 +- 38.44 | +2.8 +- 36.73 | | 64b-1t1c-af-xdp-eth-l2xcbase | 14.6 +- 0.7 | 14.6 +- 0.7 | 14.4 +- 0.52 | 14.8 +- 0.42 | -1.37 +- 5.9 | +2.78 +- 4.71 | | 64b-1t1c-af-xdp-eth-l2bdbasemaclrn | 15.1 +- 0.32 | 15.1 +- 0.32 | 15.4 +- 0.97 | 15.7 +- 1.16 | +1.99 +- 6.75 | +1.95 +- 9.88 | | 78b-1t1c-ethip6-ip6scale20k | 20.9 +- 1.45 | 21.3 +- 1.49 | 23.3 +- 2.5 | 23.7 +- 5.56 | +9.39 +- 14.01 | +1.72 +- 26.23 | | 64b-1t1c-ethip4ipsec1spe-cache-ip4base-policy-outbound-nocrypto | NT | 22.3 +- 2.0 | 27.3 +- 4.32 | 27.6 +- 8.22 | +22.42 +- 22.28 | +1.1 +- 34.11 | | 64b-1t1c-ethip4-ip4scale200k | 19.5 +- 2.46 | 20.8 +- 1.62 | 22.8 +- 2.74 | 23.0 +- 2.49 | +9.62 +- 15.7 | +0.88 +- 16.33 | | 64b-1t1c-af-xdp-ethip4-ip4base | 15.3 +- 0.48 | 15.1 +- 0.32 | 15.2 +- 0.42 | 15.3 +- 0.48 | +0.66 +- 3.5 | +0.66 +- 4.23 | | 64b-1t1c-af-xdp-ethip4-ip4scale200k | 15.2 +- 0.63 | 15.4 +- 0.7 | 15.2 +- 0.42 | 15.3 +- 0.48 | -1.3 +- 5.25 | +0.66 +- 4.23 | | 78b-1t1c-af-xdp-ethip6-ip6scale200k | 15.5 +- 0.85 | 15.2 +- 0.42 | 15.2 +- 0.63 | 15.3 +- 0.67 | +0.0 +- 5.0 | +0.66 +- 6.1 | | 64b-1t1c-eth-l2bdbasemaclrn | 20.0 +- 1.15 | 19.4 +- 0.97 | 22.3 +- 2.87 | 22.2 +- 7.38 | +14.95 +- 15.86 | -0.45 +- 35.47 | | 64b-1t1c-af-xdp-eth-l2bdscale100kmaclrn | 15.0 +- 0.0 | 15.0 +- 0.0 | 15.2 +- 0.42 | 15.1 +- 0.32 | +1.33 +- 2.81 | -0.66 +- 3.45 | | 64b-1t1c-af-xdp-ethip4-ip4scale20k | 15.2 +- 0.42 | 15.2 +- 0.42 | 15.2 +- 0.42 | 15.1 +- 0.32 | +0.0 +- 3.92 | -0.66 +- 3.45 | | 64b-1t1c-af-xdp-eth-l2bdscale10kmaclrn | 15.0 +- 0.0 | 15.5 +- 1.27 | 15.1 +- 0.32 | 15.0 +- 0.0 | -2.58 +- 8.23 | -0.66 +- 2.08 | | 64b-1t1c-ethip4-ip4scale20k | 24.1 +- 2.88 | 19.4 +- 1.65 | 22.3 +- 3.43 | 22.1 +- 2.38 | +14.95 +- 20.21 | -0.9 +- 18.62 | | 78b-1t1c-ethip6-ip6base | 18.7 +- 1.64 | 21.3 +- 1.57 | 22.2 +- 2.15 | 22.0 +- 4.35 | +4.23 +- 12.68 | -0.9 +- 21.8 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 26.1 +- 2.13 | 24.1 +- 2.28 | 28.1 +- 3.41 | 27.8 +- 7.84 | +16.6 +- 17.96 | -1.07 +- 30.39 | | 64b-1t1c-af-xdp-eth-l2patch | 14.0 +- 0.0 | 14.3 +- 0.67 | 14.3 +- 0.67 | 14.1 +- 0.32 | +0.0 +- 6.67 | -1.4 +- 5.15 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 25.1 +- 1.66 | 23.9 +- 1.66 | 26.9 +- 6.31 | 26.5 +- 11.83 | +12.55 +- 27.56 | -1.49 +- 49.67 | | 78b-1t1c-af-xdp-ethip6-ip6base | 15.7 +- 1.06 | 14.9 +- 0.32 | 15.4 +- 0.97 | 15.1 +- 0.32 | +3.36 +- 6.84 | -1.95 +- 6.48 | | 78b-1t1c-af-xdp-ethip6-ip6scale20k | 15.5 +- 0.85 | 15.2 +- 0.63 | 15.3 +- 0.67 | 15.0 +- 0.47 | +0.66 +- 6.1 | -1.96 +- 5.31 | | 64b-1t1c-eth-l2xcbase-eth-2memif-1dcr | 29.5 +- 1.84 | 28.2 +- 1.23 | 30.5 +- 2.17 | 29.6 +- 3.66 | +8.16 +- 9.03 | -2.95 +- 13.84 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 25.5 +- 4.17 | 23.3 +- 2.21 | 30.5 +- 3.6 | 28.7 +- 5.66 | +30.9 +- 19.83 | -5.9 +- 21.62 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 23.8 +- 2.35 | 23.8 +- 2.04 | 28.7 +- 3.68 | 26.7 +- 8.81 | +20.59 +- 18.62 | -6.97 +- 32.93 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 33.3 +- 3.06 | 29.1 +- 1.97 | 35.1 +- 3.9 | 32.5 +- 7.07 | +20.62 +- 15.69 | -7.41 +- 22.63 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 20.7 +- 2.5 | 32.5 +- 9.68 | 30.3 +- 7.2 | 27.5 +- 4.17 | -6.77 +- 35.51 | -9.24 +- 25.57 | +--------------------------------------------------------------------+----------------+----------------+---------------+----------------+-----------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code. 2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.