+--------------------------------------------------------------------+----------------+---------------+----------------+----------------+-----------------------+------------------------+ | Test Case | 2110.0-9 | 2202.0-9 | 2202.0-10 | 2206.0-10 | 2202.0-10 vs 2202.0-9 | 2206.0-10 vs 2202.0-10 | +--------------------------------------------------------------------+----------------+---------------+----------------+----------------+-----------------------+------------------------+ | 64b-1t1c-ethip4ipsec1spe-ip4base-policy-outbound-nocrypto | 40.2 +- 3.71 | 34.3 +- 2.91 | 34.5 +- 12.07 | 81.5 +- 12.09 | +0.58 +- 36.2 | +136.23 +- 89.76 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 48.8 +- 2.74 | 37.1 +- 1.29 | 38.2 +- 4.78 | 78.8 +- 17.52 | +2.96 +- 13.37 | +106.28 +- 52.64 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 55.0 +- 4.14 | 36.0 +- 2.87 | 36.7 +- 11.26 | 74.9 +- 5.93 | +1.94 +- 32.33 | +104.09 +- 64.7 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 75.8 +- 2.35 | 35.8 +- 2.9 | 40.2 +- 7.3 | 81.8 +- 9.55 | +12.29 +- 22.33 | +103.48 +- 43.93 | | 64b-1t1c-ethip4-ip4base-eth-2memif-1dcr | 172.5 +- 9.37 | 54.7 +- 2.21 | 76.4 +- 9.23 | 137.5 +- 48.12 | +39.67 +- 17.79 | +79.97 +- 66.63 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 70.0 +- 4.55 | 34.4 +- 3.63 | 46.3 +- 4.72 | 66.0 +- 6.22 | +34.59 +- 19.73 | +42.55 +- 19.78 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 69.3 +- 1.64 | 32.3 +- 3.33 | 47.8 +- 4.76 | 67.1 +- 5.61 | +47.99 +- 21.22 | +40.38 +- 18.24 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 69.2 +- 1.99 | 37.6 +- 2.01 | 46.8 +- 7.38 | 65.3 +- 15.51 | +24.47 +- 20.71 | +39.53 +- 39.77 | | 64b-1t1c-eth-l2bdbasemaclrn | 45.1 +- 1.52 | 25.1 +- 1.29 | 33.7 +- 5.52 | 45.8 +- 3.08 | +34.26 +- 23.04 | +35.91 +- 24.06 | | 64b-1t1c-eth-l2bdscale10kmaclrn | 38.8 +- 1.32 | 26.8 +- 2.2 | 35.1 +- 4.23 | 47.2 +- 5.07 | +30.97 +- 19.09 | +34.47 +- 21.71 | | 64b-1t1c-eth-l2xcbase | 29.5 +- 0.53 | 23.7 +- 2.11 | 27.3 +- 8.62 | 36.6 +- 4.12 | +15.19 +- 37.77 | +34.07 +- 44.92 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 41.8 +- 3.79 | 28.6 +- 1.84 | 38.3 +- 5.48 | 51.1 +- 4.75 | +33.92 +- 21.0 | +33.42 +- 22.76 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 63.7 +- 3.23 | 35.3 +- 4.69 | 46.7 +- 6.86 | 61.4 +- 5.64 | +32.29 +- 26.22 | +31.48 +- 22.79 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 50.4 +- 2.27 | 35.6 +- 4.84 | 46.3 +- 8.55 | 59.4 +- 5.4 | +30.06 +- 29.82 | +28.29 +- 26.41 | | 64b-1t1c-ethip4ipsec100spe-cache-ip4base-policy-outbound-nocrypto | NT | 34.0 +- 3.59 | 49.2 +- 8.3 | 61.7 +- 3.43 | +44.71 +- 28.79 | +25.41 +- 22.27 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 157.8 +- 10.36 | 50.8 +- 1.99 | 61.0 +- 4.67 | 76.2 +- 5.45 | +20.08 +- 10.32 | +24.92 +- 13.09 | | 64b-1t1c-ethip4-ip4base-iacldstbase | 42.6 +- 1.65 | 33.2 +- 2.62 | 45.6 +- 4.2 | 56.4 +- 6.17 | +37.35 +- 16.64 | +23.68 +- 17.68 | | 64b-1t1c-ethip4-ip4scale200k | 33.2 +- 2.04 | 26.8 +- 2.25 | 36.9 +- 5.32 | 45.0 +- 6.75 | +37.69 +- 22.98 | +21.95 +- 25.38 | | 64b-1t1c-ethip4ipsec1000spe-ip4base-policy-outbound-nocrypto | 360.9 +- 27.12 | 386.1 +- 8.6 | 327.3 +- 64.03 | 398.1 +- 14.8 | -15.23 +- 16.69 | +21.63 +- 24.22 | | 64b-1t1c-eth-l2bdscale100kmaclrn | 39.3 +- 2.06 | 27.5 +- 1.08 | 40.5 +- 2.37 | 49.0 +- 5.42 | +47.27 +- 10.38 | +20.99 +- 15.13 | | 64b-1t1c-ethip4-ip4scale20k | 33.4 +- 2.01 | 28.8 +- 4.08 | 35.4 +- 5.02 | 42.6 +- 4.84 | +22.92 +- 24.62 | +20.34 +- 21.85 | | 64b-1t1c-ethip4ipsec1000spe-cache-ip4base-policy-outbound-nocrypto | NT | 33.6 +- 3.27 | 50.2 +- 5.39 | 59.7 +- 5.21 | +49.4 +- 21.66 | +18.92 +- 16.45 | | 64b-1t1c-eth-l2xcbase-eth-2memif-1dcr | 98.8 +- 10.22 | 54.5 +- 7.58 | 74.4 +- 10.0 | 80.3 +- 21.77 | +36.51 +- 26.4 | +7.93 +- 32.66 | | 64b-1t1c-ethip4-ip4base | 33.8 +- 2.39 | 26.9 +- 4.23 | 36.3 +- 5.85 | 38.5 +- 5.04 | +34.94 +- 30.38 | +6.06 +- 22.02 | | 64b-1t1c-af-xdp-ethip4-ip4base | 16.7 +- 0.95 | 17.4 +- 2.37 | 17.5 +- 4.12 | 18.3 +- 4.85 | +0.57 +- 27.33 | +4.57 +- 37.07 | | 78b-1t1c-ethip6-ip6scale20k | 30.9 +- 1.2 | 31.2 +- 3.08 | 45.4 +- 5.93 | 47.1 +- 2.13 | +45.51 +- 23.83 | +3.74 +- 14.34 | | 64b-1t1c-af-xdp-eth-l2bdscale10kmaclrn | 16.7 +- 0.48 | 17.0 +- 0.94 | 16.4 +- 0.52 | 17.0 +- 1.05 | -3.53 +- 6.15 | +3.66 +- 7.21 | | 64b-1t1c-af-xdp-ethip4-ip4scale20k | 16.7 +- 0.95 | 16.8 +- 0.92 | 16.4 +- 0.7 | 17.0 +- 2.21 | -2.38 +- 6.77 | +3.66 +- 14.19 | | 78b-1t1c-ethip6-ip6base | 28.0 +- 1.49 | 27.9 +- 3.78 | 35.5 +- 2.72 | 36.5 +- 5.23 | +27.24 +- 19.82 | +2.82 +- 16.71 | | 64b-1t1c-ethip4ipsec100spe-ip4base-policy-outbound-nocrypto | 61.2 +- 2.78 | 50.6 +- 1.78 | 94.7 +- 17.81 | 96.5 +- 13.8 | +87.15 +- 35.8 | +1.9 +- 24.07 | | 64b-1t1c-ethip4ipsec1spe-cache-ip4base-policy-outbound-nocrypto | NT | 35.0 +- 5.29 | 52.3 +- 5.14 | 53.2 +- 6.12 | +49.43 +- 26.95 | +1.72 +- 15.4 | | 64b-1t1c-af-xdp-ethip4-ip4scale200k | 18.5 +- 5.1 | 16.6 +- 0.52 | 16.5 +- 0.53 | 16.7 +- 0.95 | -0.6 +- 4.43 | +1.21 +- 6.6 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 47.9 +- 3.21 | 48.8 +- 5.2 | 67.0 +- 10.8 | 67.4 +- 9.14 | +37.3 +- 26.54 | +0.6 +- 21.2 | | 78b-1t1c-ethip6-ip6scale200k | 36.4 +- 2.32 | 36.5 +- 5.08 | 49.5 +- 5.8 | 49.7 +- 7.24 | +35.62 +- 24.68 | +0.4 +- 18.77 | | 64b-1t1c-af-xdp-eth-l2bdbasemaclrn | 16.4 +- 0.52 | 16.2 +- 0.42 | 16.7 +- 0.95 | 16.5 +- 0.53 | +3.09 +- 6.44 | -1.2 +- 6.44 | | 78b-1t1c-af-xdp-ethip6-ip6base | 18.0 +- 1.05 | 18.6 +- 1.26 | 17.7 +- 1.16 | 17.4 +- 0.97 | -4.84 +- 8.99 | -1.69 +- 8.44 | | 64b-1t1c-af-xdp-eth-l2bdscale100kmaclrn | 16.4 +- 1.07 | 16.5 +- 0.53 | 16.9 +- 2.02 | 16.6 +- 0.52 | +2.42 +- 12.7 | -1.78 +- 12.16 | | 64b-1t1c-af-xdp-eth-l2xcbase | 17.7 +- 5.42 | 16.3 +- 0.48 | 16.7 +- 1.64 | 16.4 +- 0.52 | +2.45 +- 10.49 | -1.8 +- 10.11 | | 64b-1t1c-eth-l2patch | 21.9 +- 1.1 | 18.2 +- 0.79 | 23.9 +- 2.88 | 23.4 +- 4.09 | +31.32 +- 16.84 | -2.09 +- 20.79 | | 78b-1t1c-af-xdp-ethip6-ip6scale20k | 18.0 +- 0.94 | 18.7 +- 1.25 | 18.1 +- 0.57 | 17.7 +- 1.06 | -3.21 +- 7.15 | -2.21 +- 6.61 | | 64b-1t1c-af-xdp-eth-l2patch | 15.0 +- 0.47 | 15.6 +- 1.35 | 16.4 +- 1.17 | 15.6 +- 0.7 | +5.13 +- 11.81 | -4.88 +- 8.03 | | 78b-1t1c-af-xdp-ethip6-ip6scale200k | 18.2 +- 1.62 | 17.9 +- 0.99 | 19.9 +- 7.17 | 17.0 +- 1.05 | +11.17 +- 40.54 | -14.57 +- 31.24 | | 78b-1t1c-ethip6-ip6base-iacldstbase | 36.1 +- 1.97 | 33.7 +- 2.75 | 62.3 +- 18.89 | 48.3 +- 3.89 | +84.87 +- 58.04 | -22.47 +- 24.32 | +--------------------------------------------------------------------+----------------+---------------+----------------+----------------+-----------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code. 2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.