+--------------------------------------------------------------------+-----------------+------------------+-------------------+------------------------+ | Test Case | 2202.0-10 | 2206.0-10 | 2210.0-11 | 2210.0-11 vs 2206.0-10 | +--------------------------------------------------------------------+-----------------+------------------+-------------------+------------------------+ | 64b-1t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 369.0 +- 498.63 | 182.3 +- 38.86 | 1242.7 +- 3149.51 | +581.68 +- 1733.75 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 116.2 +- 12.95 | 223.3 +- 226.36 | 1386.5 +- 3742.93 | +520.91 +- 1790.47 | | 64b-1t1c-eth-l2bdscale10kmaclrn | 196.7 +- 331.69 | 114.1 +- 8.17 | 640.7 +- 1257.92 | +461.52 +- 1103.21 | | 64b-1t1c-ethip4-ip4scale200k | 93.5 +- 8.76 | 189.8 +- 232.1 | 982.3 +- 2591.59 | +417.54 +- 1504.97 | | 78b-1t1c-ethip6-ip6base-iacldstbase | 102.4 +- 14.13 | 184.8 +- 179.27 | 833.3 +- 2150.28 | +350.92 +- 1243.08 | | 64b-1t1c-ethip4-ip4base-iacldstbase | 102.9 +- 9.07 | 201.4 +- 172.05 | 772.9 +- 1557.31 | +283.76 +- 839.87 | | 64b-1t1c-eth-l2xcbase | 250.2 +- 397.69 | 93.8 +- 8.53 | 294.4 +- 387.85 | +213.86 +- 414.47 | | 64b-1t1c-eth-l2patch | 61.9 +- 7.69 | 64.8 +- 7.73 | 167.0 +- 300.16 | +157.72 +- 464.23 | | 64b-1t1c-ethip4ipsec1spe-cache-ip4base-policy-outbound-nocrypto | 130.8 +- 14.64 | 129.9 +- 24.82 | 284.6 +- 323.45 | +119.09 +- 252.49 | | 78b-1t1c-af-xdp-ethip6-ip6scale20k | 127.0 +- 29.2 | 125.0 +- 32.8 | 251.0 +- 186.5 | +100.8 +- 158.23 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 235.7 +- 400.08 | 160.8 +- 27.88 | 310.7 +- 276.83 | +93.22 +- 175.39 | | 64b-1t1c-af-xdp-ethip4-ip4scale20k | 140.9 +- 61.23 | 124.3 +- 34.29 | 239.7 +- 147.54 | +92.84 +- 130.07 | | 78b-1t1c-ethip6-ip6scale200k | 243.0 +- 353.7 | 147.4 +- 30.07 | 279.6 +- 316.96 | +89.69 +- 218.49 | | 64b-1t1c-af-xdp-eth-l2bdscale100kmaclrn | 124.3 +- 35.04 | 113.6 +- 45.49 | 207.6 +- 136.48 | +82.75 +- 140.67 | | 64b-1t1c-ethip4-ip4base-eth-2memif-1dcr | 293.2 +- 357.49 | 280.9 +- 93.22 | 501.8 +- 157.64 | +78.64 +- 81.63 | | 64b-1t1c-ethip4ipsec1spe-ip4base-policy-outbound-nocrypto | 103.3 +- 9.66 | 156.9 +- 37.39 | 260.0 +- 324.08 | +65.71 +- 210.29 | | 64b-1t1c-ethip4ipsec1000spe-ip4base-policy-outbound-nocrypto | 718.6 +- 154.7 | 1446.9 +- 488.56 | 2219.1 +- 3070.81 | +53.37 +- 218.46 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 234.6 +- 389.28 | 137.4 +- 32.98 | 208.2 +- 18.1 | +51.53 +- 38.68 | | 64b-1t1c-af-xdp-eth-l2bdscale10kmaclrn | 133.3 +- 0.95 | 127.2 +- 24.72 | 191.2 +- 148.01 | +50.31 +- 119.97 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 160.1 +- 23.93 | 240.7 +- 225.26 | 359.6 +- 346.58 | +49.4 +- 200.7 | | 64b-1t1c-af-xdp-eth-l2xcbase | 160.5 +- 82.06 | 132.7 +- 2.16 | 191.3 +- 167.9 | +44.16 +- 126.55 | | 64b-1t1c-ethip4-ip4scale20k | 184.4 +- 305.73 | 99.0 +- 16.47 | 140.9 +- 26.15 | +42.32 +- 35.47 | | 78b-1t1c-af-xdp-ethip6-ip6scale200k | 212.9 +- 127.52 | 104.8 +- 44.08 | 146.9 +- 46.5 | +40.17 +- 73.79 | | 78b-1t1c-af-xdp-ethip6-ip6base | 116.1 +- 40.23 | 129.8 +- 16.96 | 177.9 +- 156.32 | +37.06 +- 121.75 | | 64b-1t1c-eth-l2bdbasemaclrn | 174.3 +- 282.89 | 99.5 +- 9.23 | 130.0 +- 17.22 | +30.65 +- 21.13 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 232.4 +- 371.09 | 157.0 +- 38.09 | 202.5 +- 30.37 | +28.98 +- 36.79 | | 78b-1t1c-ethip6-ip6scale20k | 108.9 +- 13.84 | 121.8 +- 17.96 | 156.6 +- 36.4 | +28.57 +- 35.39 | | 64b-1t1c-eth-l2bdscale100kmaclrn | 203.2 +- 329.97 | 120.0 +- 21.78 | 149.9 +- 18.64 | +24.92 +- 27.48 | | 64b-1t1c-ethip4-ip4base | 277.1 +- 403.62 | 101.6 +- 6.64 | 126.0 +- 11.9 | +24.02 +- 14.24 | | 64b-1t1c-af-xdp-eth-l2bdbasemaclrn | 122.7 +- 34.89 | 150.3 +- 52.69 | 182.0 +- 152.44 | +21.09 +- 109.95 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 113.3 +- 10.42 | 162.0 +- 19.07 | 184.8 +- 32.2 | +14.07 +- 23.98 | | 64b-1t1c-eth-l2xcbase-eth-2memif-1dcr | 283.4 +- 341.91 | 199.5 +- 48.9 | 224.7 +- 53.39 | +12.63 +- 38.45 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 536.6 +- 536.28 | 271.9 +- 258.37 | 298.7 +- 330.3 | +9.86 +- 160.17 | | 64b-1t1c-ethip4ipsec100spe-ip4base-policy-outbound-nocrypto | 245.1 +- 62.99 | 287.7 +- 224.42 | 296.6 +- 33.65 | +3.09 +- 81.26 | | 64b-1t1c-af-xdp-eth-l2patch | 158.0 +- 79.8 | 132.9 +- 3.0 | 134.0 +- 48.51 | +0.83 +- 36.57 | | 64b-1t1c-af-xdp-ethip4-ip4base | 162.0 +- 98.36 | 146.5 +- 36.03 | 144.6 +- 43.46 | -1.3 +- 38.33 | | 64b-1t1c-ethip4ipsec100spe-cache-ip4base-policy-outbound-nocrypto | 122.3 +- 19.01 | 199.9 +- 194.51 | 193.6 +- 56.73 | -3.15 +- 98.42 | | 64b-1t1c-ethip4ipsec1000spe-cache-ip4base-policy-outbound-nocrypto | 217.4 +- 307.04 | 198.9 +- 188.64 | 184.1 +- 43.38 | -7.44 +- 90.45 | | 78b-1t1c-ethip6-ip6base | 187.0 +- 291.32 | 143.8 +- 174.15 | 129.3 +- 24.06 | -10.08 +- 110.17 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 223.0 +- 320.3 | 213.2 +- 203.75 | 191.2 +- 23.8 | -10.32 +- 86.43 | | 64b-1t1c-af-xdp-ethip4-ip4scale200k | 105.3 +- 46.89 | 144.2 +- 84.15 | 127.4 +- 67.78 | -11.65 +- 69.77 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 122.8 +- 10.69 | 339.8 +- 302.95 | 293.9 +- 326.87 | -13.51 +- 123.29 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 107.1 +- 21.3 | 286.3 +- 268.38 | 176.1 +- 23.6 | -38.49 +- 58.25 | +--------------------------------------------------------------------+-----------------+------------------+-------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "10" for CSIT rls2206, "11" for CSIT rls2210). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2210.0-11 vs 2206.0-10: Compares current VPP code in the current CSIT environment vs previous VPP code in the previous CSIT environment.