+--------------------------------------------------------------------+-----------------+------------------+-----------------+------------------+-----------------------+------------------------+ | Test Case | 2110.0-9 | 2202.0-9 | 2202.0-10 | 2206.0-10 | 2202.0-10 vs 2202.0-9 | 2206.0-10 vs 2202.0-10 | +--------------------------------------------------------------------+-----------------+------------------+-----------------+------------------+-----------------------+------------------------+ | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 118.6 +- 5.46 | 87.7 +- 11.81 | 122.8 +- 10.69 | 339.8 +- 302.95 | +40.02 +- 22.46 | +176.71 +- 247.88 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 93.9 +- 11.47 | 77.8 +- 13.25 | 107.1 +- 21.3 | 286.3 +- 268.38 | +37.66 +- 36.05 | +167.32 +- 256.17 | | 64b-1t1c-ethip4-ip4scale200k | 76.9 +- 5.2 | 382.0 +- 509.25 | 93.5 +- 8.76 | 189.8 +- 232.1 | -75.52 +- 32.71 | +102.99 +- 248.96 | | 64b-1t1c-ethip4ipsec1000spe-ip4base-policy-outbound-nocrypto | 824.7 +- 38.32 | 1040.1 +- 548.71 | 718.6 +- 154.7 | 1446.9 +- 488.56 | -30.91 +- 39.37 | +101.35 +- 80.63 | | 64b-1t1c-ethip4-ip4base-iacldstbase | 269.2 +- 368.07 | 85.9 +- 9.23 | 102.9 +- 9.07 | 201.4 +- 172.05 | +19.79 +- 16.65 | +95.72 +- 168.09 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 132.9 +- 3.75 | 202.9 +- 373.63 | 116.2 +- 12.95 | 223.3 +- 226.36 | -42.73 +- 105.65 | +92.17 +- 195.98 | | 78b-1t1c-ethip6-ip6base-iacldstbase | 84.9 +- 5.67 | 171.9 +- 282.28 | 102.4 +- 14.13 | 184.8 +- 179.27 | -40.43 +- 98.16 | +80.47 +- 176.83 | | 64b-1t1c-ethip4ipsec100spe-cache-ip4base-policy-outbound-nocrypto | NT | 88.1 +- 6.19 | 122.3 +- 19.01 | 199.9 +- 194.51 | +38.82 +- 23.69 | +63.45 +- 161.06 | | 64b-1t1c-ethip4ipsec1spe-ip4base-policy-outbound-nocrypto | 179.6 +- 270.79 | 78.5 +- 9.05 | 103.3 +- 9.66 | 156.9 +- 37.39 | +31.59 +- 19.53 | +51.89 +- 38.88 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 123.3 +- 16.63 | 116.7 +- 18.37 | 160.1 +- 23.93 | 240.7 +- 225.26 | +37.19 +- 29.78 | +50.34 +- 142.48 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 222.3 +- 309.33 | 82.3 +- 15.1 | 113.3 +- 10.42 | 162.0 +- 19.07 | +37.67 +- 28.26 | +42.98 +- 21.36 | | 64b-1t1c-af-xdp-ethip4-ip4scale200k | 169.3 +- 103.68 | 136.1 +- 3.57 | 105.3 +- 46.89 | 144.2 +- 84.15 | -22.63 +- 34.51 | +36.94 +- 100.52 | | 64b-1t1c-af-xdp-eth-l2bdbasemaclrn | 127.2 +- 29.34 | 132.4 +- 8.19 | 122.7 +- 34.89 | 150.3 +- 52.69 | -7.33 +- 26.97 | +22.49 +- 55.29 | | 64b-1t1c-ethip4ipsec100spe-ip4base-policy-outbound-nocrypto | 233.1 +- 294.97 | 235.9 +- 345.8 | 245.1 +- 62.99 | 287.7 +- 224.42 | +3.9 +- 154.63 | +17.38 +- 96.4 | | 78b-1t1c-ethip6-ip6scale20k | 75.5 +- 3.06 | 185.3 +- 326.7 | 108.9 +- 13.84 | 121.8 +- 17.96 | -41.23 +- 103.88 | +11.85 +- 21.77 | | 78b-1t1c-af-xdp-ethip6-ip6base | 167.0 +- 99.54 | 135.1 +- 3.38 | 116.1 +- 40.23 | 129.8 +- 16.96 | -14.06 +- 29.86 | +11.8 +- 41.4 | | 64b-1t1c-eth-l2patch | 46.0 +- 4.57 | 45.0 +- 5.56 | 61.9 +- 7.69 | 64.8 +- 7.73 | +37.56 +- 24.1 | +4.68 +- 18.03 | | 64b-1t1c-ethip4ipsec1spe-cache-ip4base-policy-outbound-nocrypto | NT | 90.3 +- 10.09 | 130.8 +- 14.64 | 129.9 +- 24.82 | +44.85 +- 22.91 | -0.69 +- 21.99 | | 78b-1t1c-af-xdp-ethip6-ip6scale20k | 162.1 +- 80.62 | 144.1 +- 66.33 | 127.0 +- 29.2 | 125.0 +- 32.8 | -11.87 +- 45.35 | -1.57 +- 34.34 | | 64b-1t1c-ethip4-ip4base-eth-2memif-1dcr | 366.0 +- 321.22 | 118.4 +- 6.13 | 293.2 +- 357.49 | 280.9 +- 93.22 | +147.64 +- 302.2 | -4.2 +- 121.06 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 112.2 +- 6.88 | 192.1 +- 333.83 | 223.0 +- 320.3 | 213.2 +- 203.75 | +16.09 +- 261.72 | -4.39 +- 164.94 | | 64b-1t1c-af-xdp-eth-l2bdscale10kmaclrn | 153.0 +- 58.73 | 157.8 +- 67.74 | 133.3 +- 0.95 | 127.2 +- 24.72 | -15.53 +- 36.27 | -4.58 +- 18.55 | | 64b-1t1c-ethip4ipsec1000spe-cache-ip4base-policy-outbound-nocrypto | NT | 86.8 +- 10.18 | 217.4 +- 307.04 | 198.9 +- 188.64 | +150.46 +- 354.95 | -8.51 +- 155.64 | | 64b-1t1c-af-xdp-eth-l2bdscale100kmaclrn | 113.1 +- 43.76 | 160.6 +- 80.97 | 124.3 +- 35.04 | 113.6 +- 45.49 | -22.6 +- 44.71 | -8.61 +- 44.75 | | 64b-1t1c-af-xdp-ethip4-ip4base | 161.6 +- 75.73 | 154.8 +- 59.5 | 162.0 +- 98.36 | 146.5 +- 36.03 | +4.65 +- 75.2 | -9.57 +- 59.24 | | 64b-1t1c-af-xdp-ethip4-ip4scale20k | 126.7 +- 26.65 | 136.5 +- 2.37 | 140.9 +- 61.23 | 124.3 +- 34.29 | +3.22 +- 44.9 | -11.78 +- 45.41 | | 64b-1t1c-af-xdp-eth-l2patch | 149.0 +- 51.41 | 132.6 +- 3.03 | 158.0 +- 79.8 | 132.9 +- 3.0 | +19.16 +- 60.24 | -15.89 +- 42.53 | | 64b-1t1c-af-xdp-eth-l2xcbase | 193.5 +- 105.16 | 161.1 +- 84.31 | 160.5 +- 82.06 | 132.7 +- 2.16 | -0.37 +- 72.89 | -17.32 +- 42.29 | | 78b-1t1c-ethip6-ip6base | 221.7 +- 332.71 | 252.9 +- 384.57 | 187.0 +- 291.32 | 143.8 +- 174.15 | -26.06 +- 160.97 | -23.1 +- 151.73 | | 64b-1t1c-eth-l2xcbase-eth-2memif-1dcr | 173.7 +- 12.29 | 233.7 +- 328.11 | 283.4 +- 341.91 | 199.5 +- 48.9 | +21.27 +- 224.48 | -29.6 +- 86.66 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 344.8 +- 410.43 | 84.3 +- 4.5 | 235.7 +- 400.08 | 160.8 +- 27.88 | +179.6 +- 474.83 | -31.78 +- 116.4 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 215.2 +- 291.8 | 203.5 +- 364.97 | 232.4 +- 371.09 | 157.0 +- 38.09 | +14.2 +- 274.23 | -32.44 +- 109.11 | | 78b-1t1c-ethip6-ip6scale200k | 94.1 +- 6.85 | 100.4 +- 10.21 | 243.0 +- 353.7 | 147.4 +- 30.07 | +142.03 +- 353.15 | -39.34 +- 89.15 | | 64b-1t1c-eth-l2bdscale100kmaclrn | 89.1 +- 3.63 | 74.9 +- 6.35 | 203.2 +- 329.97 | 120.0 +- 21.78 | +171.3 +- 441.14 | -40.94 +- 96.49 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 152.0 +- 44.08 | 204.4 +- 378.31 | 234.6 +- 389.28 | 137.4 +- 32.98 | +14.77 +- 285.3 | -41.43 +- 98.19 | | 64b-1t1c-eth-l2bdscale10kmaclrn | 85.2 +- 2.1 | 68.8 +- 5.41 | 196.7 +- 331.69 | 114.1 +- 8.17 | +185.9 +- 482.63 | -41.99 +- 97.9 | | 64b-1t1c-eth-l2bdbasemaclrn | 90.5 +- 3.34 | 62.6 +- 4.77 | 174.3 +- 282.89 | 99.5 +- 9.23 | +178.43 +- 452.41 | -42.91 +- 92.8 | | 64b-1t1c-ethip4-ip4scale20k | 153.1 +- 245.62 | 68.5 +- 10.31 | 184.4 +- 305.73 | 99.0 +- 16.47 | +169.2 +- 448.15 | -46.31 +- 89.46 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 295.9 +- 349.87 | 207.2 +- 367.04 | 536.6 +- 536.28 | 271.9 +- 258.37 | +158.98 +- 526.73 | -49.33 +- 69.88 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2memif-1dcr | 260.6 +- 42.85 | 249.3 +- 355.29 | 369.0 +- 498.63 | 182.3 +- 38.86 | +48.01 +- 290.69 | -50.6 +- 67.58 | | 78b-1t1c-af-xdp-ethip6-ip6scale200k | 133.8 +- 2.82 | 134.9 +- 2.08 | 212.9 +- 127.52 | 104.8 +- 44.08 | +57.82 +- 94.56 | -50.78 +- 36.03 | | 64b-1t1c-eth-l2xcbase | 222.6 +- 339.03 | 56.5 +- 4.74 | 250.2 +- 397.69 | 93.8 +- 8.53 | +342.83 +- 704.85 | -62.51 +- 59.69 | | 64b-1t1c-ethip4-ip4base | 74.8 +- 6.49 | 238.7 +- 367.56 | 277.1 +- 403.62 | 101.6 +- 6.64 | +16.09 +- 246.06 | -63.33 +- 53.46 | +--------------------------------------------------------------------+-----------------+------------------+-----------------+------------------+-----------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 2n-tx2 with xl710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code. 2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.