+-------------------------------------------------------------------+------------------+------------------+-------------------+-------------------+-----------------------+------------------------+ | Test Case | 2110.0-9 | 2202.0-9 | 2202.0-10 | 2206.0-10 | 2202.0-10 vs 2202.0-9 | 2206.0-10 vs 2202.0-10 | +-------------------------------------------------------------------+------------------+------------------+-------------------+-------------------+-----------------------+------------------------+ | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 418.5 +- 20.37 | 372.7 +- 17.93 | 295.11 +- 32.78 | 403.56 +- 9.76 | -20.82 +- 9.58 | +36.75 +- 15.54 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 346.22 +- 12.27 | 299.3 +- 10.56 | 254.2 +- 51.84 | 318.62 +- 18.37 | -15.07 +- 17.58 | +25.34 +- 26.57 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 366.5 +- 5.84 | 340.78 +- 9.98 | 274.0 +- 31.89 | 333.22 +- 18.53 | -19.6 +- 9.65 | +21.61 +- 15.69 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | 1369.7 +- 299.87 | 1348.9 +- 232.37 | 1445.56 +- 223.86 | 1642.56 +- 33.8 | +7.17 +- 24.82 | +13.63 +- 17.75 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | 275.4 +- 5.58 | 279.5 +- 6.98 | 281.0 +- 9.57 | 309.33 +- 11.84 | +0.54 +- 4.24 | +10.08 +- 5.64 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 580.0 +- 91.46 | 472.2 +- 42.55 | 605.5 +- 94.14 | 662.78 +- 93.93 | +28.23 +- 23.04 | +9.46 +- 23.03 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 302.6 +- 18.67 | 261.5 +- 23.91 | 232.89 +- 16.03 | 253.22 +- 13.35 | -10.94 +- 10.19 | +8.73 +- 9.43 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | 475.88 +- 43.29 | 423.33 +- 32.6 | 591.44 +- 96.57 | 641.5 +- 95.84 | +39.71 +- 25.22 | +8.46 +- 24.0 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 103.0 +- 4.77 | 110.22 +- 13.34 | 128.4 +- 20.69 | 136.11 +- 15.07 | +16.49 +- 23.48 | +6.01 +- 20.73 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 85.0 +- 5.08 | 91.5 +- 5.62 | 112.3 +- 16.36 | 118.67 +- 15.74 | +22.73 +- 19.4 | +5.67 +- 20.82 | | 64b-1t1c-eth-l2xcbase | 123.33 +- 3.04 | 107.8 +- 5.35 | 131.1 +- 11.74 | 136.56 +- 5.13 | +21.61 +- 12.45 | +4.16 +- 10.12 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 427.0 +- 42.18 | 503.1 +- 134.35 | 467.38 +- 95.63 | 484.89 +- 52.79 | -7.1 +- 31.25 | +3.75 +- 24.05 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 88.5 +- 2.84 | 94.1 +- 2.33 | 116.2 +- 15.66 | 120.38 +- 12.63 | +23.49 +- 16.92 | +3.59 +- 17.69 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 629.9 +- 70.69 | 583.5 +- 171.08 | 752.0 +- 309.41 | 768.2 +- 171.2 | +28.88 +- 65.11 | +2.15 +- 47.8 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 552.1 +- 39.38 | 601.75 +- 149.59 | 572.75 +- 99.19 | 584.62 +- 95.23 | -4.82 +- 28.84 | +2.07 +- 24.27 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 215.1 +- 3.78 | 224.12 +- 3.18 | 253.67 +- 3.77 | 256.8 +- 4.39 | +13.18 +- 2.33 | +1.24 +- 2.3 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 82.2 +- 4.8 | 91.44 +- 7.06 | 113.11 +- 16.57 | 113.33 +- 19.09 | +23.69 +- 20.48 | +0.2 +- 22.37 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | 535.67 +- 116.53 | 568.1 +- 94.62 | 553.11 +- 35.59 | 552.38 +- 36.39 | -2.64 +- 17.39 | -0.13 +- 9.2 | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids | 172.2 +- 1.81 | 192.78 +- 2.05 | 213.4 +- 26.15 | 213.11 +- 11.89 | +10.7 +- 13.62 | -0.14 +- 13.45 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 492.8 +- 47.17 | 532.11 +- 113.0 | 494.33 +- 29.23 | 491.5 +- 43.15 | -7.1 +- 20.48 | -0.57 +- 10.52 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 83.2 +- 4.39 | 94.2 +- 4.29 | 116.25 +- 12.9 | 115.44 +- 10.96 | +23.41 +- 14.81 | -0.69 +- 14.5 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 149.44 +- 2.88 | 153.56 +- 4.1 | 170.12 +- 9.45 | 168.9 +- 14.15 | +10.79 +- 6.83 | -0.72 +- 9.98 | | 64b-1t1c-ethip4vxlan-l2xcbase | 181.0 +- 1.66 | 187.7 +- 1.89 | 213.1 +- 10.31 | 211.0 +- 9.3 | +13.53 +- 5.61 | -0.99 +- 6.48 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | 556.44 +- 50.64 | 558.7 +- 93.15 | 566.5 +- 41.44 | 557.67 +- 35.93 | +1.4 +- 18.46 | -1.56 +- 9.6 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 500.11 +- 18.5 | 526.2 +- 91.22 | 653.38 +- 158.83 | 643.0 +- 130.3 | +24.17 +- 37.07 | -1.59 +- 31.15 | | 78b-1t1c-ethip6ip6-ip6base-srv6enc1sid | 165.67 +- 3.67 | 176.25 +- 4.37 | 194.44 +- 12.17 | 190.86 +- 5.43 | +10.32 +- 7.42 | -1.84 +- 6.75 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 89.8 +- 4.05 | 94.2 +- 4.37 | 122.67 +- 17.06 | 120.0 +- 11.08 | +30.22 +- 19.09 | -2.17 +- 16.33 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | 278.9 +- 8.05 | 287.7 +- 8.21 | 300.9 +- 15.58 | 292.78 +- 23.07 | +4.59 +- 6.18 | -2.7 +- 9.18 | | 64b-1t1c-eth-l2patch | 61.67 +- 4.47 | 61.67 +- 1.73 | 74.33 +- 2.92 | 72.25 +- 6.9 | +20.54 +- 5.82 | -2.8 +- 10.04 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 561.5 +- 63.8 | 494.5 +- 24.02 | 591.0 +- 103.2 | 573.29 +- 22.77 | +19.51 +- 21.66 | -3.0 +- 17.37 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 84.0 +- 5.01 | 89.11 +- 2.26 | 115.12 +- 16.07 | 111.5 +- 12.33 | +29.19 +- 18.32 | -3.15 +- 17.24 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 408.7 +- 31.99 | 509.3 +- 106.09 | 520.0 +- 113.11 | 499.75 +- 59.21 | +2.1 +- 30.75 | -3.89 +- 23.8 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 80.9 +- 18.3 | 87.6 +- 3.53 | 120.56 +- 15.32 | 115.25 +- 8.4 | +37.62 +- 18.35 | -4.4 +- 14.01 | | 64b-1t1c-ethip4-ip4base | 122.22 +- 1.86 | 135.43 +- 2.99 | 174.11 +- 8.07 | 165.71 +- 8.98 | +28.56 +- 6.6 | -4.82 +- 6.78 | | 78b-1t1c-ethip6-ip6base | 106.7 +- 4.62 | 129.6 +- 7.53 | 164.67 +- 18.04 | 151.12 +- 21.77 | +27.06 +- 15.76 | -8.22 +- 16.61 | | 64b-1t1c-eth-l2bdbasemaclrn | 129.3 +- 3.65 | 133.0 +- 1.85 | 167.88 +- 7.75 | 151.44 +- 8.82 | +26.22 +- 6.09 | -9.79 +- 6.71 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 82.78 +- 5.24 | 86.2 +- 4.94 | 128.6 +- 15.79 | 114.62 +- 15.77 | +49.19 +- 20.22 | -10.87 +- 16.44 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 395.0 +- 25.07 | 485.5 +- 117.18 | 527.2 +- 106.9 | 463.89 +- 47.98 | +8.59 +- 34.23 | -12.01 +- 20.03 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 530.62 +- 153.47 | 564.22 +- 125.06 | 675.12 +- 153.28 | 572.56 +- 115.95 | +19.66 +- 37.97 | -15.19 +- 25.8 | +-------------------------------------------------------------------+------------------+------------------+-------------------+-------------------+-----------------------+------------------------+ Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "9" for CSIT rls2202, "10" for CSIT rls2206). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2202.0-10 vs 2202.0-9: Compares CSIT environment current vs previous with previous VPP code. 2206.0-10 vs 2202.0-10: Compares VPP code current vs previous in the current CSIT environment.