+-------------------------------------------------------------------+-----------------+-----------------+-----------------+-----------------+----------------------+----------------------+ | Test Case | 2101.0-7 | 2106.0-7 | 2106.0-8 | 2110.0-8 | 2106.0-8 vs 2106.0-7 | 2110.0-8 vs 2106.0-8 | +-------------------------------------------------------------------+-----------------+-----------------+-----------------+-----------------+----------------------+----------------------+ | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 219.5 +- 11.58 | 203.1 +- 15.32 | 195.1 +- 24.82 | 222.78 +- 11.58 | -3.94 +- 14.21 | +14.19 +- 15.69 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 204.0 +- 15.26 | 181.64 +- 26.43 | 186.33 +- 27.16 | 209.9 +- 15.36 | +2.59 +- 21.13 | +12.65 +- 18.37 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 200.7 +- 16.16 | 183.09 +- 16.1 | 175.6 +- 24.96 | 197.1 +- 16.9 | -4.09 +- 16.03 | +12.24 +- 18.63 | | 64b-1t1c-eth-l2xcbase | 53.0 +- 3.57 | 48.6 +- 2.72 | 46.5 +- 4.57 | 50.1 +- 3.07 | -4.32 +- 10.81 | +7.74 +- 12.47 | | 78b-1t1c-ethip6ip6-ip6base-srv6enc1sid | 67.0 +- 5.24 | 61.6 +- 5.66 | 61.78 +- 5.74 | 64.11 +- 5.25 | +0.29 +- 13.11 | +3.78 +- 12.86 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 152.7 +- 16.39 | 132.33 +- 14.65 | 146.33 +- 24.98 | 151.5 +- 12.51 | +10.58 +- 22.5 | +3.53 +- 19.64 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 174.9 +- 25.43 | 184.0 +- 43.21 | 176.0 +- 13.99 | 179.78 +- 19.95 | -4.35 +- 23.71 | +2.15 +- 13.94 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 52.6 +- 2.41 | 48.3 +- 2.87 | 47.9 +- 2.23 | 48.6 +- 4.03 | -0.83 +- 7.49 | +1.46 +- 9.66 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 205.25 +- 21.68 | 212.55 +- 27.89 | 224.11 +- 28.2 | 226.5 +- 18.75 | +5.44 +- 19.17 | +1.07 +- 15.22 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 166.4 +- 14.24 | 164.36 +- 12.39 | 166.3 +- 14.85 | 167.9 +- 17.37 | +1.18 +- 11.82 | +0.96 +- 13.8 | | 78b-1t1c-ethip6-ip6base | 62.89 +- 12.79 | 51.64 +- 4.99 | 48.1 +- 5.04 | 48.5 +- 4.7 | -6.85 +- 13.28 | +0.83 +- 14.39 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 184.38 +- 10.35 | 161.91 +- 8.24 | 165.7 +- 9.6 | 167.0 +- 13.6 | +2.34 +- 7.89 | +0.78 +- 10.07 | | 64b-1t1c-eth-l2bdbasemaclrn | 56.78 +- 5.38 | 55.3 +- 6.09 | 53.8 +- 4.42 | 54.1 +- 5.57 | -2.71 +- 13.37 | +0.56 +- 13.24 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 55.9 +- 14.53 | 57.4 +- 5.44 | 59.78 +- 7.24 | 59.8 +- 12.87 | +4.14 +- 16.02 | +0.04 +- 24.71 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 89.33 +- 6.42 | 80.55 +- 5.48 | 80.0 +- 6.58 | 79.9 +- 5.2 | -0.68 +- 10.61 | -0.12 +- 10.47 | | 64b-1t1c-eth-l2patch | 41.7 +- 3.59 | 33.0 +- 2.19 | 35.5 +- 2.46 | 35.44 +- 1.81 | +7.58 +- 10.33 | -0.16 +- 8.6 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 149.62 +- 11.35 | 138.18 +- 19.67 | 152.4 +- 12.18 | 151.25 +- 18.77 | +10.29 +- 18.0 | -0.75 +- 14.65 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | NT | 98.36 +- 12.43 | 95.56 +- 12.54 | 94.75 +- 8.8 | -2.85 +- 17.7 | -0.84 +- 15.94 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 54.4 +- 2.76 | 48.22 +- 3.19 | 48.12 +- 2.03 | 47.7 +- 4.32 | -0.2 +- 7.84 | -0.88 +- 9.91 | | 64b-1t1c-ethip4-ip4base | 55.0 +- 4.94 | 49.55 +- 4.18 | 51.33 +- 4.3 | 50.6 +- 3.72 | +3.61 +- 12.32 | -1.43 +- 10.98 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 150.9 +- 32.17 | 178.4 +- 42.24 | 158.8 +- 12.21 | 155.9 +- 13.76 | -10.99 +- 22.16 | -1.83 +- 11.49 | | 64b-1t1c-ethip4vxlan-l2xcbase | 75.5 +- 5.66 | 69.45 +- 18.54 | 69.1 +- 19.76 | 67.7 +- 19.52 | -0.51 +- 38.91 | -2.03 +- 39.79 | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids | 78.9 +- 5.86 | 70.67 +- 3.08 | 71.6 +- 4.38 | 70.1 +- 3.93 | +1.32 +- 7.61 | -2.09 +- 8.12 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 183.0 +- 26.2 | 162.7 +- 24.12 | 169.38 +- 16.72 | 165.78 +- 14.02 | +4.1 +- 18.54 | -2.12 +- 12.72 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 52.6 +- 3.44 | 47.82 +- 3.79 | 48.78 +- 1.86 | 47.6 +- 2.99 | +2.01 +- 8.97 | -2.41 +- 7.16 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | NT | 213.73 +- 19.84 | 206.8 +- 13.52 | 201.7 +- 25.07 | -3.24 +- 10.99 | -2.47 +- 13.7 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 57.5 +- 4.38 | 47.7 +- 1.77 | 48.9 +- 1.91 | 47.4 +- 3.34 | +2.52 +- 5.52 | -3.07 +- 7.81 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | NT | 187.91 +- 27.47 | 210.7 +- 21.23 | 204.0 +- 16.95 | +12.13 +- 19.91 | -3.18 +- 12.64 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 53.88 +- 3.48 | 49.78 +- 4.55 | 50.7 +- 4.47 | 48.6 +- 2.72 | +1.85 +- 12.94 | -4.14 +- 10.01 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | NT | 108.27 +- 16.9 | 107.1 +- 17.21 | 101.9 +- 17.89 | -1.08 +- 22.16 | -4.86 +- 22.64 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 180.75 +- 21.7 | 180.0 +- 27.99 | 188.6 +- 38.3 | 179.4 +- 34.59 | +4.78 +- 26.8 | -4.88 +- 26.64 | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 54.56 +- 3.43 | 49.9 +- 3.67 | 51.8 +- 2.49 | 49.1 +- 2.6 | +3.81 +- 9.11 | -5.21 +- 6.78 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | NT | 212.3 +- 21.83 | 220.33 +- 21.67 | 208.22 +- 22.14 | +3.78 +- 14.77 | -5.5 +- 13.69 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 183.71 +- 15.77 | 168.73 +- 22.7 | 178.0 +- 18.28 | 168.2 +- 15.33 | +5.5 +- 17.86 | -5.51 +- 12.97 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 138.11 +- 20.78 | 118.09 +- 10.48 | 130.56 +- 13.63 | 123.33 +- 12.1 | +10.56 +- 15.15 | -5.53 +- 13.54 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 53.4 +- 4.09 | 50.27 +- 8.31 | 46.5 +- 4.79 | 43.78 +- 8.04 | -7.5 +- 18.01 | -5.85 +- 19.83 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 52.7 +- 4.95 | 47.6 +- 2.12 | 51.1 +- 3.93 | 47.5 +- 3.1 | +7.35 +- 9.54 | -7.05 +- 9.37 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 52.7 +- 3.2 | 51.18 +- 4.14 | 51.67 +- 3.57 | 47.8 +- 4.21 | +0.95 +- 10.74 | -7.48 +- 10.36 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | NT | 220.11 +- 31.68 | 271.56 +- 48.04 | 224.4 +- 16.55 | +23.37 +- 28.14 | -17.36 +- 15.84 | +-------------------------------------------------------------------+-----------------+-----------------+-----------------+-----------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "7" for CSIT rls2106, "8" for CSIT rls2110). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2106.0-8 vs 2106.0-7: Compares CSIT environment current vs previous with previous VPP code. 2110.0-8 vs 2106.0-8: Compares VPP code current vs previous in the current CSIT environment.