+-------------------------------------------------------------------+------------------+-------------------+-------------------+------------------+----------------------+----------------------+ | Test Case | 2101.0-7 | 2106.0-7 | 2106.0-8 | 2110.0-8 | 2106.0-8 vs 2106.0-7 | 2110.0-8 vs 2106.0-8 | +-------------------------------------------------------------------+------------------+-------------------+-------------------+------------------+----------------------+----------------------+ | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 99.11 +- 6.15 | 88.3 +- 3.27 | 85.5 +- 3.1 | 239.7 +- 481.52 | -3.17 +- 5.02 | +180.35 +- 563.27 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 778.75 +- 448.71 | 473.78 +- 99.37 | 453.7 +- 88.02 | 490.3 +- 147.17 | -4.24 +- 27.36 | +8.07 +- 38.62 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128gcm | NT | 611.7 +- 88.06 | 552.56 +- 18.34 | 587.22 +- 84.04 | -9.67 +- 13.34 | +6.27 +- 15.61 | | 78b-1t1c-ethip6ip6-ip6base-srv6enc1sid | 168.56 +- 4.69 | 159.6 +- 2.59 | 157.33 +- 4.82 | 165.44 +- 1.81 | -1.42 +- 3.42 | +5.16 +- 3.42 | | 64b-1t1c-eth-l2xcbase | 112.89 +- 4.51 | 117.5 +- 3.54 | 116.38 +- 2.0 | 121.8 +- 2.74 | -0.96 +- 3.43 | +4.66 +- 2.96 | | 64b-1t1c-eth-l2patch | 81.9 +- 4.12 | 58.82 +- 2.82 | 59.6 +- 3.81 | 62.22 +- 2.59 | +1.33 +- 8.09 | +4.4 +- 7.96 | | 64b-1t1c-ethip4vxlan-l2xcbase | 185.5 +- 2.0 | 174.36 +- 2.11 | 173.3 +- 2.0 | 180.9 +- 3.31 | -0.61 +- 1.66 | +4.39 +- 2.26 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 769.25 +- 502.31 | 493.73 +- 119.71 | 640.67 +- 98.8 | 668.6 +- 117.2 | +29.76 +- 37.29 | +4.36 +- 24.36 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn | 221.67 +- 7.04 | 209.09 +- 2.59 | 208.3 +- 3.71 | 215.6 +- 3.84 | -0.38 +- 2.16 | +3.5 +- 2.61 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 103.3 +- 4.62 | 90.78 +- 3.67 | 88.5 +- 4.54 | 91.6 +- 3.63 | -2.51 +- 6.36 | +3.5 +- 6.7 | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 337.0 +- 25.94 | 306.82 +- 9.63 | 342.7 +- 6.33 | 353.5 +- 6.21 | +11.69 +- 4.07 | +3.15 +- 2.63 | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 428.12 +- 16.81 | 363.73 +- 14.66 | 413.8 +- 11.32 | 425.0 +- 16.66 | +13.77 +- 5.54 | +2.71 +- 4.91 | | 64b-1t1c-dot1q-l2bdbasemaclrn | 153.4 +- 7.4 | 144.2 +- 3.55 | 145.44 +- 6.11 | 149.2 +- 3.82 | +0.86 +- 4.91 | +2.58 +- 5.05 | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids | 181.3 +- 2.5 | 169.89 +- 1.96 | 168.7 +- 4.5 | 172.8 +- 3.16 | -0.7 +- 2.89 | +2.43 +- 3.31 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 500.12 +- 34.34 | 497.6 +- 24.39 | 520.0 +- 67.33 | 532.56 +- 47.95 | +4.5 +- 14.47 | +2.41 +- 16.15 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 100.2 +- 14.57 | 93.9 +- 5.0 | 93.1 +- 4.07 | 95.2 +- 4.16 | -0.85 +- 6.83 | +2.26 +- 6.32 | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 114.7 +- 5.58 | 106.55 +- 5.57 | 107.7 +- 8.11 | 109.56 +- 5.5 | +1.08 +- 9.27 | +1.72 +- 9.21 | | 78b-1t1c-ethip6-ip6base | 119.22 +- 3.56 | 115.64 +- 8.04 | 106.4 +- 6.45 | 108.1 +- 3.96 | -7.99 +- 8.49 | +1.6 +- 7.19 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 310.11 +- 21.74 | 273.73 +- 6.81 | 299.44 +- 11.33 | 303.44 +- 14.2 | +9.4 +- 4.95 | +1.34 +- 6.1 | | 64b-1t1c-ethip4ipsec1000tnlsw-ip4base-policy-aes256gcm | NT | 1567.78 +- 257.98 | 1516.22 +- 280.53 | 1535.2 +- 229.86 | -3.29 +- 23.95 | +1.25 +- 24.1 | | 64b-1t1c-ethip4-ip4base | 126.6 +- 8.1 | 120.64 +- 3.2 | 121.56 +- 3.81 | 123.0 +- 2.87 | +0.76 +- 4.14 | +1.19 +- 3.95 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 508.6 +- 60.77 | 491.73 +- 46.07 | 488.8 +- 66.47 | 494.2 +- 52.18 | -0.6 +- 16.42 | +1.1 +- 17.41 | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 96.8 +- 10.36 | 89.18 +- 4.09 | 88.56 +- 5.7 | 89.4 +- 5.17 | -0.7 +- 7.85 | +0.95 +- 8.74 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 373.9 +- 17.39 | 317.89 +- 7.7 | 360.44 +- 5.92 | 362.9 +- 12.91 | +13.39 +- 3.32 | +0.68 +- 3.94 | | 64b-1t1c-eth-l2bdbasemaclrn | 120.22 +- 6.1 | 128.1 +- 2.08 | 129.7 +- 4.03 | 129.7 +- 3.09 | +1.25 +- 3.55 | +0.0 +- 3.92 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 511.29 +- 30.12 | 637.0 +- 156.04 | 516.0 +- 93.51 | 515.9 +- 78.24 | -19.0 +- 24.68 | -0.02 +- 23.63 | | 64b-1t1c-ethip4ipsec40tnlsw-ip4base-policy-aes256gcm | NT | 287.0 +- 5.81 | 285.8 +- 4.57 | 284.8 +- 7.08 | -0.42 +- 2.57 | -0.35 +- 2.95 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 503.2 +- 49.91 | 575.18 +- 104.44 | 564.7 +- 113.46 | 562.5 +- 30.34 | -1.82 +- 26.59 | -0.39 +- 20.72 | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 529.1 +- 418.44 | 443.1 +- 111.91 | 395.7 +- 27.75 | 393.7 +- 20.6 | -10.7 +- 23.41 | -0.51 +- 8.71 | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 818.5 +- 651.01 | 446.91 +- 133.49 | 419.1 +- 36.52 | 413.0 +- 42.7 | -6.22 +- 29.18 | -1.46 +- 13.32 | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 95.8 +- 4.26 | 89.64 +- 6.39 | 90.33 +- 3.97 | 89.0 +- 8.06 | +0.78 +- 8.44 | -1.48 +- 9.91 | | 64b-1t1c-ethip4ipsec1tnlsw-ip4base-policy-aes256gcm | NT | 275.55 +- 7.1 | 278.22 +- 5.54 | 273.0 +- 5.45 | +0.97 +- 3.29 | -1.88 +- 2.77 | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 91.8 +- 4.37 | 84.0 +- 3.77 | 86.2 +- 4.37 | 84.5 +- 5.6 | +2.62 +- 6.95 | -1.97 +- 8.18 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 525.22 +- 46.4 | 536.0 +- 76.41 | 568.67 +- 92.03 | 548.2 +- 54.2 | +6.09 +- 22.88 | -3.6 +- 18.28 | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128gcm | NT | 451.64 +- 7.12 | 462.0 +- 37.99 | 440.0 +- 16.09 | +2.29 +- 8.56 | -4.76 +- 8.57 | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128gcm | NT | 527.73 +- 97.78 | 547.1 +- 97.32 | 521.0 +- 81.92 | +3.67 +- 26.63 | -4.77 +- 22.61 | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 100.0 +- 4.34 | 89.5 +- 4.25 | 88.8 +- 2.25 | 84.5 +- 3.72 | -0.78 +- 5.34 | -4.84 +- 4.83 | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 564.6 +- 112.38 | 604.9 +- 161.97 | 607.25 +- 186.3 | 554.22 +- 142.34 | +0.39 +- 40.88 | -8.73 +- 36.52 | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 102.25 +- 4.83 | 91.0 +- 3.43 | 92.0 +- 4.83 | 83.6 +- 5.74 | +1.1 +- 6.53 | -9.13 +- 7.85 | +-------------------------------------------------------------------+------------------+-------------------+-------------------+------------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "7" for CSIT rls2106, "8" for CSIT rls2110). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2106.0-8 vs 2106.0-7: Compares CSIT environment current vs previous with previous VPP code. 2110.0-8 vs 2106.0-8: Compares VPP code current vs previous in the current CSIT environment.