+-------------------------------------------------------------------+---------------+---------------+--------------+----------------------+----------------------+ | Test Case | 2101.0-6 | 2101.0-7 | 2101.1-7 | 2101.0-7 vs 2101.0-6 | 2101.1-7 vs 2101.0-7 | +-------------------------------------------------------------------+---------------+---------------+--------------+----------------------+----------------------+ | 64b-1t1c-dot1q-l2bdbasemaclrn | 55.9 +- 14.5 | 55.9 +- 14.5 | 96.0 +- NaN | +0.0 +- 36.7 | +71.7 +- NaN | | 64b-1t1c-ethip4-ip4scale200k | 49.4 +- 14.1 | 49.4 +- 14.1 | 66.0 +- NaN | +0.0 +- 40.4 | +33.5 +- NaN | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 150.9 +- 32.2 | 150.9 +- 32.2 | 199.0 +- NaN | +0.0 +- 30.2 | +31.9 +- NaN | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 200.7 +- 16.2 | 200.7 +- 16.2 | 249.0 +- NaN | +0.0 +- 11.4 | +24.1 +- NaN | | 1518b-1t1c-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 183.0 +- 26.2 | 183.0 +- 26.2 | 208.0 +- NaN | +0.0 +- 20.2 | +13.7 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn | 56.8 +- 5.4 | 56.8 +- 5.4 | 61.0 +- NaN | +0.0 +- 13.4 | +7.4 +- NaN | | 78b-1t1c-ethip6-ip6base | 62.9 +- 12.8 | 62.9 +- 12.8 | 66.0 +- NaN | +0.0 +- 28.8 | +4.9 +- NaN | | 64b-1t1c-ethip4-ip4base | 55.0 +- 4.9 | 55.0 +- 4.9 | 57.0 +- NaN | +0.0 +- 12.7 | +3.6 +- NaN | | 64b-1t1c-eth-l2patch | 41.7 +- 3.6 | 41.7 +- 3.6 | 43.0 +- NaN | +0.0 +- 12.2 | +3.1 +- NaN | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 166.4 +- 14.2 | 166.4 +- 14.2 | 171.0 +- NaN | +0.0 +- 12.1 | +2.8 +- NaN | | 64b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 205.2 +- 21.7 | 205.2 +- 21.7 | 207.0 +- NaN | +0.0 +- 14.9 | +0.9 +- NaN | | 78b-1t1c-ethip6srhip6-ip6base-srv6proxy-dyn | 107.9 +- 13.5 | 107.9 +- 13.5 | 108.0 +- NaN | +0.0 +- 17.7 | +0.1 +- NaN | | 64b-1t1c-ethip4-ip4scale20k | 57.8 +- 9.7 | 57.8 +- 9.7 | 57.0 +- NaN | +0.0 +- 23.8 | -1.4 +- NaN | | 1518b-1t1c-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 204.0 +- 15.3 | 204.0 +- 15.3 | 199.0 +- NaN | +0.0 +- 10.6 | -2.5 +- NaN | | 64b-1t1c-eth-l2bdscale10kmaclrn | 58.5 +- 12.8 | 58.5 +- 12.8 | 57.0 +- NaN | +0.0 +- 31.0 | -2.6 +- NaN | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids-nodecaps | 78.2 +- 11.1 | 78.2 +- 11.1 | 76.0 +- NaN | +0.0 +- 20.0 | -2.8 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 149.6 +- 11.4 | 149.6 +- 11.4 | 144.0 +- NaN | +0.0 +- 10.7 | -3.8 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows | 53.4 +- 4.1 | 53.4 +- 4.1 | 51.0 +- NaN | +0.0 +- 10.8 | -4.5 +- NaN | | 64b-1t1c-eth-l2xcbase | 53.0 +- 3.6 | 53.0 +- 3.6 | 50.0 +- NaN | +0.0 +- 9.5 | -5.7 +- NaN | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 219.5 +- 11.6 | 219.5 +- 11.6 | 207.0 +- NaN | +0.0 +- 7.5 | -5.7 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows | 54.4 +- 2.8 | 54.4 +- 2.8 | 51.0 +- NaN | +0.0 +- 7.2 | -6.2 +- NaN | | 64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 138.1 +- 20.8 | 138.1 +- 20.8 | 127.0 +- NaN | +0.0 +- 21.3 | -8.0 +- NaN | | 64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows | 54.6 +- 3.4 | 54.6 +- 3.4 | 50.0 +- NaN | +0.0 +- 8.9 | -8.4 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sf-10kflows | 52.6 +- 3.4 | 52.6 +- 3.4 | 48.0 +- NaN | +0.0 +- 9.2 | -8.7 +- NaN | | 64b-1t1c-ethip4-ip4base-eth-2memif-1dcr | 136.2 +- 7.5 | 136.2 +- 7.5 | 124.0 +- NaN | +0.0 +- 7.8 | -9.0 +- NaN | | 1518b-1t1c-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 183.7 +- 15.8 | 183.7 +- 15.8 | 165.0 +- NaN | +0.0 +- 12.1 | -10.2 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-iacl50sl-10kflows | 52.6 +- 2.4 | 52.6 +- 2.4 | 47.0 +- NaN | +0.0 +- 6.5 | -10.6 +- NaN | | 64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows | 53.9 +- 3.5 | 53.9 +- 3.5 | 48.0 +- NaN | +0.0 +- 9.1 | -10.9 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2memif-1lxc | 141.6 +- 7.7 | 141.6 +- 7.7 | 125.0 +- NaN | +0.0 +- 7.7 | -11.7 +- NaN | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 152.7 +- 16.4 | 152.7 +- 16.4 | 129.0 +- NaN | +0.0 +- 15.2 | -15.5 +- NaN | | 64b-1t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 174.9 +- 25.4 | 174.9 +- 25.4 | 147.0 +- NaN | +0.0 +- 20.6 | -16.0 +- NaN | | 78b-1t1c-ethip6-ip6scale20k | 58.4 +- 8.2 | 58.4 +- 8.2 | 49.0 +- NaN | +0.0 +- 19.9 | -16.1 +- NaN | | 64b-1t1c-eth-l2xcbase-eth-2memif-1lxc | 116.8 +- 6.2 | 116.8 +- 6.2 | 98.0 +- NaN | +0.0 +- 7.5 | -16.1 +- NaN | | 78b-1t1c-ethip6srhip6-ip6base-srv6proxy-masq | 118.1 +- 7.3 | 118.1 +- 7.3 | 99.0 +- NaN | +0.0 +- 8.7 | -16.2 +- NaN | | 64b-1t1c-ethip4udp-ip4base-iacl50sf-10kflows | 52.7 +- 4.9 | 52.7 +- 4.9 | 44.0 +- NaN | +0.0 +- 13.3 | -16.5 +- NaN | | 64b-1t1c-ethip4udp-ip4base-iacl50sl-10kflows | 52.7 +- 3.2 | 52.7 +- 3.2 | 44.0 +- NaN | +0.0 +- 8.6 | -16.5 +- NaN | | 64b-1t1c-eth-l2xcbase-eth-2memif-1dcr | 112.9 +- 7.0 | 112.9 +- 7.0 | 94.0 +- NaN | +0.0 +- 8.7 | -16.7 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 180.8 +- 21.7 | 180.8 +- 21.7 | 148.0 +- NaN | +0.0 +- 17.0 | -18.1 +- NaN | | 78b-1t1c-ethip6ip6-ip6base-srv6enc1sid | 67.0 +- 5.2 | 67.0 +- 5.2 | 54.0 +- NaN | +0.0 +- 11.1 | -19.4 +- NaN | | 78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids | 78.9 +- 5.9 | 78.9 +- 5.9 | 63.0 +- NaN | +0.0 +- 10.5 | -20.2 +- NaN | | 64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows | 57.5 +- 4.4 | 57.5 +- 4.4 | 45.0 +- NaN | +0.0 +- 10.8 | -21.7 +- NaN | | 78b-1t1c-ethip6-ip6scale200k | 75.1 +- 13.1 | 75.1 +- 13.1 | 58.0 +- NaN | +0.0 +- 24.6 | -22.8 +- NaN | | 64b-1t1c-eth-l2bdscale1mmaclrn | 67.5 +- 8.0 | 67.5 +- 8.0 | 50.0 +- NaN | +0.0 +- 16.8 | -25.9 +- NaN | | 64b-1t1c-ethip4vxlan-l2xcbase | 75.5 +- 5.7 | 75.5 +- 5.7 | 48.0 +- NaN | +0.0 +- 10.6 | -36.4 +- NaN | | 64b-1t1c-ethip4-ip4scale2m | 49.9 +- 14.7 | 49.9 +- 14.7 | 27.0 +- NaN | +0.0 +- 41.5 | -45.9 +- NaN | +-------------------------------------------------------------------+---------------+---------------+--------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 3n-tsh with x520. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "6" for CSIT rls2101, "7" for CSIT rls2106). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2101.0-7 vs 2101.0-6: Compares CSIT environment current vs previous with previous VPP code. 2101.1-7 vs 2101.0-7: Compares VPP code current vs previous in the current CSIT environment.