+-----------------------------------------------------------------------+---------------+---------------+--------------+----------------------+----------------------+ | Test Case | 2101.0-6 | 2101.0-7 | 2106.0-7 | 2101.0-7 vs 2101.0-6 | 2106.0-7 vs 2101.0-7 | +-----------------------------------------------------------------------+---------------+---------------+--------------+----------------------+----------------------+ | 1518b-2t1c-avf-ethip4ipsec1000tnlsw-ip4base-int-aes256gcm | 96.0 +- 13.8 | 65.0 +- 8.2 | 131.0 +- NaN | -32.3 +- 13.0 | +101.5 +- NaN | | 1518b-2t1c-avf-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 86.3 +- 19.8 | 74.1 +- 10.4 | 131.0 +- NaN | -14.1 +- 23.1 | +76.8 +- NaN | | 1518b-2t1c-avf-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 87.5 +- 11.2 | 68.0 +- 10.3 | 113.0 +- NaN | -22.3 +- 15.4 | +66.2 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale2m | 30.6 +- 2.7 | 34.3 +- 3.5 | 43.0 +- NaN | +12.1 +- 15.0 | +25.4 +- NaN | | 1518b-2t1c-ethip4ipsec10000tnlsw-ip4base-int-aes256gcm | 126.5 +- 28.7 | 92.6 +- 11.9 | 116.0 +- NaN | -26.8 +- 19.1 | +25.3 +- NaN | | 64b-2t1c-avf-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 84.4 +- 18.5 | 92.3 +- 6.6 | 109.0 +- NaN | +9.4 +- 25.2 | +18.1 +- NaN | | 64b-2t1c-ethip4-ip4scale2m | 33.5 +- 2.6 | 31.8 +- 3.5 | 37.0 +- NaN | -5.1 +- 12.7 | +16.4 +- NaN | | 64b-2t1c-avf-ethip4-ip4base-eth-2vhostvr1024-1vm | 76.0 +- 5.1 | 80.9 +- 3.1 | 94.0 +- NaN | +6.4 +- 8.2 | +16.2 +- NaN | | 1518b-2t1c-avf-ethip4ipsec10000tnlsw-ip4base-int-aes128cbc-hmac512sha | 225.0 +- 39.8 | 199.2 +- 9.2 | 229.0 +- NaN | -11.5 +- 16.2 | +15.0 +- NaN | | 1518b-2t1c-ethip4ipsec4tnlsw-ip4base-int-aes256gcm | 89.4 +- 14.4 | 75.0 +- 12.7 | 86.0 +- NaN | -16.1 +- 19.6 | +14.7 +- NaN | | 1518b-2t1c-avf-ethip4ipsec1000tnlsw-ip4base-int-aes128cbc-hmac512sha | 223.8 +- 45.4 | 180.9 +- 26.0 | 207.0 +- NaN | -19.2 +- 20.1 | +14.4 +- NaN | | 1518b-2t1c-avf-ethip4ipsec4tnlsw-ip4base-int-aes128cbc-hmac512sha | 233.4 +- 28.4 | 174.1 +- 24.2 | 199.0 +- NaN | -25.4 +- 13.8 | +14.3 +- NaN | | 78b-2t1c-avf-ethip6-ip6base | 28.2 +- 0.6 | 30.3 +- 1.9 | 34.0 +- NaN | +7.4 +- 7.1 | +12.2 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale20k | 28.3 +- 0.7 | 32.3 +- 1.1 | 36.0 +- NaN | +14.1 +- 4.6 | +11.5 +- NaN | | 64b-2t1c-ethip4vxlan-l2xcbase | 32.8 +- 2.2 | 40.1 +- 0.7 | 44.0 +- NaN | +22.3 +- 8.5 | +9.7 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-vppl2xc | 71.6 +- 8.2 | 70.5 +- 2.7 | 77.0 +- NaN | -1.5 +- 11.9 | +9.2 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn | 29.3 +- 1.3 | 32.3 +- 2.8 | 35.0 +- NaN | +10.2 +- 10.6 | +8.4 +- NaN | | 64b-2t1c-ethip4-ip4base-eth-2vhostvr1024-1vm | 71.6 +- 5.8 | 80.7 +- 1.7 | 87.0 +- NaN | +12.7 +- 9.4 | +7.8 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 71.6 +- 3.2 | 81.6 +- 2.2 | 87.0 +- NaN | +14.0 +- 6.0 | +6.6 +- NaN | | 78b-2t1c-avf-ethip6-ip6scale200k | 29.3 +- 1.6 | 33.0 +- 1.2 | 35.0 +- NaN | +12.6 +- 7.4 | +6.1 +- NaN | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6enc2sids | 35.5 +- 2.2 | 41.7 +- 0.9 | 44.0 +- NaN | +17.5 +- 7.7 | +5.5 +- NaN | | 64b-2t1c-eth-l2patch | 22.9 +- 1.7 | 24.7 +- 1.2 | 26.0 +- NaN | +7.9 +- 9.6 | +5.3 +- NaN | | 78b-2t1c-avf-ethip6ip6-ip6base-srv6enc1sid | 29.1 +- 1.0 | 39.3 +- 1.4 | 41.0 +- NaN | +35.1 +- 6.7 | +4.3 +- NaN | | 64b-2t1c-eth-l2xcbase-eth-2vhostvr1024-1vm | 63.7 +- 5.9 | 74.2 +- 2.1 | 77.0 +- NaN | +16.5 +- 11.4 | +3.8 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm | 66.7 +- 2.4 | 78.8 +- 1.6 | 81.0 +- NaN | +18.1 +- 4.8 | +2.8 +- NaN | | 64b-2t1c-ethip4vxlan-l2bdbasemaclrn | 37.1 +- 2.3 | 46.0 +- 1.4 | 47.0 +- NaN | +24.0 +- 8.7 | +2.2 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale200k | 27.7 +- 1.3 | 32.3 +- 0.7 | 33.0 +- NaN | +16.6 +- 5.8 | +2.2 +- NaN | | 64b-2t1c-avf-eth-l2patch | 21.9 +- 0.6 | 24.5 +- 0.8 | 25.0 +- NaN | +11.9 +- 4.8 | +2.0 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale20k | 27.9 +- 0.9 | 32.6 +- 0.5 | 33.0 +- NaN | +16.8 +- 4.1 | +1.2 +- NaN | | 64b-2t1c-eth-l2bdbasemaclrn-eth-2memif-1lxc | 69.0 +- 4.2 | 75.1 +- 2.8 | 76.0 +- NaN | +8.8 +- 7.8 | +1.2 +- NaN | | 64b-2t1c-avf-ethip4vxlan-l2xcbase | 31.8 +- 2.2 | 42.5 +- 2.6 | 43.0 +- NaN | +33.6 +- 12.4 | +1.2 +- NaN | | 64b-2t1c-ethip4-ip4base | 27.9 +- 1.2 | 31.7 +- 0.8 | 32.0 +- NaN | +13.6 +- 5.7 | +0.9 +- NaN | | 64b-2t1c-eth-l2xcbase | 25.8 +- 1.5 | 28.8 +- 0.6 | 29.0 +- NaN | +11.6 +- 6.8 | +0.7 +- NaN | | 64b-2t1c-ethip4-ip4base-eth-2memif-1dcr | 70.3 +- 4.3 | 74.5 +- 2.1 | 75.0 +- NaN | +6.0 +- 7.1 | +0.7 +- NaN | | 64b-2t1c-eth-l2xcbase-eth-2memif-1lxc | 57.7 +- 3.1 | 65.7 +- 3.5 | 66.0 +- NaN | +13.9 +- 8.6 | +0.5 +- NaN | | 64b-2t1c-avf-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 92.4 +- 23.9 | 102.7 +- 7.5 | 103.0 +- NaN | +11.1 +- 29.9 | +0.3 +- NaN | | 78b-2t1c-ethip6-ip6base | 29.8 +- 1.5 | 32.4 +- 3.0 | 32.0 +- NaN | +8.7 +- 11.4 | -1.2 +- NaN | | 64b-2t1c-eth-l2bdscale1mmaclrn | 33.9 +- 2.1 | 38.6 +- 1.3 | 38.0 +- NaN | +13.9 +- 8.1 | -1.6 +- NaN | | 64b-2t1c-eth-l2xcbase-eth-2memif-1dcr | 56.2 +- 3.0 | 66.5 +- 2.1 | 65.0 +- NaN | +18.3 +- 7.3 | -2.3 +- NaN | | 64b-2t1c-avf-ethip4-ip4scale2m | 28.8 +- 1.4 | 32.8 +- 0.8 | 32.0 +- NaN | +13.9 +- 6.2 | -2.4 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 73.9 +- 3.0 | 82.4 +- 3.4 | 80.0 +- NaN | +11.5 +- 6.4 | -2.9 +- NaN | | 64b-2t1c-avf-dot1q-l2bdbasemaclrn | 29.1 +- 1.2 | 38.4 +- 1.0 | 37.0 +- NaN | +32.0 +- 6.4 | -3.6 +- NaN | | 64b-2t1c-avf-ethip4-ip4base-eth-2memif-1dcr | 68.8 +- 5.1 | 68.5 +- 4.7 | 66.0 +- NaN | -0.4 +- 10.1 | -3.6 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn | 29.0 +- 1.1 | 35.3 +- 0.5 | 34.0 +- NaN | +21.7 +- 4.7 | -3.7 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2vhostvr1024-1vm-vppl2xc | 55.9 +- 6.9 | 66.5 +- 5.1 | 64.0 +- NaN | +19.0 +- 17.3 | -3.8 +- NaN | | 64b-2t1c-avf-eth-l2bdscale1mmaclrn | 31.0 +- 2.1 | 36.4 +- 0.8 | 35.0 +- NaN | +17.4 +- 8.2 | -3.8 +- NaN | | 64b-2t1c-ethip4vxlan-l2bdbasemaclrn-eth-2vhostvr1024-1vm | 66.4 +- 13.0 | 106.2 +- 3.7 | 102.0 +- NaN | +59.9 +- 31.8 | -4.0 +- NaN | | 64b-2t1c-avf-ethip4vxlan-l2bdbasemaclrn | 34.4 +- 1.5 | 49.0 +- 1.6 | 47.0 +- NaN | +42.4 +- 7.7 | -4.1 +- NaN | | 64b-2t1c-avf-eth-l2bdscale10kmaclrn | 30.6 +- 1.3 | 34.6 +- 0.7 | 33.0 +- NaN | +13.1 +- 5.2 | -4.6 +- NaN | | 64b-2t1c-avf-ethip4-ip4base-eth-2vhostvr1024-1vm-vppip4 | 78.7 +- 7.7 | 75.7 +- 5.9 | 72.0 +- NaN | -3.8 +- 12.1 | -4.9 +- NaN | | 64b-2t1c-avf-ethip4-ip4base | 28.0 +- 0.9 | 32.7 +- 0.5 | 31.0 +- NaN | +16.8 +- 4.3 | -5.2 +- NaN | | 64b-2t1c-avf-eth-l2bdscale100kmaclrn | 30.3 +- 2.1 | 35.0 +- 0.7 | 33.0 +- NaN | +15.5 +- 8.3 | -5.7 +- NaN | | 64b-2t1c-avf-eth-l2bdbasemaclrn-eth-2memif-1lxc | 66.9 +- 4.1 | 78.5 +- 4.8 | 73.0 +- NaN | +17.3 +- 10.3 | -7.0 +- NaN | | 64b-2t1c-avf-eth-l2xcbase | 26.6 +- 0.7 | 31.5 +- 0.5 | 29.0 +- NaN | +18.4 +- 3.7 | -7.9 +- NaN | | 78b-2t1c-ethip6-ip6scale2m | 36.5 +- 2.0 | 39.2 +- 2.6 | 35.0 +- NaN | +7.4 +- 9.3 | -10.7 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1lxc | 57.8 +- 2.1 | 74.4 +- 2.5 | 65.0 +- NaN | +28.7 +- 6.4 | -12.6 +- NaN | | 64b-2t1c-avf-eth-l2xcbase-eth-2memif-1dcr | 57.5 +- 3.1 | 74.6 +- 2.4 | 64.0 +- NaN | +29.7 +- 8.2 | -14.2 +- NaN | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6enc2sids-nodecaps | 34.2 +- 1.9 | 40.3 +- 0.8 | 0.0 +- NaN | +17.8 +- 6.9 | -100.0 +- NaN | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6proxy-dyn | 37.2 +- 4.2 | 49.0 +- 4.8 | 0.0 +- NaN | +31.7 +- 19.8 | -100.0 +- NaN | | 78b-2t1c-avf-ethip6srhip6-ip6base-srv6proxy-masq | 42.3 +- 3.3 | 58.9 +- 2.7 | 0.0 +- NaN | +39.2 +- 12.5 | -100.0 +- NaN | +-----------------------------------------------------------------------+---------------+---------------+--------------+----------------------+----------------------+ Test Case: Test cases executed for: PDR throughput on 3n-skx with xxv710. YYMM.V-E: [uSec +- StDev] results for VPP (YY year, MM month, V minor version) tested in CSIT (E environment version, "6" for CSIT rls2101, "7" for CSIT rls2106). YYMM.V-E vs YYMM.V-E: [% +- StDev] Relative difference, latter is the base. [N] for Root Cause Analysis (RCA) reference, see RCA list below. 2101.0-7 vs 2101.0-6: Compares CSIT environment current vs previous with previous VPP code. 2106.0-7 vs 2101.0-7: Compares VPP code current vs previous in the current CSIT environment.