7.14. vts

7.14.1. 2n1l-10ge2p1x710-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr suite

RFC2544: Packet throughput L2BD test cases with VXLANoIPv4 and vhost

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for L2 switching of IPv4. Eth-IPv4-VXLAN-Eth-IPv4 is applied on link from/to TG.

  • [Cfg] DUT configuration: DUTs are configured with L2 bridge- domain and MAC learning enabled. Qemu VNFs are connected to VPP via vhost-user interfaces. Guest is running VPP l2xc interconnecting vhost-user interfaces, rxd/txd=1024. DUTs are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544, RFC7348.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | L2BDMACLRN | ENCAP | VXLAN | L2OVRLAY | IP4UNRLAY
| ... | VHOST | VM | VHOST_1024 | VTS | ACL_PERMIT | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | vhost
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${50}
| ${nf_dtcr}= | ${1}
| ${nf_dtc}= | ${1}
| ${nf_chains}= | ${1}
| ${nf_nodes}= | ${1}
# Traffic profile:
| ${traffic_profile}=
| ... | trex-stl-ethip4vxlan-ip4src${nf_chains}udpsrcrnd
| ${acl_type}= | permit

7.14.1.1. Local Template

  • [Cfg] DUT runs L2BD switching config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - L2 Frame Size [B]. Type: integer - phy_cores - Number of worker threads to be used. Type: integer - rxq - Number of Rx queues to be used. Type: integer - acl_type - FIXME.


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
@{permit_list} =  Create List  172.17.0.2/32  172.27.0.2/32
Run Keyword If  '${acl_type}' != '${EMPTY}'  Configure ACLs on a single interface  ${dut1}  ${DUT1_${int}2_1}[0]  input  ${acl_type}  @{permit_list}
  And Initialize layer ip4vxlan  count=${nf_chains}
  And Initialize L2 bridge domains for multiple chains with Vhost-User  nf_chains=${nf_chains}  nf_nodes=${nf_nodes}
  And Configure chains of NFs connected via vhost-user  nf_chains=${nf_chains}  nf_nodes=${nf_nodes}  jumbo=${jumbo}  use_tuned_cfs=${False}  auto_scale=${True}  vnf=vppl2xc_2vhostvr1024
 Then Find NDR and PDR intervals using optimized search

7.14.1.2. 114B-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=${114}  phy_cores=${1}

7.14.1.3. 114B-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=${114}  phy_cores=${2}

7.14.1.4. 114B-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=${114}  phy_cores=${4}

7.14.1.5. 1518B-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.14.1.6. 1518B-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.14.1.7. 1518B-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.14.1.8. 9000B-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.14.1.9. 9000B-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.14.1.10. 9000B-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.14.1.11. IMIX-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.14.1.12. IMIX-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.14.1.13. IMIX-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.14.2. 2n1l-10ge2p1x710-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr suite

RFC2544: Packet throughput L2BD test cases with VXLANoIPv4 and vhost

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for L2 switching of IPv4. Eth-IPv4-VXLAN-Eth-IPv4 is applied on link from/to TG.

  • [Cfg] DUT configuration: DUTs are configured with L2 bridge- domain and MAC learning enabled. Qemu VNFs are connected to VPP via vhost-user interfaces. Guest is running VPP l2xc interconnecting vhost-user interfaces, rxd/txd=1024. DUTs are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544, RFC7348.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | L2BDMACLRN | ENCAP | VXLAN | L2OVRLAY | IP4UNRLAY
| ... | VHOST | VM | VHOST_1024 | VTS | ACL_PERMIT_REFLECT | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | vhost
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${50}
| ${nf_dtcr}= | ${1}
| ${nf_dtc}= | ${1}
| ${nf_chains}= | ${1}
| ${nf_nodes}= | ${1}
# Traffic profile:
| ${traffic_profile}=
| ... | trex-stl-ethip4vxlan-ip4src${nf_chains}udpsrcrnd
| ${acl_type}= | permit+reflect

7.14.2.1. Local Template

  • [Cfg] DUT runs L2BD switching config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - L2 Frame Size [B]. Type: integer - phy_cores - Number of worker threads to be used. Type: integer - rxq - Number of Rx queues to be used. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
@{permit_list} =  Create List  172.17.0.2/32  172.27.0.2/32
Run Keyword If  '${acl_type}' != '${EMPTY}'  Configure ACLs on a single interface  ${dut1}  ${DUT1_${int}2_1}[0]  input  ${acl_type}  @{permit_list}
  And Initialize layer ip4vxlan  count=${nf_chains}
  And Initialize L2 bridge domains for multiple chains with Vhost-User  nf_chains=${nf_chains}  nf_nodes=${nf_nodes}
  And Configure chains of NFs connected via vhost-user  nf_chains=${nf_chains}  nf_nodes=${nf_nodes}  jumbo=${jumbo}  use_tuned_cfs=${False}  auto_scale=${True}  vnf=vppl2xc_2vhostvr1024
 Then Find NDR and PDR intervals using optimized search

7.14.2.2. 114B-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=${114}  phy_cores=${1}

7.14.2.3. 114B-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=${114}  phy_cores=${2}

7.14.2.4. 114B-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=${114}  phy_cores=${4}

7.14.2.5. 1518B-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.14.2.6. 1518B-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.14.2.7. 1518B-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.14.2.8. 9000B-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.14.2.9. 9000B-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.14.2.10. 9000B-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.14.2.11. IMIX-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.14.2.12. IMIX-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.14.2.13. IMIX-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.14.3. 2n1l-10ge2p1x710-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr suite

RFC2544: Packet throughput L2BD test cases with VXLANoIPv4 and vhost

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for L2 switching of IPv4. Eth-IPv4-VXLAN-Eth-IPv4 is applied on link from/to TG.

  • [Cfg] DUT configuration: DUTs are configured with L2 bridge- domain and MAC learning enabled. Qemu VNFs are connected to VPP via vhost-user interfaces. Guest is running VPP l2xc interconnecting vhost-user interfaces, rxd/txd=1024. DUTs are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544, RFC7348.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | L2BDMACLRN | ENCAP | VXLAN | L2OVRLAY | IP4UNRLAY
| ... | VHOST | VM | VHOST_1024 | VTS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | vhost
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${50}
| ${nf_dtcr}= | ${1}
| ${nf_dtc}= | ${1}
| ${nf_chains}= | ${1}
| ${nf_nodes}= | ${1}
# Traffic profile:
| ${traffic_profile}=
| ... | trex-stl-ethip4vxlan-ip4src${nf_chains}udpsrcrnd
| ${acl_type}= | ${EMPTY}

7.14.3.1. Local Template

  • [Cfg] DUT runs L2BD switching config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - L2 Frame Size [B]. Type: integer - phy_cores - Number of worker threads to be used. Type: integer - rxq - Number of Rx queues to be used. Type: integer - acl_type - FIXME.


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
@{permit_list} =  Create List  172.17.0.2/32  172.27.0.2/32
Run Keyword If  '${acl_type}' != '${EMPTY}'  Configure ACLs on a single interface  ${dut1}  ${DUT1_${int}2_1}[0]  input  ${acl_type}  @{permit_list}
  And Initialize layer ip4vxlan  count=${nf_chains}
  And Initialize L2 bridge domains for multiple chains with Vhost-User  nf_chains=${nf_chains}  nf_nodes=${nf_nodes}
  And Configure chains of NFs connected via vhost-user  nf_chains=${nf_chains}  nf_nodes=${nf_nodes}  jumbo=${jumbo}  use_tuned_cfs=${False}  auto_scale=${True}  vnf=vppl2xc_2vhostvr1024
 Then Find NDR and PDR intervals using optimized search

7.14.3.2. 114B-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=${114}  phy_cores=${1}

7.14.3.3. 114B-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=${114}  phy_cores=${2}

7.14.3.4. 114B-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=${114}  phy_cores=${4}

7.14.3.5. 1518B-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.14.3.6. 1518B-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.14.3.7. 1518B-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.14.3.8. 9000B-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.14.3.9. 9000B-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.14.3.10. 9000B-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.14.3.11. IMIX-1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.14.3.12. IMIX-2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.14.3.13. IMIX-4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}