7.5. ip4

7.5.1. 10ge2p1x710-dot1q-ip4base-ndrpdr suite

RFC2544: Pkt throughput IPv4 routing with IEEE 802.1Q test cases

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing. IEEE 802.1Q tagging is applied on link between DUT1 and DUT2.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and two static IPv4 /30 route entries. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 254 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | BASE | DOT1Q | IP4BASE | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | dot1q-ip4base
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${4}
| ${subid}= | 10
| ${tag_rewrite}= | pop-1
# TG subnets used by T-Rex
| ${tg_if1_net}= | 10.10.10.0
| ${tg_if2_net}= | 20.20.20.0
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4-ip4src254

7.5.1.1. Local Template

  • [Cfg] Each DUT runs IPv4 routing with VLAN and uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding with VLAN dot1q sub-interfaces in circular topology  ${tg_if1_net}  ${tg_if2_net}  ${subid}  ${tag_rewrite}
 Then Find NDR and PDR intervals using optimized search

7.5.1.2. 64B-1c-dot1q-ip4base-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.1.3. 64B-2c-dot1q-ip4base-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.1.4. 64B-4c-dot1q-ip4base-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.1.5. 1518B-1c-dot1q-ip4base-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.1.6. 1518B-2c-dot1q-ip4base-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.1.7. 1518B-4c-dot1q-ip4base-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.1.8. 9000B-1c-dot1q-ip4base-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.1.9. 9000B-2c-dot1q-ip4base-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.1.10. 9000B-4c-dot1q-ip4base-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.1.11. IMIX-1c-dot1q-ip4base-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.1.12. IMIX-2c-dot1q-ip4base-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.1.13. IMIX-4c-dot1q-ip4base-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.2. 10ge2p1x710-ethip4-ip4base-adlalwlistbase-ndrpdr suite

RFC2544: Pkt throughput IPv4 allowlist test cases

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4 routing, two static IPv4 /24 routes and IPv4 ADL security allowlist ingress /24 filter entries applied on links TG - DUT1 and DUT2 - TG. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ADLALWLIST | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4-ip4base-adlalwlistbase
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | adl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4-ip4src253

7.5.2.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology
  And Add Fib Table  ${dut1}  1
  And Vpp Route Add  ${dut1}  10.10.10.0  24  vrf=1  local=${TRUE}
  And Add Fib Table  ${dut2}  1
  And Vpp Route Add  ${dut2}  20.20.20.0  24  vrf=1  local=${TRUE}
  And ADL Add allowlist Entry  ${dut1}  ${DUT1_${int}1}[0]  ip4  1
  And ADL Add allowlist Entry  ${dut2}  ${DUT2_${int}2}[0]  ip4  1
  And ADL interface enable or disable  ${dut1}  ${DUT1_${int}1}[0]  enable
  And ADL interface enable or disable  ${dut2}  ${DUT2_${int}2}[0]  enable
 Then Find NDR and PDR intervals using optimized search

7.5.2.2. 64B-1c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.2.3. 64B-2c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.2.4. 64B-4c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.2.5. 1518B-1c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.2.6. 1518B-2c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.2.7. 1518B-4c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.2.8. 9000B-1c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.2.9. 9000B-2c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.2.10. 9000B-4c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.2.11. IMIX-1c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.2.12. IMIX-2c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.2.13. IMIX-4c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.3. 10ge2p1x710-ethip4-ip4base-iacldstbase-ndrpdr suite

RFC2544: Pkt throughput IPv4 iAcl whitelist test cases

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4 routing, two static IPv4 /24 routes and IPv4 iAcl security whitelist ingress /24 filter entries applied on links TG - DUT1 and DUT2 - TG. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv6 header and generated payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | IACLDST | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4-ip4base-iacldstbase
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | classify
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4-ip4src253

7.5.3.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology
${table_idx}  ${skip_n}  ${match_n}=  And Vpp Creates Classify Table L3  ${dut1}  ip4  dst  255.255.255.0
  And Vpp Configures Classify Session L3  ${dut1}  permit  ${table_idx}  ${skip_n}  ${match_n}  ip4  dst  20.20.20.0
  And Vpp Enable Input Acl Interface  ${dut1}  ${DUT1_${int}1}[0]  ip4  ${table_idx}
${table_idx}  ${skip_n}  ${match_n}=  And Vpp Creates Classify Table L3  ${dut2}  ip4  dst  255.255.255.0
  And Vpp Configures Classify Session L3  ${dut2}  permit  ${table_idx}  ${skip_n}  ${match_n}  ip4  dst  10.10.10.0
  And Vpp Enable Input Acl Interface  ${dut2}  ${DUT2_${int}2}[0]  ip4  ${table_idx}
 Then Find NDR and PDR intervals using optimized search

7.5.3.2. 64B-1c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.3.3. 64B-2c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.3.4. 64B-4c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.3.5. 1518B-1c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.3.6. 1518B-2c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.3.7. 1518B-4c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.3.8. 9000B-1c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.3.9. 9000B-2c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.3.10. 9000B-4c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.3.11. IMIX-1c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.3.12. IMIX-2c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.3.13. IMIX-4c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.4. 10ge2p1x710-ethip4-ip4base-ipolicemarkbase-ndrpdr suite

RFC2544: Pkt throughput IPv4 policer test cases

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4 routing and two static IPv4 /24 route entries and policer with 2R3C color-aware configuration. Policer is applied on links TG - DUT1 and DUT2 - TG. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv6 header and generated payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544, RFC2698.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
| Library | resources.libraries.python.Policer
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | IP4FWD | FEATURE | POLICE_MARK | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4-ip4base-ipolicemarkbase
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | classify
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
| ${cir}= | ${100}
| ${eir}= | ${150}
| ${dscp}= | AF22
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4-ip4src253

7.5.4.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Set Rates For Policer
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology
  And Initialize IPv4 policer 2r3c-'ca' in circular topology
 Then Find NDR and PDR intervals using optimized search

7.5.4.2. 64B-1c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.4.3. 64B-2c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.4.4. 64B-4c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.4.5. 1518B-1c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.4.6. 1518B-2c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.4.7. 1518B-4c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.4.8. 9000B-1c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.4.9. 9000B-2c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.4.10. 9000B-4c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.4.11. IMIX-1c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.4.12. IMIX-2c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.4.13. IMIX-4c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.5. 10ge2p1x710-ethip4-ip4base-ndrpdr suite

RFC2544: Pkt throughput IPv4 routing test cases

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | BASE | IP4BASE | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4-ip4base
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4-ip4src253

7.5.5.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology
 Then Find NDR and PDR intervals using optimized search

7.5.5.2. 64B-1c-ethip4-ip4base-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.5.3. 64B-2c-ethip4-ip4base-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.5.4. 64B-4c-ethip4-ip4base-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.5.5. 1518B-1c-ethip4-ip4base-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.5.6. 1518B-2c-ethip4-ip4base-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.5.7. 1518B-4c-ethip4-ip4base-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.5.8. 9000B-1c-ethip4-ip4base-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.5.9. 9000B-2c-ethip4-ip4base-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.5.10. 9000B-4c-ethip4-ip4base-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.5.11. IMIX-1c-ethip4-ip4base-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.5.12. IMIX-2c-ethip4-ip4base-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.5.13. IMIX-4c-ethip4-ip4base-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.6. 10ge2p1x710-ethip4-ip4scale200k-ndrpdr suite

RFC2544: Pkt throughput IPv4 routing test cases

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and 2x100k static IPv4 /32 route entries. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 100k flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | SCALE | FIB_200K | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4-ip4scale200k
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
| ${rts_per_flow}= | ${100000}
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4-ip4dst${rts_per_flow}

7.5.6.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding with scaling in circular topology  ${rts_per_flow}
 Then Find NDR and PDR intervals using optimized search

7.5.6.2. 64B-1c-ethip4-ip4scale200k-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.6.3. 64B-2c-ethip4-ip4scale200k-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.6.4. 64B-4c-ethip4-ip4scale200k-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.6.5. 1518B-1c-ethip4-ip4scale200k-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.6.6. 1518B-2c-ethip4-ip4scale200k-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.6.7. 1518B-4c-ethip4-ip4scale200k-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.6.8. 9000B-1c-ethip4-ip4scale200k-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.6.9. 9000B-2c-ethip4-ip4scale200k-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.6.10. 9000B-4c-ethip4-ip4scale200k-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.6.11. IMIX-1c-ethip4-ip4scale200k-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.6.12. IMIX-2c-ethip4-ip4scale200k-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.6.13. IMIX-4c-ethip4-ip4scale200k-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.7. 10ge2p1x710-ethip4-ip4scale200k-rnd-ndrpdr suite

RFC2544: Pkt throughput IPv4 routing test cases

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and 2x100k static IPv4 /32 route entries. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains 2 randomized L3 flow-groups (flow-group per direction, 100k flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | SCALE | FIB_200K | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0 | IP4_RND
| ... | ethip4-ip4scale200k-rnd
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
| ${rts_per_flow}= | ${100000}
# Traffic profile
| ${traffic_profile}= | trex-stl-ethip4-ip4dst-rnd${rts_per_flow}

7.5.7.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding with scaling in circular topology  ${rts_per_flow}
 Then Find NDR and PDR intervals using optimized search

7.5.7.2. 64B-1c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.7.3. 64B-2c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.7.4. 64B-4c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.7.5. 1518B-1c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.7.6. 1518B-2c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.7.7. 1518B-4c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.7.8. 9000B-1c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.7.9. 9000B-2c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.7.10. 9000B-4c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.7.11. IMIX-1c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.7.12. IMIX-2c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.7.13. IMIX-4c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.8. 10ge2p1x710-ethip4-ip4scale20k-ndrpdr suite

RFC2544: Pkt throughput IPv4 routing test cases

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and 2x10k static IPv4 /32 route entries. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 10k flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | SCALE | FIB_20K | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4-ip4scale20k
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
| ${rts_per_flow}= | ${10000}
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4-ip4dst${rts_per_flow}

7.5.8.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding with scaling in circular topology  ${rts_per_flow}
 Then Find NDR and PDR intervals using optimized search

7.5.8.2. 64B-1c-ethip4-ip4scale20k-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.8.3. 64B-2c-ethip4-ip4scale20k-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.8.4. 64B-4c-ethip4-ip4scale20k-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.8.5. 1518B-1c-ethip4-ip4scale20k-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.8.6. 1518B-2c-ethip4-ip4scale20k-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.8.7. 1518B-4c-ethip4-ip4scale20k-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.8.8. 9000B-1c-ethip4-ip4scale20k-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.8.9. 9000B-2c-ethip4-ip4scale20k-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.8.10. 9000B-4c-ethip4-ip4scale20k-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.8.11. IMIX-1c-ethip4-ip4scale20k-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.8.12. IMIX-2c-ethip4-ip4scale20k-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.8.13. IMIX-4c-ethip4-ip4scale20k-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.9. 10ge2p1x710-ethip4-ip4scale20k-rnd-ndrpdr suite

RFC2544: Pkt throughput IPv4 routing test cases

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and 2x10k static IPv4 /32 route entries. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains 2 randomized L3 flow-groups (flow-group per direction, 10k flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | SCALE | FIB_20K | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0 | IP4_RND
| ... | ethip4-ip4scale20k-rnd
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
| ${rts_per_flow}= | ${10000}
# Traffic profile
| ${traffic_profile}= | trex-stl-ethip4-ip4dst-rnd${rts_per_flow}

7.5.9.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding with scaling in circular topology  ${rts_per_flow}
 Then Find NDR and PDR intervals using optimized search

7.5.9.2. 64B-1c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.9.3. 64B-2c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.9.4. 64B-4c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.9.5. 1518B-1c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.9.6. 1518B-2c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.9.7. 1518B-4c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.9.8. 9000B-1c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.9.9. 9000B-2c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.9.10. 9000B-4c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.9.11. IMIX-1c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.9.12. IMIX-2c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.9.13. IMIX-4c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.10. 10ge2p1x710-ethip4-ip4scale2m-ndrpdr suite

RFC2544: Pkt throughput IPv4 routing test cases

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and 2x1M static IPv4 /32 route entries. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 1M flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | SCALE | FIB_2M | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4-ip4scale2m
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
| ${rts_per_flow}= | ${1000000}
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4-ip4dst${rts_per_flow}

7.5.10.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding with scaling in circular topology  ${rts_per_flow}
 Then Find NDR and PDR intervals using optimized search

7.5.10.2. 64B-1c-ethip4-ip4scale2m-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.10.3. 64B-2c-ethip4-ip4scale2m-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.10.4. 64B-4c-ethip4-ip4scale2m-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.10.5. 1518B-1c-ethip4-ip4scale2m-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.10.6. 1518B-2c-ethip4-ip4scale2m-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.10.7. 1518B-4c-ethip4-ip4scale2m-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.10.8. 9000B-1c-ethip4-ip4scale2m-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.10.9. 9000B-2c-ethip4-ip4scale2m-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.10.10. 9000B-4c-ethip4-ip4scale2m-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.10.11. IMIX-1c-ethip4-ip4scale2m-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.10.12. IMIX-2c-ethip4-ip4scale2m-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.10.13. IMIX-4c-ethip4-ip4scale2m-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.11. 10ge2p1x710-ethip4-ip4scale2m-rnd-ndrpdr suite

RFC2544: Pkt throughput IPv4 routing test cases

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and 2x1M static IPv4 /32 route entries. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains 2 randomized L3 flow-groups (flow-group per direction, 1M flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | SCALE | FIB_2M | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0 | IP4_RND
| ... | ethip4-ip4scale2m-rnd
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
| ${rts_per_flow}= | ${1000000}
# Traffic profile
| ${traffic_profile}= | trex-stl-ethip4-ip4dst-rnd${rts_per_flow}

7.5.11.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding with scaling in circular topology  ${rts_per_flow}
 Then Find NDR and PDR intervals using optimized search

7.5.11.2. 64B-1c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.11.3. 64B-2c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.11.4. 64B-4c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.11.5. 1518B-1c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.11.6. 1518B-2c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.11.7. 1518B-4c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.11.8. 9000B-1c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.11.9. 9000B-2c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.11.10. 9000B-4c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.11.11. IMIX-1c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.11.12. IMIX-2c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.11.13. IMIX-4c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.12. 10ge2p1x710-ethip4udp-ip4base-iacl10sf-100flows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | IACL | ACL10 | 100_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl10sf-100flows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 10
| ${flows_per_dir}= | 100
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u10p-conc

7.5.12.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.12.2. 64B-1c-ethip4udp-ip4base-iacl10sf-100flows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.12.3. 64B-2c-ethip4udp-ip4base-iacl10sf-100flows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.12.4. 64B-4c-ethip4udp-ip4base-iacl10sf-100flows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.12.5. 1518B-1c-ethip4udp-ip4base-iacl10sf-100flows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.12.6. 1518B-2c-ethip4udp-ip4base-iacl10sf-100flows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.12.7. 1518B-4c-ethip4udp-ip4base-iacl10sf-100flows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.12.8. 9000B-1c-ethip4udp-ip4base-iacl10sf-100flows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.12.9. 9000B-2c-ethip4udp-ip4base-iacl10sf-100flows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.12.10. 9000B-4c-ethip4udp-ip4base-iacl10sf-100flows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.12.11. IMIX-1c-ethip4udp-ip4base-iacl10sf-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.12.12. IMIX-2c-ethip4udp-ip4base-iacl10sf-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.12.13. IMIX-4c-ethip4udp-ip4base-iacl10sf-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.13. 10ge2p1x710-ethip4udp-ip4base-iacl10sf-100kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | IACL | ACL10 | 100K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl10sf-100kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 10
| ${flows_per_dir}= | 100k
| ${ip_nr}= | ${100}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-100u1000p-conc

7.5.13.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.13.2. 64B-1c-ethip4udp-ip4base-iacl10sf-100kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.13.3. 64B-2c-ethip4udp-ip4base-iacl10sf-100kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.13.4. 64B-4c-ethip4udp-ip4base-iacl10sf-100kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.13.5. 1518B-1c-ethip4udp-ip4base-iacl10sf-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.13.6. 1518B-2c-ethip4udp-ip4base-iacl10sf-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.13.7. 1518B-4c-ethip4udp-ip4base-iacl10sf-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.13.8. 9000B-1c-ethip4udp-ip4base-iacl10sf-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.13.9. 9000B-2c-ethip4udp-ip4base-iacl10sf-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.13.10. 9000B-4c-ethip4udp-ip4base-iacl10sf-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.13.11. IMIX-1c-ethip4udp-ip4base-iacl10sf-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.13.12. IMIX-2c-ethip4udp-ip4base-iacl10sf-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.13.13. IMIX-4c-ethip4udp-ip4base-iacl10sf-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.14. 10ge2p1x710-ethip4udp-ip4base-iacl10sf-10kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | IACL | ACL10 | 10K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl10sf-10kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 10
| ${flows_per_dir}= | 10k
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u1000p-conc

7.5.14.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.14.2. 64B-1c-ethip4udp-ip4base-iacl10sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.14.3. 64B-2c-ethip4udp-ip4base-iacl10sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.14.4. 64B-4c-ethip4udp-ip4base-iacl10sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.14.5. 1518B-1c-ethip4udp-ip4base-iacl10sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.14.6. 1518B-2c-ethip4udp-ip4base-iacl10sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.14.7. 1518B-4c-ethip4udp-ip4base-iacl10sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.14.8. 9000B-1c-ethip4udp-ip4base-iacl10sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.14.9. 9000B-2c-ethip4udp-ip4base-iacl10sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.14.10. 9000B-4c-ethip4udp-ip4base-iacl10sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.14.11. IMIX-1c-ethip4udp-ip4base-iacl10sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.14.12. IMIX-2c-ethip4udp-ip4base-iacl10sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.14.13. IMIX-4c-ethip4udp-ip4base-iacl10sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.15. 10ge2p1x710-ethip4udp-ip4base-iacl10sl-100flows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | IACL | ACL10 | 100_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl10sl-100flows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 10
| ${flows_per_dir}= | 100
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u10p-conc

7.5.15.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.15.2. 64B-1c-ethip4udp-ip4base-iacl10sl-100flows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.15.3. 64B-2c-ethip4udp-ip4base-iacl10sl-100flows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.15.4. 64B-4c-ethip4udp-ip4base-iacl10sl-100flows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.15.5. 1518B-1c-ethip4udp-ip4base-iacl10sl-100flows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.15.6. 1518B-2c-ethip4udp-ip4base-iacl10sl-100flows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.15.7. 1518B-4c-ethip4udp-ip4base-iacl10sl-100flows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.15.8. 9000B-1c-ethip4udp-ip4base-iacl10sl-100flows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.15.9. 9000B-2c-ethip4udp-ip4base-iacl10sl-100flows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.15.10. 9000B-4c-ethip4udp-ip4base-iacl10sl-100flows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.15.11. IMIX-1c-ethip4udp-ip4base-iacl10sl-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.15.12. IMIX-2c-ethip4udp-ip4base-iacl10sl-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.15.13. IMIX-4c-ethip4udp-ip4base-iacl10sl-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.16. 10ge2p1x710-ethip4udp-ip4base-iacl10sl-100kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | IACL | ACL10 | 100K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl10sl-100kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 10
| ${flows_per_dir}= | 100k
| ${ip_nr}= | ${100}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-100u1000p-conc

7.5.16.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.16.2. 64B-1c-ethip4udp-ip4base-iacl10sl-100kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.16.3. 64B-2c-ethip4udp-ip4base-iacl10sl-100kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.16.4. 64B-4c-ethip4udp-ip4base-iacl10sl-100kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.16.5. 1518B-1c-ethip4udp-ip4base-iacl10sl-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.16.6. 1518B-2c-ethip4udp-ip4base-iacl10sl-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.16.7. 1518B-4c-ethip4udp-ip4base-iacl10sl-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.16.8. 9000B-1c-ethip4udp-ip4base-iacl10sl-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.16.9. 9000B-2c-ethip4udp-ip4base-iacl10sl-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.16.10. 9000B-4c-ethip4udp-ip4base-iacl10sl-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.16.11. IMIX-1c-ethip4udp-ip4base-iacl10sl-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.16.12. IMIX-2c-ethip4udp-ip4base-iacl10sl-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.16.13. IMIX-4c-ethip4udp-ip4base-iacl10sl-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.17. 10ge2p1x710-ethip4udp-ip4base-iacl10sl-10kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | IACL | ACL10 | 10K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl10sl-10kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 10
| ${flows_per_dir}= | 10k
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u1000p-conc

7.5.17.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.17.2. 64B-1c-ethip4udp-ip4base-iacl10sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.17.3. 64B-2c-ethip4udp-ip4base-iacl10sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.17.4. 64B-4c-ethip4udp-ip4base-iacl10sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.17.5. 1518B-1c-ethip4udp-ip4base-iacl10sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.17.6. 1518B-2c-ethip4udp-ip4base-iacl10sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.17.7. 1518B-4c-ethip4udp-ip4base-iacl10sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.17.8. 9000B-1c-ethip4udp-ip4base-iacl10sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.17.9. 9000B-2c-ethip4udp-ip4base-iacl10sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.17.10. 9000B-4c-ethip4udp-ip4base-iacl10sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.17.11. IMIX-1c-ethip4udp-ip4base-iacl10sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.17.12. IMIX-2c-ethip4udp-ip4base-iacl10sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.17.13. IMIX-4c-ethip4udp-ip4base-iacl10sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.18. 10ge2p1x710-ethip4udp-ip4base-iacl1sf-100flows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | IACL | ACL1 | 100_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl1sf-100flows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 1
| ${flows_per_dir}= | 100
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u10p-conc

7.5.18.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.18.2. 64B-1c-ethip4udp-ip4base-iacl1sf-100flows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.18.3. 64B-2c-ethip4udp-ip4base-iacl1sf-100flows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.18.4. 64B-4c-ethip4udp-ip4base-iacl1sf-100flows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.18.5. 1518B-1c-ethip4udp-ip4base-iacl1sf-100flows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.18.6. 1518B-2c-ethip4udp-ip4base-iacl1sf-100flows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.18.7. 1518B-4c-ethip4udp-ip4base-iacl1sf-100flows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.18.8. 9000B-1c-ethip4udp-ip4base-iacl1sf-100flows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.18.9. 9000B-2c-ethip4udp-ip4base-iacl1sf-100flows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.18.10. 9000B-4c-ethip4udp-ip4base-iacl1sf-100flows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.18.11. IMIX-1c-ethip4udp-ip4base-iacl1sf-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.18.12. IMIX-2c-ethip4udp-ip4base-iacl1sf-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.18.13. IMIX-4c-ethip4udp-ip4base-iacl1sf-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.19. 10ge2p1x710-ethip4udp-ip4base-iacl1sf-100kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | IACL | ACL1 | 100K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl1sf-100kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 1
| ${flows_per_dir}= | 100k
| ${ip_nr}= | ${100}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-100u1000p-conc

7.5.19.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.19.2. 64B-1c-ethip4udp-ip4base-iacl1sf-100kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.19.3. 64B-2c-ethip4udp-ip4base-iacl1sf-100kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.19.4. 64B-4c-ethip4udp-ip4base-iacl1sf-100kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.19.5. 1518B-1c-ethip4udp-ip4base-iacl1sf-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.19.6. 1518B-2c-ethip4udp-ip4base-iacl1sf-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.19.7. 1518B-4c-ethip4udp-ip4base-iacl1sf-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.19.8. 9000B-1c-ethip4udp-ip4base-iacl1sf-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.19.9. 9000B-2c-ethip4udp-ip4base-iacl1sf-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.19.10. 9000B-4c-ethip4udp-ip4base-iacl1sf-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.19.11. IMIX-1c-ethip4udp-ip4base-iacl1sf-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.19.12. IMIX-2c-ethip4udp-ip4base-iacl1sf-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.19.13. IMIX-4c-ethip4udp-ip4base-iacl1sf-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.20. 10ge2p1x710-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | IACL | ACL1 | 10K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl1sf-10kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 1
| ${flows_per_dir}= | 10k
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u1000p-conc

7.5.20.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.20.2. 64B-1c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.20.3. 64B-2c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.20.4. 64B-4c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.20.5. 1518B-1c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.20.6. 1518B-2c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.20.7. 1518B-4c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.20.8. 9000B-1c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.20.9. 9000B-2c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.20.10. 9000B-4c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.20.11. IMIX-1c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.20.12. IMIX-2c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.20.13. IMIX-4c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.21. 10ge2p1x710-ethip4udp-ip4base-iacl1sl-100flows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | IACL | ACL1 | 100_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl1sl-100flows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 1
| ${flows_per_dir}= | 100
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u10p-conc

7.5.21.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.21.2. 64B-1c-ethip4udp-ip4base-iacl1sl-100flows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.21.3. 64B-2c-ethip4udp-ip4base-iacl1sl-100flows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.21.4. 64B-4c-ethip4udp-ip4base-iacl1sl-100flows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.21.5. 1518B-1c-ethip4udp-ip4base-iacl1sl-100flows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.21.6. 1518B-2c-ethip4udp-ip4base-iacl1sl-100flows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.21.7. 1518B-4c-ethip4udp-ip4base-iacl1sl-100flows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.21.8. 9000B-1c-ethip4udp-ip4base-iacl1sl-100flows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.21.9. 9000B-2c-ethip4udp-ip4base-iacl1sl-100flows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.21.10. 9000B-4c-ethip4udp-ip4base-iacl1sl-100flows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.21.11. IMIX-1c-ethip4udp-ip4base-iacl1sl-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.21.12. IMIX-2c-ethip4udp-ip4base-iacl1sl-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.21.13. IMIX-4c-ethip4udp-ip4base-iacl1sl-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.22. 10ge2p1x710-ethip4udp-ip4base-iacl1sl-100kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | IACL | ACL1 | 100K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl1sl-100kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
| ${ip_nr}= | ${100}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 1
| ${flows_per_dir}= | 100k
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-100u1000p-conc

7.5.22.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.22.2. 64B-1c-ethip4udp-ip4base-iacl1sl-100kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.22.3. 64B-2c-ethip4udp-ip4base-iacl1sl-100kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.22.4. 64B-4c-ethip4udp-ip4base-iacl1sl-100kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.22.5. 1518B-1c-ethip4udp-ip4base-iacl1sl-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.22.6. 1518B-2c-ethip4udp-ip4base-iacl1sl-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.22.7. 1518B-4c-ethip4udp-ip4base-iacl1sl-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.22.8. 9000B-1c-ethip4udp-ip4base-iacl1sl-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.22.9. 9000B-2c-ethip4udp-ip4base-iacl1sl-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.22.10. 9000B-4c-ethip4udp-ip4base-iacl1sl-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.22.11. IMIX-1c-ethip4udp-ip4base-iacl1sl-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.22.12. IMIX-2c-ethip4udp-ip4base-iacl1sl-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.22.13. IMIX-4c-ethip4udp-ip4base-iacl1sl-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.23. 10ge2p1x710-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | IACL | ACL1 | 10K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl1sl-10kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 1
| ${flows_per_dir}= | 10k
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u1000p-conc

7.5.23.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.23.2. 64B-1c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.23.3. 64B-2c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.23.4. 64B-4c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.23.5. 1518B-1c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.23.6. 1518B-2c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.23.7. 1518B-4c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.23.8. 9000B-1c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.23.9. 9000B-2c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.23.10. 9000B-4c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.23.11. IMIX-1c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.23.12. IMIX-2c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.23.13. IMIX-4c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.24. 10ge2p1x710-ethip4udp-ip4base-iacl50sf-100flows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | IACL | ACL50 | 100_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl50sf-100flows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 50
| ${flows_per_dir}= | 100
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u10p-conc

7.5.24.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.24.2. 64B-1c-ethip4udp-ip4base-iacl50sf-100flows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.24.3. 64B-2c-ethip4udp-ip4base-iacl50sf-100flows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.24.4. 64B-4c-ethip4udp-ip4base-iacl50sf-100flows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.24.5. 1518B-1c-ethip4udp-ip4base-iacl50sf-100flows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.24.6. 1518B-2c-ethip4udp-ip4base-iacl50sf-100flows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.24.7. 1518B-4c-ethip4udp-ip4base-iacl50sf-100flows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.24.8. 9000B-1c-ethip4udp-ip4base-iacl50sf-100flows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.24.9. 9000B-2c-ethip4udp-ip4base-iacl50sf-100flows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.24.10. 9000B-4c-ethip4udp-ip4base-iacl50sf-100flows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.24.11. IMIX-1c-ethip4udp-ip4base-iacl50sf-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.24.12. IMIX-2c-ethip4udp-ip4base-iacl50sf-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.24.13. IMIX-4c-ethip4udp-ip4base-iacl50sf-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.25. 10ge2p1x710-ethip4udp-ip4base-iacl50sf-100kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | IACL | ACL50 | 100K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl50sf-100kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 50
| ${flows_per_dir}= | 100k
| ${ip_nr}= | ${100}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-100u1000p-conc

7.5.25.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.25.2. 64B-1c-ethip4udp-ip4base-iacl50sf-100kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.25.3. 64B-2c-ethip4udp-ip4base-iacl50sf-100kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.25.4. 64B-4c-ethip4udp-ip4base-iacl50sf-100kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.25.5. 1518B-1c-ethip4udp-ip4base-iacl50sf-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.25.6. 1518B-2c-ethip4udp-ip4base-iacl50sf-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.25.7. 1518B-4c-ethip4udp-ip4base-iacl50sf-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.25.8. 9000B-1c-ethip4udp-ip4base-iacl50sf-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.25.9. 9000B-2c-ethip4udp-ip4base-iacl50sf-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.25.10. 9000B-4c-ethip4udp-ip4base-iacl50sf-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.25.11. IMIX-1c-ethip4udp-ip4base-iacl50sf-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.25.12. IMIX-2c-ethip4udp-ip4base-iacl50sf-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.25.13. IMIX-4c-ethip4udp-ip4base-iacl50sf-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.26. 10ge2p1x710-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | IACL | ACL50 | 10K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl50sf-10kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 50
| ${flows_per_dir}= | 10k
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u1000p-conc

7.5.26.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.26.2. 64B-1c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.26.3. 64B-2c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.26.4. 64B-4c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.26.5. 1518B-1c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.26.6. 1518B-2c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.26.7. 1518B-4c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.26.8. 9000B-1c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.26.9. 9000B-2c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.26.10. 9000B-4c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.26.11. IMIX-1c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.26.12. IMIX-2c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.26.13. IMIX-4c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.27. 10ge2p1x710-ethip4udp-ip4base-iacl50sl-100flows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | IACL | ACL50 | 100_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl50sl-100flows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 50
| ${flows_per_dir}= | 100
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u10p-conc

7.5.27.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.27.2. 64B-1c-ethip4udp-ip4base-iacl50sl-100flows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.27.3. 64B-2c-ethip4udp-ip4base-iacl50sl-100flows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.27.4. 64B-4c-ethip4udp-ip4base-iacl50sl-100flows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.27.5. 1518B-1c-ethip4udp-ip4base-iacl50sl-100flows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.27.6. 1518B-2c-ethip4udp-ip4base-iacl50sl-100flows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.27.7. 1518B-4c-ethip4udp-ip4base-iacl50sl-100flows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.27.8. 9000B-1c-ethip4udp-ip4base-iacl50sl-100flows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.27.9. 9000B-2c-ethip4udp-ip4base-iacl50sl-100flows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.27.10. 9000B-4c-ethip4udp-ip4base-iacl50sl-100flows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.27.11. IMIX-1c-ethip4udp-ip4base-iacl50sl-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.27.12. IMIX-2c-ethip4udp-ip4base-iacl50sl-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.27.13. IMIX-4c-ethip4udp-ip4base-iacl50sl-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.28. 10ge2p1x710-ethip4udp-ip4base-iacl50sl-100kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | IACL | ACL50 | 100K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl50sl-100kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 50
| ${flows_per_dir}= | 100k
| ${ip_nr}= | ${100}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-100u1000p-conc

7.5.28.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.28.2. 64B-1c-ethip4udp-ip4base-iacl50sl-100kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.28.3. 64B-2c-ethip4udp-ip4base-iacl50sl-100kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.28.4. 64B-4c-ethip4udp-ip4base-iacl50sl-100kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.28.5. 1518B-1c-ethip4udp-ip4base-iacl50sl-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.28.6. 1518B-2c-ethip4udp-ip4base-iacl50sl-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.28.7. 1518B-4c-ethip4udp-ip4base-iacl50sl-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.28.8. 9000B-1c-ethip4udp-ip4base-iacl50sl-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.28.9. 9000B-2c-ethip4udp-ip4base-iacl50sl-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.28.10. 9000B-4c-ethip4udp-ip4base-iacl50sl-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.28.11. IMIX-1c-ethip4udp-ip4base-iacl50sl-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.28.12. IMIX-2c-ethip4udp-ip4base-iacl50sl-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.28.13. IMIX-4c-ethip4udp-ip4base-iacl50sl-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.29. 10ge2p1x710-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | IACL | ACL50 | 10K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl50sl-10kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 50
| ${flows_per_dir}= | 10k
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u1000p-conc

7.5.29.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.29.2. 64B-1c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.29.3. 64B-2c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.29.4. 64B-4c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.29.5. 1518B-1c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.29.6. 1518B-2c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.29.7. 1518B-4c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.29.8. 9000B-1c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.29.9. 9000B-2c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.29.10. 9000B-4c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.29.11. IMIX-1c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.29.12. IMIX-2c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.29.13. IMIX-4c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.30. 10ge2p1x710-ethip4udp-ip4base-oacl10sf-100flows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | OACL | ACL10 | 100_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl10sf-100flows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 10
| ${flows_per_dir}= | 100
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u10p-conc

7.5.30.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.30.2. 64B-1c-ethip4udp-ip4base-oacl10sf-100flows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.30.3. 64B-2c-ethip4udp-ip4base-oacl10sf-100flows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.30.4. 64B-4c-ethip4udp-ip4base-oacl10sf-100flows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.30.5. 1518B-1c-ethip4udp-ip4base-oacl10sf-100flows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.30.6. 1518B-2c-ethip4udp-ip4base-oacl10sf-100flows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.30.7. 1518B-4c-ethip4udp-ip4base-oacl10sf-100flows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.30.8. 9000B-1c-ethip4udp-ip4base-oacl10sf-100flows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.30.9. 9000B-2c-ethip4udp-ip4base-oacl10sf-100flows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.30.10. 9000B-4c-ethip4udp-ip4base-oacl10sf-100flows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.30.11. IMIX-1c-ethip4udp-ip4base-oacl10sf-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.30.12. IMIX-2c-ethip4udp-ip4base-oacl10sf-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.30.13. IMIX-4c-ethip4udp-ip4base-oacl10sf-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.31. 10ge2p1x710-ethip4udp-ip4base-oacl10sf-100kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | OACL | ACL10 | 100K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl10sf-100kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 10
| ${flows_per_dir}= | 100k
| ${ip_nr}= | ${100}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-100u1000p-conc

7.5.31.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.31.2. 64B-1c-ethip4udp-ip4base-oacl10sf-100kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.31.3. 64B-2c-ethip4udp-ip4base-oacl10sf-100kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.31.4. 64B-4c-ethip4udp-ip4base-oacl10sf-100kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.31.5. 1518B-1c-ethip4udp-ip4base-oacl10sf-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.31.6. 1518B-2c-ethip4udp-ip4base-oacl10sf-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.31.7. 1518B-4c-ethip4udp-ip4base-oacl10sf-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.31.8. 9000B-1c-ethip4udp-ip4base-oacl10sf-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.31.9. 9000B-2c-ethip4udp-ip4base-oacl10sf-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.31.10. 9000B-4c-ethip4udp-ip4base-oacl10sf-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.31.11. IMIX-1c-ethip4udp-ip4base-oacl10sf-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.31.12. IMIX-2c-ethip4udp-ip4base-oacl10sf-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.31.13. IMIX-4c-ethip4udp-ip4base-oacl10sf-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.32. 10ge2p1x710-ethip4udp-ip4base-oacl10sf-10kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | OACL | ACL10 | 10K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl10sf-10kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 10
| ${flows_per_dir}= | 10k
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u1000p-conc

7.5.32.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.32.2. 64B-1c-ethip4udp-ip4base-oacl10sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.32.3. 64B-2c-ethip4udp-ip4base-oacl10sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.32.4. 64B-4c-ethip4udp-ip4base-oacl10sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.32.5. 1518B-1c-ethip4udp-ip4base-oacl10sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.32.6. 1518B-2c-ethip4udp-ip4base-oacl10sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.32.7. 1518B-4c-ethip4udp-ip4base-oacl10sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.32.8. 9000B-1c-ethip4udp-ip4base-oacl10sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.32.9. 9000B-2c-ethip4udp-ip4base-oacl10sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.32.10. 9000B-4c-ethip4udp-ip4base-oacl10sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.32.11. IMIX-1c-ethip4udp-ip4base-oacl10sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.32.12. IMIX-2c-ethip4udp-ip4base-oacl10sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.32.13. IMIX-4c-ethip4udp-ip4base-oacl10sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.33. 10ge2p1x710-ethip4udp-ip4base-oacl10sl-100flows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | OACL | ACL10 | 100_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl10sl-100flows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 10
| ${flows_per_dir}= | 100
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u10p-conc

7.5.33.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.33.2. 64B-1c-ethip4udp-ip4base-oacl10sl-100flows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.33.3. 64B-2c-ethip4udp-ip4base-oacl10sl-100flows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.33.4. 64B-4c-ethip4udp-ip4base-oacl10sl-100flows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.33.5. 1518B-1c-ethip4udp-ip4base-oacl10sl-100flows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.33.6. 1518B-2c-ethip4udp-ip4base-oacl10sl-100flows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.33.7. 1518B-4c-ethip4udp-ip4base-oacl10sl-100flows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.33.8. 9000B-1c-ethip4udp-ip4base-oacl10sl-100flows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.33.9. 9000B-2c-ethip4udp-ip4base-oacl10sl-100flows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.33.10. 9000B-4c-ethip4udp-ip4base-oacl10sl-100flows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.33.11. IMIX-1c-ethip4udp-ip4base-oacl10sl-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.33.12. IMIX-2c-ethip4udp-ip4base-oacl10sl-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.33.13. IMIX-4c-ethip4udp-ip4base-oacl10sl-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.34. 10ge2p1x710-ethip4udp-ip4base-oacl10sl-100kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | OACL | ACL10 | 100K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl10sl-100kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 10
| ${flows_per_dir}= | 100k
| ${ip_nr}= | ${100}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-100u1000p-conc

7.5.34.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.34.2. 64B-1c-ethip4udp-ip4base-oacl10sl-100kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.34.3. 64B-2c-ethip4udp-ip4base-oacl10sl-100kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.34.4. 64B-4c-ethip4udp-ip4base-oacl10sl-100kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.34.5. 1518B-1c-ethip4udp-ip4base-oacl10sl-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.34.6. 1518B-2c-ethip4udp-ip4base-oacl10sl-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.34.7. 1518B-4c-ethip4udp-ip4base-oacl10sl-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.34.8. 9000B-1c-ethip4udp-ip4base-oacl10sl-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.34.9. 9000B-2c-ethip4udp-ip4base-oacl10sl-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.34.10. 9000B-4c-ethip4udp-ip4base-oacl10sl-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.34.11. IMIX-1c-ethip4udp-ip4base-oacl10sl-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.34.12. IMIX-2c-ethip4udp-ip4base-oacl10sl-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.34.13. IMIX-4c-ethip4udp-ip4base-oacl10sl-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.35. 10ge2p1x710-ethip4udp-ip4base-oacl10sl-10kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | OACL | ACL10 | 10K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl10sl-10kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 10
| ${flows_per_dir}= | 10k
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u1000p-conc

7.5.35.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.35.2. 64B-1c-ethip4udp-ip4base-oacl10sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.35.3. 64B-2c-ethip4udp-ip4base-oacl10sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.35.4. 64B-4c-ethip4udp-ip4base-oacl10sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.35.5. 1518B-1c-ethip4udp-ip4base-oacl10sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.35.6. 1518B-2c-ethip4udp-ip4base-oacl10sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.35.7. 1518B-4c-ethip4udp-ip4base-oacl10sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.35.8. 9000B-1c-ethip4udp-ip4base-oacl10sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.35.9. 9000B-2c-ethip4udp-ip4base-oacl10sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.35.10. 9000B-4c-ethip4udp-ip4base-oacl10sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.35.11. IMIX-1c-ethip4udp-ip4base-oacl10sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.35.12. IMIX-2c-ethip4udp-ip4base-oacl10sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.35.13. IMIX-4c-ethip4udp-ip4base-oacl10sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.36. 10ge2p1x710-ethip4udp-ip4base-oacl1sf-100flows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | OACL | ACL1 | 100_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl1sf-100flows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 1
| ${flows_per_dir}= | 100
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u10p-conc

7.5.36.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.36.2. 64B-1c-ethip4udp-ip4base-oacl1sf-100flows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.36.3. 64B-2c-ethip4udp-ip4base-oacl1sf-100flows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.36.4. 64B-4c-ethip4udp-ip4base-oacl1sf-100flows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.36.5. 1518B-1c-ethip4udp-ip4base-oacl1sf-100flows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.36.6. 1518B-2c-ethip4udp-ip4base-oacl1sf-100flows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.36.7. 1518B-4c-ethip4udp-ip4base-oacl1sf-100flows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.36.8. 9000B-1c-ethip4udp-ip4base-oacl1sf-100flows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.36.9. 9000B-2c-ethip4udp-ip4base-oacl1sf-100flows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.36.10. 9000B-4c-ethip4udp-ip4base-oacl1sf-100flows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.36.11. IMIX-1c-ethip4udp-ip4base-oacl1sf-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.36.12. IMIX-2c-ethip4udp-ip4base-oacl1sf-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.36.13. IMIX-4c-ethip4udp-ip4base-oacl1sf-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.37. 10ge2p1x710-ethip4udp-ip4base-oacl1sf-100kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | OACL | ACL1 | 100K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl1sf-100kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 1
| ${flows_per_dir}= | 100k
| ${ip_nr}= | ${100}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-100u1000p-conc

7.5.37.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.37.2. 64B-1c-ethip4udp-ip4base-oacl1sf-100kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.37.3. 64B-2c-ethip4udp-ip4base-oacl1sf-100kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.37.4. 64B-4c-ethip4udp-ip4base-oacl1sf-100kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.37.5. 1518B-1c-ethip4udp-ip4base-oacl1sf-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.37.6. 1518B-2c-ethip4udp-ip4base-oacl1sf-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.37.7. 1518B-4c-ethip4udp-ip4base-oacl1sf-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.37.8. 9000B-1c-ethip4udp-ip4base-oacl1sf-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.37.9. 9000B-2c-ethip4udp-ip4base-oacl1sf-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.37.10. 9000B-4c-ethip4udp-ip4base-oacl1sf-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.37.11. IMIX-1c-ethip4udp-ip4base-oacl1sf-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.37.12. IMIX-2c-ethip4udp-ip4base-oacl1sf-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.37.13. IMIX-4c-ethip4udp-ip4base-oacl1sf-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.38. 10ge2p1x710-ethip4udp-ip4base-oacl1sf-10kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | OACL | ACL1 | 10K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl1sf-10kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 1
| ${flows_per_dir}= | 10k
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u1000p-conc

7.5.38.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.38.2. 64B-1c-ethip4udp-ip4base-oacl1sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.38.3. 64B-2c-ethip4udp-ip4base-oacl1sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.38.4. 64B-4c-ethip4udp-ip4base-oacl1sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.38.5. 1518B-1c-ethip4udp-ip4base-oacl1sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.38.6. 1518B-2c-ethip4udp-ip4base-oacl1sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.38.7. 1518B-4c-ethip4udp-ip4base-oacl1sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.38.8. 9000B-1c-ethip4udp-ip4base-oacl1sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.38.9. 9000B-2c-ethip4udp-ip4base-oacl1sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.38.10. 9000B-4c-ethip4udp-ip4base-oacl1sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.38.11. IMIX-1c-ethip4udp-ip4base-oacl1sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.38.12. IMIX-2c-ethip4udp-ip4base-oacl1sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.38.13. IMIX-4c-ethip4udp-ip4base-oacl1sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.39. 10ge2p1x710-ethip4udp-ip4base-oacl1sl-100flows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | OACL | ACL1 | 100_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl1sl-100flows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 1
| ${flows_per_dir}= | 100
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u10p-conc

7.5.39.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.39.2. 64B-1c-ethip4udp-ip4base-oacl1sl-100flows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.39.3. 64B-2c-ethip4udp-ip4base-oacl1sl-100flows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.39.4. 64B-4c-ethip4udp-ip4base-oacl1sl-100flows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.39.5. 1518B-1c-ethip4udp-ip4base-oacl1sl-100flows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.39.6. 1518B-2c-ethip4udp-ip4base-oacl1sl-100flows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.39.7. 1518B-4c-ethip4udp-ip4base-oacl1sl-100flows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.39.8. 9000B-1c-ethip4udp-ip4base-oacl1sl-100flows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.39.9. 9000B-2c-ethip4udp-ip4base-oacl1sl-100flows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.39.10. 9000B-4c-ethip4udp-ip4base-oacl1sl-100flows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.39.11. IMIX-1c-ethip4udp-ip4base-oacl1sl-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.39.12. IMIX-2c-ethip4udp-ip4base-oacl1sl-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.39.13. IMIX-4c-ethip4udp-ip4base-oacl1sl-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.40. 10ge2p1x710-ethip4udp-ip4base-oacl1sl-100kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | OACL | ACL1 | 100K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl1sl-100kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 1
| ${flows_per_dir}= | 100k
| ${ip_nr}= | ${100}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-100u1000p-conc

7.5.40.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.40.2. 64B-1c-ethip4udp-ip4base-oacl1sl-100kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.40.3. 64B-2c-ethip4udp-ip4base-oacl1sl-100kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.40.4. 64B-4c-ethip4udp-ip4base-oacl1sl-100kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.40.5. 1518B-1c-ethip4udp-ip4base-oacl1sl-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.40.6. 1518B-2c-ethip4udp-ip4base-oacl1sl-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.40.7. 1518B-4c-ethip4udp-ip4base-oacl1sl-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.40.8. 9000B-1c-ethip4udp-ip4base-oacl1sl-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.40.9. 9000B-2c-ethip4udp-ip4base-oacl1sl-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.40.10. 9000B-4c-ethip4udp-ip4base-oacl1sl-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.40.11. IMIX-1c-ethip4udp-ip4base-oacl1sl-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.40.12. IMIX-2c-ethip4udp-ip4base-oacl1sl-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.40.13. IMIX-4c-ethip4udp-ip4base-oacl1sl-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.41. 10ge2p1x710-ethip4udp-ip4base-oacl1sl-10kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | OACL | ACL1 | 10K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl1sl-10kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 1
| ${flows_per_dir}= | 10k
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u1000p-conc

7.5.41.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.41.2. 64B-1c-ethip4udp-ip4base-oacl1sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.41.3. 64B-2c-ethip4udp-ip4base-oacl1sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.41.4. 64B-4c-ethip4udp-ip4base-oacl1sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.41.5. 1518B-1c-ethip4udp-ip4base-oacl1sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.41.6. 1518B-2c-ethip4udp-ip4base-oacl1sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.41.7. 1518B-4c-ethip4udp-ip4base-oacl1sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.41.8. 9000B-1c-ethip4udp-ip4base-oacl1sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.41.9. 9000B-2c-ethip4udp-ip4base-oacl1sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.41.10. 9000B-4c-ethip4udp-ip4base-oacl1sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.41.11. IMIX-1c-ethip4udp-ip4base-oacl1sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.41.12. IMIX-2c-ethip4udp-ip4base-oacl1sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.41.13. IMIX-4c-ethip4udp-ip4base-oacl1sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.42. 10ge2p1x710-ethip4udp-ip4base-oacl50sf-100flows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | OACL | ACL50 | 100_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl50sf-100flows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 50
| ${flows_per_dir}= | 100
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u10p-conc

7.5.42.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.42.2. 64B-1c-ethip4udp-ip4base-oacl50sf-100flows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.42.3. 64B-2c-ethip4udp-ip4base-oacl50sf-100flows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.42.4. 64B-4c-ethip4udp-ip4base-oacl50sf-100flows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.42.5. 1518B-1c-ethip4udp-ip4base-oacl50sf-100flows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.42.6. 1518B-2c-ethip4udp-ip4base-oacl50sf-100flows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.42.7. 1518B-4c-ethip4udp-ip4base-oacl50sf-100flows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.42.8. 9000B-1c-ethip4udp-ip4base-oacl50sf-100flows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.42.9. 9000B-2c-ethip4udp-ip4base-oacl50sf-100flows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.42.10. 9000B-4c-ethip4udp-ip4base-oacl50sf-100flows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.42.11. IMIX-1c-ethip4udp-ip4base-oacl50sf-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.42.12. IMIX-2c-ethip4udp-ip4base-oacl50sf-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.42.13. IMIX-4c-ethip4udp-ip4base-oacl50sf-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.43. 10ge2p1x710-ethip4udp-ip4base-oacl50sf-100kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | OACL | ACL50 | 100K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl50sf-100kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 50
| ${flows_per_dir}= | 100k
| ${ip_nr}= | ${100}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-100u1000p-conc

7.5.43.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.43.2. 64B-1c-ethip4udp-ip4base-oacl50sf-100kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.43.3. 64B-2c-ethip4udp-ip4base-oacl50sf-100kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.43.4. 64B-4c-ethip4udp-ip4base-oacl50sf-100kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.43.5. 1518B-1c-ethip4udp-ip4base-oacl50sf-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.43.6. 1518B-2c-ethip4udp-ip4base-oacl50sf-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.43.7. 1518B-4c-ethip4udp-ip4base-oacl50sf-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.43.8. 9000B-1c-ethip4udp-ip4base-oacl50sf-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.43.9. 9000B-2c-ethip4udp-ip4base-oacl50sf-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.43.10. 9000B-4c-ethip4udp-ip4base-oacl50sf-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.43.11. IMIX-1c-ethip4udp-ip4base-oacl50sf-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.43.12. IMIX-2c-ethip4udp-ip4base-oacl50sf-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.43.13. IMIX-4c-ethip4udp-ip4base-oacl50sf-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.44. 10ge2p1x710-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | OACL | ACL50 | 10K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl50sf-10kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 50
| ${flows_per_dir}= | 10k
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u1000p-conc

7.5.44.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.44.2. 64B-1c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.44.3. 64B-2c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.44.4. 64B-4c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.44.5. 1518B-1c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.44.6. 1518B-2c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.44.7. 1518B-4c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.44.8. 9000B-1c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.44.9. 9000B-2c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.44.10. 9000B-4c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.44.11. IMIX-1c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.44.12. IMIX-2c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.44.13. IMIX-4c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.45. 10ge2p1x710-ethip4udp-ip4base-oacl50sl-100flows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | OACL | ACL50 | 100_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl50sl-100flows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 50
| ${flows_per_dir}= | 100
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u10p-conc

7.5.45.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.45.2. 64B-1c-ethip4udp-ip4base-oacl50sl-100flows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.45.3. 64B-2c-ethip4udp-ip4base-oacl50sl-100flows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.45.4. 64B-4c-ethip4udp-ip4base-oacl50sl-100flows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.45.5. 1518B-1c-ethip4udp-ip4base-oacl50sl-100flows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.45.6. 1518B-2c-ethip4udp-ip4base-oacl50sl-100flows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.45.7. 1518B-4c-ethip4udp-ip4base-oacl50sl-100flows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.45.8. 9000B-1c-ethip4udp-ip4base-oacl50sl-100flows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.45.9. 9000B-2c-ethip4udp-ip4base-oacl50sl-100flows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.45.10. 9000B-4c-ethip4udp-ip4base-oacl50sl-100flows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.45.11. IMIX-1c-ethip4udp-ip4base-oacl50sl-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.45.12. IMIX-2c-ethip4udp-ip4base-oacl50sl-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.45.13. IMIX-4c-ethip4udp-ip4base-oacl50sl-100flows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.46. 10ge2p1x710-ethip4udp-ip4base-oacl50sl-100kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | OACL | ACL50 | 100K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl50sl-100kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 50
| ${flows_per_dir}= | 100k
| ${ip_nr}= | ${100}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-100u1000p-conc

7.5.46.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.46.2. 64B-1c-ethip4udp-ip4base-oacl50sl-100kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.46.3. 64B-2c-ethip4udp-ip4base-oacl50sl-100kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.46.4. 64B-4c-ethip4udp-ip4base-oacl50sl-100kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.46.5. 1518B-1c-ethip4udp-ip4base-oacl50sl-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.46.6. 1518B-2c-ethip4udp-ip4base-oacl50sl-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.46.7. 1518B-4c-ethip4udp-ip4base-oacl50sl-100kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.46.8. 9000B-1c-ethip4udp-ip4base-oacl50sl-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.46.9. 9000B-2c-ethip4udp-ip4base-oacl50sl-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.46.10. 9000B-4c-ethip4udp-ip4base-oacl50sl-100kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.46.11. IMIX-1c-ethip4udp-ip4base-oacl50sl-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.46.12. IMIX-2c-ethip4udp-ip4base-oacl50sl-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.46.13. IMIX-4c-ethip4udp-ip4base-oacl50sl-100kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.47. 10ge2p1x710-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 3_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | OACL | ACL50 | 10K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl50sl-10kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 50
| ${flows_per_dir}= | 10k
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-3n-ethip4udp-10u1000p-conc

7.5.47.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.47.2. 64B-1c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.47.3. 64B-2c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.47.4. 64B-4c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.47.5. 1518B-1c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.47.6. 1518B-2c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.47.7. 1518B-4c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.47.8. 9000B-1c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.47.9. 9000B-2c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.47.10. 9000B-4c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.47.11. IMIX-1c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.47.12. IMIX-2c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.47.13. IMIX-4c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.48. 2n1l-10ge2p1x710-dot1q-ip4base-ndrpdr suite

RFC2544: Pkt throughput IPv4 routing with IEEE 802.1Q test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing. IEEE 802.1Q tagging is applied on link between DUT1-if2 and TG-if2.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and two static IPv4 /30 route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains two L3 flow-groups (flow-group per direction, 254 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | BASE | DOT1Q | IP4BASE | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | dot1q-ip4base
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${4}
| ${subid}= | 10
| ${tag_rewrite}= | pop-1
# TG subnets used by T-Rex
| ${tg_if1_net}= | 10.10.10.0
| ${tg_if2_net}= | 20.20.20.0
# Traffic profile
| ${traffic_profile}= | trex-stl-2n-dot1qip4asym-ip4src254

7.5.48.1. Local Template

  • [Cfg] Each DUT runs IPv4 routing with VLAN and uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding with VLAN dot1q sub-interfaces in circular topology  ${tg_if1_net}  ${tg_if2_net}  ${subid}  ${tag_rewrite}
 Then Find NDR and PDR intervals using optimized search

7.5.48.2. 64B-1c-dot1q-ip4base-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.48.3. 64B-2c-dot1q-ip4base-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.48.4. 64B-4c-dot1q-ip4base-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.48.5. 1518B-1c-dot1q-ip4base-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.48.6. 1518B-2c-dot1q-ip4base-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.48.7. 1518B-4c-dot1q-ip4base-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.48.8. 9000B-1c-dot1q-ip4base-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.48.9. 9000B-2c-dot1q-ip4base-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.48.10. 9000B-4c-dot1q-ip4base-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.48.11. IMIX-1c-dot1q-ip4base-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.48.12. IMIX-2c-dot1q-ip4base-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.48.13. IMIX-4c-dot1q-ip4base-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.49. 2n1l-10ge2p1x710-ethip4-ip4base-adlalwlistbase-ndrpdr suite

RFC2544: Pkt throughput IPv4 allowlist test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4. routing, two static IPv4 /24 routes and IPv4 ADL security allowlist ingress /24 filter entries applied on links TG - DUT1. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ADLALWLIST | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4-ip4base-adlalwlistbase
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | adl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# Traffic profile
| ${traffic_profile}= | trex-stl-2n-ethip4-ip4src253

7.5.49.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology
  And Add Fib Table  ${dut1}  1
  And Vpp Route Add  ${dut1}  10.10.10.0  24  vrf=1  local=${TRUE}
  And ADL Add allowlist Entry  ${dut1}  ${DUT1_${int}1}[0]  ip4  1
  And ADL interface enable or disable  ${dut1}  ${DUT1_${int}1}[0]  enable
 Then Find NDR and PDR intervals using optimized search

7.5.49.2. 64B-1c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.49.3. 64B-2c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.49.4. 64B-4c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.49.5. 1518B-1c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.49.6. 1518B-2c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.49.7. 1518B-4c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.49.8. 9000B-1c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.49.9. 9000B-2c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.49.10. 9000B-4c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.49.11. IMIX-1c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.49.12. IMIX-2c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.49.13. IMIX-4c-ethip4-ip4base-adlalwlistbase-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.50. 2n1l-10ge2p1x710-ethip4-ip4base-iacldstbase-ndrpdr suite

RFC2544: Pkt throughput IPv4 iAcl whitelist test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing, two static IPv4 /24 routes and IPv4 iAcl security whitelist ingress /24 filter entries applied on links TG - DUT1. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv6 header and generated payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | IACLDST | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4-ip4base-iacldstbase
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | classify
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# Traffic profile
| ${traffic_profile}= | trex-stl-2n-ethip4-ip4src253

7.5.50.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology
${table_idx}  ${skip_n}  ${match_n}=  And Vpp Creates Classify Table L3  ${dut1}  ip4  dst  255.255.255.0
  And Vpp Configures Classify Session L3  ${dut1}  permit  ${table_idx}  ${skip_n}  ${match_n}  ip4  dst  20.20.20.0
  And Vpp Enable Input Acl Interface  ${dut1}  ${DUT1_${int}1}[0]  ip4  ${table_idx}
  And Vpp Configures Classify Session L3  ${dut1}  permit  ${table_idx}  ${skip_n}  ${match_n}  ip4  dst  10.10.10.0
  And Vpp Enable Input Acl Interface  ${dut1}  ${DUT1_${int}2}[0]  ip4  ${table_idx}
 Then Find NDR and PDR intervals using optimized search

7.5.50.2. 64B-1c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.50.3. 64B-2c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.50.4. 64B-4c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.50.5. 1518B-1c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.50.6. 1518B-2c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.50.7. 1518B-4c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.50.8. 9000B-1c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.50.9. 9000B-2c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.50.10. 9000B-4c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.50.11. IMIX-1c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.50.12. IMIX-2c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.50.13. IMIX-4c-ethip4-ip4base-iacldstbase-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.51. 2n1l-10ge2p1x710-ethip4-ip4base-ipolicemarkbase-ndrpdr suite

RFC2544: Pkt throughput IPv4 policer test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and two IPv4 ARP entries and policer with 2R3C color-aware configuration. Policer is applied on links TG - DUT1. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv6 header and generated payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544, RFC2698.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | IP4FWD | FEATURE | POLICE_MARK | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4-ip4base-ipolicemarkbase
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | classify
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
| ${cir}= | ${100}
| ${eir}= | ${150}
| ${dscp}= | AF22
# Traffic profile
| ${traffic_profile}= | trex-stl-2n-ethip4-ip4src253

7.5.51.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Set Rates For Policer
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology
  And Initialize IPv4 policer 2r3c-'ca' in circular topology
 Then Find NDR and PDR intervals using optimized search

7.5.51.2. 64B-1c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.51.3. 64B-2c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.51.4. 64B-4c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.51.5. 1518B-1c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.51.6. 1518B-2c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.51.7. 1518B-4c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.51.8. 9000B-1c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.51.9. 9000B-2c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.51.10. 9000B-4c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.51.11. IMIX-1c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.51.12. IMIX-2c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.51.13. IMIX-4c-ethip4-ip4base-ipolicemarkbase-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.52. 2n1l-10ge2p1x710-ethip4-ip4base-ndrpdr suite

RFC2544: Pkt throughput IPv4 routing test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | BASE | IP4BASE | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4-ip4base
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# Traffic profile
| ${traffic_profile}= | trex-stl-2n-ethip4-ip4src253

7.5.52.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology
 Then Find NDR and PDR intervals using optimized search

7.5.52.2. 64B-1c-ethip4-ip4base-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.52.3. 64B-2c-ethip4-ip4base-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.52.4. 64B-4c-ethip4-ip4base-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.52.5. 1518B-1c-ethip4-ip4base-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.52.6. 1518B-2c-ethip4-ip4base-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.52.7. 1518B-4c-ethip4-ip4base-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.52.8. 9000B-1c-ethip4-ip4base-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.52.9. 9000B-2c-ethip4-ip4base-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.52.10. 9000B-4c-ethip4-ip4base-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.52.11. IMIX-1c-ethip4-ip4base-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.52.12. IMIX-2c-ethip4-ip4base-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.52.13. IMIX-4c-ethip4-ip4base-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.53. 2n1l-10ge2p1x710-ethip4-ip4scale200k-ndrpdr suite

RFC2544: Pkt throughput IPv4 routing test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and 2x100k static IPv4 /32 route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains two L3 flow-groups (flow-group per direction, 100k flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | SCALE | FIB_200k | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4-ip4scale200k
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
| ${rts_per_flow}= | ${100000}
# Traffic profile
| ${traffic_profile}= | trex-stl-2n-ethip4-ip4dst${rts_per_flow}

7.5.53.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding with scaling in circular topology  ${rts_per_flow}
 Then Find NDR and PDR intervals using optimized search

7.5.53.2. 64B-1c-ethip4-ip4scale200k-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.53.3. 64B-2c-ethip4-ip4scale200k-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.53.4. 64B-4c-ethip4-ip4scale200k-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.53.5. 1518B-1c-ethip4-ip4scale200k-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.53.6. 1518B-2c-ethip4-ip4scale200k-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.53.7. 1518B-4c-ethip4-ip4scale200k-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.53.8. 9000B-1c-ethip4-ip4scale200k-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.53.9. 9000B-2c-ethip4-ip4scale200k-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.53.10. 9000B-4c-ethip4-ip4scale200k-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.53.11. IMIX-1c-ethip4-ip4scale200k-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.53.12. IMIX-2c-ethip4-ip4scale200k-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.53.13. IMIX-4c-ethip4-ip4scale200k-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.54. 2n1l-10ge2p1x710-ethip4-ip4scale200k-rnd-ndrpdr suite

RFC2544: Pkt throughput IPv4 routing test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and 2x100k static IPv4 /32 route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains 2 randomized L3 flow-groups (flow-group per direction, 100k flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | SCALE | FIB_200K | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | IP4_RND
| ... | ethip4-ip4scale200k-rnd
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
| ${rts_per_flow}= | ${100000}
# Traffic profile
| ${traffic_profile}= | trex-stl-ethip4-ip4dst-rnd${rts_per_flow}

7.5.54.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding with scaling in circular topology  ${rts_per_flow}
 Then Find NDR and PDR intervals using optimized search

7.5.54.2. 64B-1c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.54.3. 64B-2c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.54.4. 64B-4c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.54.5. 1518B-1c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.54.6. 1518B-2c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.54.7. 1518B-4c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.54.8. 9000B-1c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.54.9. 9000B-2c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.54.10. 9000B-4c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.54.11. IMIX-1c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.54.12. IMIX-2c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.54.13. IMIX-4c-ethip4-ip4scale200k-rnd-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.55. 2n1l-10ge2p1x710-ethip4-ip4scale20k-ndrpdr suite

RFC2544: Pkt throughput IPv4 routing test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and 2x10k static IPv4 /32 route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains two L3 flow-groups (flow-group per direction, 10k flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | SCALE | FIB_20k | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4-ip4scale20k
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
| ${rts_per_flow}= | ${10000}
# Traffic profile
| ${traffic_profile}= | trex-stl-2n-ethip4-ip4dst${rts_per_flow}

7.5.55.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding with scaling in circular topology  ${rts_per_flow}
 Then Find NDR and PDR intervals using optimized search

7.5.55.2. 64B-1c-ethip4-ip4scale20k-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.55.3. 64B-2c-ethip4-ip4scale20k-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.55.4. 64B-4c-ethip4-ip4scale20k-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.55.5. 1518B-1c-ethip4-ip4scale20k-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.55.6. 1518B-2c-ethip4-ip4scale20k-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.55.7. 1518B-4c-ethip4-ip4scale20k-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.55.8. 9000B-1c-ethip4-ip4scale20k-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.55.9. 9000B-2c-ethip4-ip4scale20k-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.55.10. 9000B-4c-ethip4-ip4scale20k-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.55.11. IMIX-1c-ethip4-ip4scale20k-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.55.12. IMIX-2c-ethip4-ip4scale20k-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.55.13. IMIX-4c-ethip4-ip4scale20k-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.56. 2n1l-10ge2p1x710-ethip4-ip4scale20k-rnd-ndrpdr suite

RFC2544: Pkt throughput IPv4 routing test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and 2x10k static IPv4 /32 route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains 2 randomized L3 flow-groups (flow-group per direction, 10k flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | SCALE | FIB_20K | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | IP4_RND
| ... | ethip4-ip4scale20k-rnd
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
| ${rts_per_flow}= | ${10000}
# Traffic profile
| ${traffic_profile}= | trex-stl-ethip4-ip4dst-rnd${rts_per_flow}

7.5.56.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding with scaling in circular topology  ${rts_per_flow}
 Then Find NDR and PDR intervals using optimized search

7.5.56.2. 64B-1c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.56.3. 64B-2c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.56.4. 64B-4c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.56.5. 1518B-1c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.56.6. 1518B-2c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.56.7. 1518B-4c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.56.8. 9000B-1c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.56.9. 9000B-2c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.56.10. 9000B-4c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.56.11. IMIX-1c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.56.12. IMIX-2c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.56.13. IMIX-4c-ethip4-ip4scale20k-rnd-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.57. 2n1l-10ge2p1x710-ethip4-ip4scale2m-ndrpdr suite

RFC2544: Pkt throughput IPv4 routing test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and 2x1M static IPv4 /32 route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains two L3 flow-groups (flow-group per direction, 1M flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | SCALE | FIB_2M | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4-ip4scale2m
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
| ${rts_per_flow}= | ${1000000}
# Traffic profile
| ${traffic_profile}= | trex-stl-2n-ethip4-ip4dst${rts_per_flow}

7.5.57.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding with scaling in circular topology  ${rts_per_flow}
 Then Find NDR and PDR intervals using optimized search

7.5.57.2. 64B-1c-ethip4-ip4scale2m-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.57.3. 64B-2c-ethip4-ip4scale2m-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.57.4. 64B-4c-ethip4-ip4scale2m-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.57.5. 1518B-1c-ethip4-ip4scale2m-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.57.6. 1518B-2c-ethip4-ip4scale2m-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.57.7. 1518B-4c-ethip4-ip4scale2m-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.57.8. 9000B-1c-ethip4-ip4scale2m-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.57.9. 9000B-2c-ethip4-ip4scale2m-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.57.10. 9000B-4c-ethip4-ip4scale2m-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.57.11. IMIX-1c-ethip4-ip4scale2m-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.57.12. IMIX-2c-ethip4-ip4scale2m-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.57.13. IMIX-4c-ethip4-ip4scale2m-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.58. 2n1l-10ge2p1x710-ethip4-ip4scale2m-rnd-ndrpdr suite

RFC2544: Pkt throughput IPv4 routing test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and 2x1M static IPv4 /32 route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains 2 randomized L3 flow-groups (flow-group per direction, 1M flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | SCALE | FIB_2M | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | IP4_RND
| ... | ethip4-ip4scale2m-rnd
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
| ${rts_per_flow}= | ${1000000}
# Traffic profile
| ${traffic_profile}= | trex-stl-ethip4-ip4dst-rnd${rts_per_flow}

7.5.58.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding with scaling in circular topology  ${rts_per_flow}
 Then Find NDR and PDR intervals using optimized search

7.5.58.2. 64B-1c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.58.3. 64B-2c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.58.4. 64B-4c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.58.5. 1518B-1c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.58.6. 1518B-2c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.58.7. 1518B-4c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.58.8. 9000B-1c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.58.9. 9000B-2c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.58.10. 9000B-4c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.58.11. IMIX-1c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.58.12. IMIX-2c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.58.13. IMIX-4c-ethip4-ip4scale2m-rnd-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.59. 2n1l-10ge2p1x710-ethip4tcp-ip4base-h1024-p63-s64512-cps-ndrpdr suite

CPS on empty TCP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional TCP flows) with all packets containing Ethernet header, IPv4 header with TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | IP4BASE | TCP | TCP_CPS | DRV_VFIO_PCI
| ... | SCALE | HOSTS_1024 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-ip4base-h1024-p63-s64512-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${1024}
| ${n_ports}= | ${63}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
| ${packets_per_transaction_and_direction}= | ${4}
| ${packets_per_transaction_aggregated}= | ${7}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h
| ${transaction_type}= | tcp_cps
| ${disable_latency}= | ${True}

7.5.59.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  192.168.0.0  20.0.0.0  ${22}
 Then Find NDR and PDR intervals using optimized search

7.5.59.2. 64B-1c-ethip4tcp-ip4base-h1024-p63-s64512-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.59.3. 64B-2c-ethip4tcp-ip4base-h1024-p63-s64512-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.59.4. 64B-4c-ethip4tcp-ip4base-h1024-p63-s64512-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.60. 2n1l-10ge2p1x710-ethip4tcp-ip4base-h1024-p63-s64512-tput-ndrpdr suite

TPUT on lightweight TCP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains client and server ASTF programs, generating packets containing Ethernet header, IPv4 header, TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | IP4BASE | TCP | TCP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_1024 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-ip4base-h1024-p63-s64512-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| # TODO CSIT-1765: Unify suite Documentation.
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${1024}
| ${n_ports}= | ${63}
| ${packets_per_transaction_and_direction}= | ${4 + ${ASTF_N_DATA_FRAMES}}
| ${packets_per_transaction_aggregated}= | ${6 + 2 * ${ASTF_N_DATA_FRAMES}}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
# Traffic profile:
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h-pps
| ${transaction_type}= | tcp_pps
| ${disable_latency}= | ${True}

7.5.60.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  192.168.0.0  20.0.0.0  ${22}
 Then Find NDR and PDR intervals using optimized search

7.5.60.2. 100B-1c-ethip4tcp-ip4base-h1024-p63-s64512-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.60.3. 100B-2c-ethip4tcp-ip4base-h1024-p63-s64512-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.60.4. 100B-4c-ethip4tcp-ip4base-h1024-p63-s64512-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.60.5. 1518B-1c-ethip4tcp-ip4base-h1024-p63-s64512-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.60.6. 1518B-2c-ethip4tcp-ip4base-h1024-p63-s64512-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.60.7. 1518B-4c-ethip4tcp-ip4base-h1024-p63-s64512-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.60.8. 9000B-1c-ethip4tcp-ip4base-h1024-p63-s64512-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.60.9. 9000B-2c-ethip4tcp-ip4base-h1024-p63-s64512-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.60.10. 9000B-4c-ethip4tcp-ip4base-h1024-p63-s64512-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.61. 2n1l-10ge2p1x710-ethip4tcp-ip4base-h16384-p63-s1032192-cps-ndrpdr suite

CPS on empty TCP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional TCP flows) with all packets containing Ethernet header, IPv4 header with TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | IP4BASE | TCP | TCP_CPS | DRV_VFIO_PCI
| ... | SCALE | HOSTS_16384 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-ip4base-h16384-p63-s1032192-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${16384}
| ${n_ports}= | ${63}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
| ${packets_per_transaction_and_direction}= | ${4}
| ${packets_per_transaction_aggregated}= | ${7}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h
| ${transaction_type}= | tcp_cps
| ${disable_latency}= | ${True}

7.5.61.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  192.168.0.0  20.0.0.0  ${18}
 Then Find NDR and PDR intervals using optimized search

7.5.61.2. 64B-1c-ethip4tcp-ip4base-h16384-p63-s1032192-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.61.3. 64B-2c-ethip4tcp-ip4base-h16384-p63-s1032192-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.61.4. 64B-4c-ethip4tcp-ip4base-h16384-p63-s1032192-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.62. 2n1l-10ge2p1x710-ethip4tcp-ip4base-h16384-p63-s1032192-tput-ndrpdr suite

TPUT on lightweight TCP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains client and server ASTF programs, generating packets containing Ethernet header, IPv4 header, TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | IP4BASE | TCP | TCP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_16384 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-ip4base-h16384-p63-s1032192-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| # TODO CSIT-1765: Unify suite Documentation.
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${16384}
| ${n_ports}= | ${63}
| ${packets_per_transaction_and_direction}= | ${4 + ${ASTF_N_DATA_FRAMES}}
| ${packets_per_transaction_aggregated}= | ${6 + 2 * ${ASTF_N_DATA_FRAMES}}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
# Traffic profile:
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h-pps
| ${transaction_type}= | tcp_pps
| ${disable_latency}= | ${True}

7.5.62.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  192.168.0.0  20.0.0.0  ${18}
 Then Find NDR and PDR intervals using optimized search

7.5.62.2. 100B-1c-ethip4tcp-ip4base-h16384-p63-s1032192-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.62.3. 100B-2c-ethip4tcp-ip4base-h16384-p63-s1032192-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.62.4. 100B-4c-ethip4tcp-ip4base-h16384-p63-s1032192-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.62.5. 1518B-1c-ethip4tcp-ip4base-h16384-p63-s1032192-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.62.6. 1518B-2c-ethip4tcp-ip4base-h16384-p63-s1032192-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.62.7. 1518B-4c-ethip4tcp-ip4base-h16384-p63-s1032192-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.62.8. 9000B-1c-ethip4tcp-ip4base-h16384-p63-s1032192-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.62.9. 9000B-2c-ethip4tcp-ip4base-h16384-p63-s1032192-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.62.10. 9000B-4c-ethip4tcp-ip4base-h16384-p63-s1032192-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.63. 2n1l-10ge2p1x710-ethip4tcp-ip4base-h262144-p63-s16515072-cps-ndrpdr suite

CPS on empty TCP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional TCP flows) with all packets containing Ethernet header, IPv4 header with TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | IP4BASE | TCP | TCP_CPS | DRV_VFIO_PCI
| ... | SCALE | HOSTS_262144 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-ip4base-h262144-p63-s16515072-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${262144}
| ${n_ports}= | ${63}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
| ${packets_per_transaction_and_direction}= | ${4}
| ${packets_per_transaction_aggregated}= | ${7}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h
| ${transaction_type}= | tcp_cps
| ${disable_latency}= | ${True}

7.5.63.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  172.16.0.0  20.16.0.0  ${14}
 Then Find NDR and PDR intervals using optimized search

7.5.63.2. 64B-1c-ethip4tcp-ip4base-h262144-p63-s16515072-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.63.3. 64B-2c-ethip4tcp-ip4base-h262144-p63-s16515072-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.63.4. 64B-4c-ethip4tcp-ip4base-h262144-p63-s16515072-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.64. 2n1l-10ge2p1x710-ethip4tcp-ip4base-h262144-p63-s16515072-tput-ndrpdr suite

TPUT on lightweight TCP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains client and server ASTF programs, generating packets containing Ethernet header, IPv4 header, TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | IP4BASE | TCP | TCP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_262144 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-ip4base-h262144-p63-s16515072-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| # TODO CSIT-1765: Unify suite Documentation.
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${262144}
| ${n_ports}= | ${63}
| ${packets_per_transaction_and_direction}= | ${4 + ${ASTF_N_DATA_FRAMES}}
| ${packets_per_transaction_aggregated}= | ${6 + 2 * ${ASTF_N_DATA_FRAMES}}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
# Traffic profile:
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h-pps
| ${transaction_type}= | tcp_pps
| ${disable_latency}= | ${True}

7.5.64.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  172.16.0.0  20.16.0.0  ${14}
 Then Find NDR and PDR intervals using optimized search

7.5.64.2. 100B-1c-ethip4tcp-ip4base-h262144-p63-s16515072-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.64.3. 100B-2c-ethip4tcp-ip4base-h262144-p63-s16515072-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.64.4. 100B-4c-ethip4tcp-ip4base-h262144-p63-s16515072-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.64.5. 1518B-1c-ethip4tcp-ip4base-h262144-p63-s16515072-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.64.6. 1518B-2c-ethip4tcp-ip4base-h262144-p63-s16515072-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.64.7. 1518B-4c-ethip4tcp-ip4base-h262144-p63-s16515072-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.64.8. 9000B-1c-ethip4tcp-ip4base-h262144-p63-s16515072-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.64.9. 9000B-2c-ethip4tcp-ip4base-h262144-p63-s16515072-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.64.10. 9000B-4c-ethip4tcp-ip4base-h262144-p63-s16515072-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.65. 2n1l-10ge2p1x710-ethip4tcp-ip4base-h4096-p63-s258048-cps-ndrpdr suite

CPS on empty TCP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional TCP flows) with all packets containing Ethernet header, IPv4 header with TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | IP4BASE | TCP | TCP_CPS | DRV_VFIO_PCI
| ... | SCALE | HOSTS_4096 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-ip4base-h4096-p63-s258048-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${4096}
| ${n_ports}= | ${63}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
| ${packets_per_transaction_and_direction}= | ${4}
| ${packets_per_transaction_aggregated}= | ${7}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h
| ${transaction_type}= | tcp_cps
| ${disable_latency}= | ${True}

7.5.65.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  192.168.0.0  20.0.0.0  ${20}
 Then Find NDR and PDR intervals using optimized search

7.5.65.2. 64B-1c-ethip4tcp-ip4base-h4096-p63-s258048-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.65.3. 64B-2c-ethip4tcp-ip4base-h4096-p63-s258048-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.65.4. 64B-4c-ethip4tcp-ip4base-h4096-p63-s258048-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.66. 2n1l-10ge2p1x710-ethip4tcp-ip4base-h4096-p63-s258048-tput-ndrpdr suite

TPUT on lightweight TCP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains client and server ASTF programs, generating packets containing Ethernet header, IPv4 header, TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | IP4BASE | TCP | TCP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_4096 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-ip4base-h4096-p63-s258048-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| # TODO CSIT-1765: Unify suite Documentation.
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${4096}
| ${n_ports}= | ${63}
| ${packets_per_transaction_and_direction}= | ${4 + ${ASTF_N_DATA_FRAMES}}
| ${packets_per_transaction_aggregated}= | ${6 + 2 * ${ASTF_N_DATA_FRAMES}}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
# Traffic profile:
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h-pps
| ${transaction_type}= | tcp_pps
| ${disable_latency}= | ${True}

7.5.66.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  192.168.0.0  20.0.0.0  ${20}
 Then Find NDR and PDR intervals using optimized search

7.5.66.2. 100B-1c-ethip4tcp-ip4base-h4096-p63-s258048-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.66.3. 100B-2c-ethip4tcp-ip4base-h4096-p63-s258048-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.66.4. 100B-4c-ethip4tcp-ip4base-h4096-p63-s258048-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.66.5. 1518B-1c-ethip4tcp-ip4base-h4096-p63-s258048-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.66.6. 1518B-2c-ethip4tcp-ip4base-h4096-p63-s258048-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.66.7. 1518B-4c-ethip4tcp-ip4base-h4096-p63-s258048-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.66.8. 9000B-1c-ethip4tcp-ip4base-h4096-p63-s258048-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.66.9. 9000B-2c-ethip4tcp-ip4base-h4096-p63-s258048-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.66.10. 9000B-4c-ethip4tcp-ip4base-h4096-p63-s258048-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.67. 2n1l-10ge2p1x710-ethip4tcp-ip4base-h65536-p63-s4128768-cps-ndrpdr suite

CPS on empty TCP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional TCP flows) with all packets containing Ethernet header, IPv4 header with TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | IP4BASE | TCP | TCP_CPS | DRV_VFIO_PCI
| ... | SCALE | HOSTS_65536 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-ip4base-h65536-p63-s4128768-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${65536}
| ${n_ports}= | ${63}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
| ${packets_per_transaction_and_direction}= | ${4}
| ${packets_per_transaction_aggregated}= | ${7}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h
| ${transaction_type}= | tcp_cps
| ${disable_latency}= | ${True}

7.5.67.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  192.168.0.0  20.0.0.0  ${16}
 Then Find NDR and PDR intervals using optimized search

7.5.67.2. 64B-1c-ethip4tcp-ip4base-h65536-p63-s4128768-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.67.3. 64B-2c-ethip4tcp-ip4base-h65536-p63-s4128768-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.67.4. 64B-4c-ethip4tcp-ip4base-h65536-p63-s4128768-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.68. 2n1l-10ge2p1x710-ethip4tcp-ip4base-h65536-p63-s4128768-tput-ndrpdr suite

TPUT on lightweight TCP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains client and server ASTF programs, generating packets containing Ethernet header, IPv4 header, TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | IP4BASE | TCP | TCP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_65536 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-ip4base-h65536-p63-s4128768-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| # TODO CSIT-1765: Unify suite Documentation.
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${65536}
| ${n_ports}= | ${63}
| ${packets_per_transaction_and_direction}= | ${4 + ${ASTF_N_DATA_FRAMES}}
| ${packets_per_transaction_aggregated}= | ${6 + 2 * ${ASTF_N_DATA_FRAMES}}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
# Traffic profile:
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h-pps
| ${transaction_type}= | tcp_pps
| ${disable_latency}= | ${True}

7.5.68.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  192.168.0.0  20.0.0.0  ${16}
 Then Find NDR and PDR intervals using optimized search

7.5.68.2. 100B-1c-ethip4tcp-ip4base-h65536-p63-s4128768-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.68.3. 100B-2c-ethip4tcp-ip4base-h65536-p63-s4128768-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.68.4. 100B-4c-ethip4tcp-ip4base-h65536-p63-s4128768-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.68.5. 1518B-1c-ethip4tcp-ip4base-h65536-p63-s4128768-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.68.6. 1518B-2c-ethip4tcp-ip4base-h65536-p63-s4128768-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.68.7. 1518B-4c-ethip4tcp-ip4base-h65536-p63-s4128768-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.68.8. 9000B-1c-ethip4tcp-ip4base-h65536-p63-s4128768-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.68.9. 9000B-2c-ethip4tcp-ip4base-h65536-p63-s4128768-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.68.10. 9000B-4c-ethip4tcp-ip4base-h65536-p63-s4128768-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.69. 2n1l-10ge2p1x710-ethip4tcp-nat44ed-h1024-p63-s64512-cps-ndrpdr suite

CPS on empty TCP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and one static IPv4 /18 route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional TCP flows) with all packets containing Ethernet header, IPv4 header with TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: Benchmarking Methodology for Network Security Device Performance (draft-ietf-bmwg-ngfw-performance-03).

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
| Resource | resources/libraries/robot/ip/nat.robot
| Resource | resources/libraries/robot/shared/traffic.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | TCP | TCP_CPS
| ... | NAT44_ENDPOINT_DEPENDENT | SCALE | HOSTS_1024 | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-nat44ed-h1024-p63-s64512-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${22}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${22}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.0
| ${out_mask}= | ${32}
# Scale settings
| ${n_hosts}= | ${1024}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${transaction_scale}= | ${n_sessions}
| ${packets_per_transaction_and_direction}= | ${4}
| ${packets_per_transaction_aggregated}= | ${7}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h
| ${transaction_type}= | tcp_cps
| ${disable_latency}= | ${True}

7.5.69.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Find NDR and PDR intervals using optimized search

7.5.69.2. 64B-1c-ethip4tcp-nat44ed-h1024-p63-s64512-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.69.3. 64B-2c-ethip4tcp-nat44ed-h1024-p63-s64512-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.69.4. 64B-4c-ethip4tcp-nat44ed-h1024-p63-s64512-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.70. 2n1l-10ge2p1x710-ethip4tcp-nat44ed-h1024-p63-s64512-tput-ndrpdr suite

TPUT on lightweight TCP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains client and server ASTF programs, generating packets containing Ethernet header, IPv4 header, TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | NAT44 | TCP | TCP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_1024 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-nat44ed-h1024-p63-s64512-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| # TODO CSIT-1765: Unify suite Documentation.
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${22}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${22}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.0
| ${out_mask}= | ${32}
# Scale settings
| ${n_hosts}= | ${1024}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${packets_per_transaction_and_direction}= | ${4 + ${ASTF_N_DATA_FRAMES}}
| ${packets_per_transaction_aggregated}= | ${6 + 2 * ${ASTF_N_DATA_FRAMES}}
| ${transaction_scale}= | ${n_sessions}
# Ramp-up settings
| ${ramp_up_rate}= | ${30000}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h-pps
| ${transaction_type}= | tcp_pps
| ${disable_latency}= | ${True}

7.5.70.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Send ramp-up traffic
  And Verify NAT44 TCP sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search
  And Verify NAT44 TCP sessions number on DUT1 node

7.5.70.2. 100B-1c-ethip4tcp-nat44ed-h1024-p63-s64512-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.70.3. 100B-2c-ethip4tcp-nat44ed-h1024-p63-s64512-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.70.4. 100B-4c-ethip4tcp-nat44ed-h1024-p63-s64512-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.70.5. 1518B-1c-ethip4tcp-nat44ed-h1024-p63-s64512-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.70.6. 1518B-2c-ethip4tcp-nat44ed-h1024-p63-s64512-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.70.7. 1518B-4c-ethip4tcp-nat44ed-h1024-p63-s64512-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.70.8. 9000B-1c-ethip4tcp-nat44ed-h1024-p63-s64512-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.70.9. 9000B-2c-ethip4tcp-nat44ed-h1024-p63-s64512-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.70.10. 9000B-4c-ethip4tcp-nat44ed-h1024-p63-s64512-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.71. 2n1l-10ge2p1x710-ethip4tcp-nat44ed-h16384-p63-s1032192-cps-ndrpdr suite

CPS on empty TCP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and one static IPv4 /18 route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional TCP flows) with all packets containing Ethernet header, IPv4 header with TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: Benchmarking Methodology for Network Security Device Performance (draft-ietf-bmwg-ngfw-performance-03).

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
| Resource | resources/libraries/robot/ip/nat.robot
| Resource | resources/libraries/robot/shared/traffic.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | TCP | TCP_CPS
| ... | NAT44_ENDPOINT_DEPENDENT | SCALE | HOSTS_16384 | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-nat44ed-h16384-p63-s1032192-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${18}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${18}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.15
| ${out_mask}= | ${28}
# Scale settings
| ${n_hosts}= | ${16384}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${transaction_scale}= | ${n_sessions}
| ${packets_per_transaction_and_direction}= | ${4}
| ${packets_per_transaction_aggregated}= | ${7}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h
| ${transaction_type}= | tcp_cps
| ${disable_latency}= | ${True}

7.5.71.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Find NDR and PDR intervals using optimized search

7.5.71.2. 64B-1c-ethip4tcp-nat44ed-h16384-p63-s1032192-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.71.3. 64B-2c-ethip4tcp-nat44ed-h16384-p63-s1032192-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.71.4. 64B-4c-ethip4tcp-nat44ed-h16384-p63-s1032192-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.72. 2n1l-10ge2p1x710-ethip4tcp-nat44ed-h16384-p63-s1032192-tput-ndrpdr suite

TPUT on lightweight TCP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains client and server ASTF programs, generating packets containing Ethernet header, IPv4 header, TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | NAT44 | TCP | TCP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_16384 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-nat44ed-h16384-p63-s1032192-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| # TODO CSIT-1765: Unify suite Documentation.
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${18}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${18}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.15
| ${out_mask}= | ${28}
# Scale settings
| ${n_hosts}= | ${16384}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${packets_per_transaction_and_direction}= | ${4 + ${ASTF_N_DATA_FRAMES}}
| ${packets_per_transaction_aggregated}= | ${6 + 2 * ${ASTF_N_DATA_FRAMES}}
| ${transaction_scale}= | ${n_sessions}
# Ramp-up settings
| ${ramp_up_rate}= | ${30000}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h-pps
| ${transaction_type}= | tcp_pps
| ${disable_latency}= | ${True}

7.5.72.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Send ramp-up traffic
  And Verify NAT44 TCP sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search
  And Verify NAT44 TCP sessions number on DUT1 node

7.5.72.2. 100B-1c-ethip4tcp-nat44ed-h16384-p63-s1032192-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.72.3. 100B-2c-ethip4tcp-nat44ed-h16384-p63-s1032192-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.72.4. 100B-4c-ethip4tcp-nat44ed-h16384-p63-s1032192-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.72.5. 1518B-1c-ethip4tcp-nat44ed-h16384-p63-s1032192-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.72.6. 1518B-2c-ethip4tcp-nat44ed-h16384-p63-s1032192-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.72.7. 1518B-4c-ethip4tcp-nat44ed-h16384-p63-s1032192-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.72.8. 9000B-1c-ethip4tcp-nat44ed-h16384-p63-s1032192-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.72.9. 9000B-2c-ethip4tcp-nat44ed-h16384-p63-s1032192-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.72.10. 9000B-4c-ethip4tcp-nat44ed-h16384-p63-s1032192-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.73. 2n1l-10ge2p1x710-ethip4tcp-nat44ed-h262144-p63-s16515072-cps-ndrpdr suite

CPS on empty TCP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and one static IPv4 /18 route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional TCP flows) with all packets containing Ethernet header, IPv4 header with TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: Benchmarking Methodology for Network Security Device Performance (draft-ietf-bmwg-ngfw-performance-03).

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
| Resource | resources/libraries/robot/ip/nat.robot
| Resource | resources/libraries/robot/shared/traffic.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | TCP | TCP_CPS
| ... | NAT44_ENDPOINT_DEPENDENT | SCALE | HOSTS_262144 | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-nat44ed-h262144-p63-s16515072-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.16.0.0
| ${dest_mask}= | ${14}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 172.16.0.0
| ${in_mask}= | ${14}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.255
| ${out_mask}= | ${24}
# Scale settings
| ${n_hosts}= | ${262144}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${transaction_scale}= | ${n_sessions}
| ${packets_per_transaction_and_direction}= | ${4}
| ${packets_per_transaction_aggregated}= | ${7}
# Main heap size multiplicator
| ${heap_size_mult}= | ${7}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h
| ${transaction_type}= | tcp_cps
| ${disable_latency}= | ${True}

7.5.73.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Find NDR and PDR intervals using optimized search

7.5.73.2. 64B-1c-ethip4tcp-nat44ed-h262144-p63-s16515072-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.73.3. 64B-2c-ethip4tcp-nat44ed-h262144-p63-s16515072-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.73.4. 64B-4c-ethip4tcp-nat44ed-h262144-p63-s16515072-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.74. 2n1l-10ge2p1x710-ethip4tcp-nat44ed-h262144-p63-s16515072-tput-ndrpdr suite

TPUT on lightweight TCP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains client and server ASTF programs, generating packets containing Ethernet header, IPv4 header, TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | NAT44 | TCP | TCP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_262144 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-nat44ed-h262144-p63-s16515072-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| # TODO CSIT-1765: Unify suite Documentation.
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.16.0.0
| ${dest_mask}= | ${14}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 172.16.0.0
| ${in_mask}= | ${14}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.255
| ${out_mask}= | ${24}
# Scale settings
| ${n_hosts}= | ${262144}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${packets_per_transaction_and_direction}= | ${4 + ${ASTF_N_DATA_FRAMES}}
| ${packets_per_transaction_aggregated}= | ${6 + 2 * ${ASTF_N_DATA_FRAMES}}
| ${transaction_scale}= | ${n_sessions}
# Main heap size multiplicator
| ${heap_size_mult}= | ${7}
# Ramp-up settings
| ${ramp_up_rate}= | ${30000}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h-pps
| ${transaction_type}= | tcp_pps
| ${disable_latency}= | ${True}

7.5.74.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Send ramp-up traffic
  And Verify NAT44 TCP sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search
  And Verify NAT44 TCP sessions number on DUT1 node

7.5.74.2. 100B-1c-ethip4tcp-nat44ed-h262144-p63-s16515072-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.74.3. 100B-2c-ethip4tcp-nat44ed-h262144-p63-s16515072-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.74.4. 100B-4c-ethip4tcp-nat44ed-h262144-p63-s16515072-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.74.5. 1518B-1c-ethip4tcp-nat44ed-h262144-p63-s16515072-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.74.6. 1518B-2c-ethip4tcp-nat44ed-h262144-p63-s16515072-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.74.7. 1518B-4c-ethip4tcp-nat44ed-h262144-p63-s16515072-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.74.8. 9000B-1c-ethip4tcp-nat44ed-h262144-p63-s16515072-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.74.9. 9000B-2c-ethip4tcp-nat44ed-h262144-p63-s16515072-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.74.10. 9000B-4c-ethip4tcp-nat44ed-h262144-p63-s16515072-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.75. 2n1l-10ge2p1x710-ethip4tcp-nat44ed-h4096-p63-s258048-cps-ndrpdr suite

CPS on empty TCP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and one static IPv4 /18 route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional TCP flows) with all packets containing Ethernet header, IPv4 header with TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: Benchmarking Methodology for Network Security Device Performance (draft-ietf-bmwg-ngfw-performance-03).

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
| Resource | resources/libraries/robot/ip/nat.robot
| Resource | resources/libraries/robot/shared/traffic.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | TCP | TCP_CPS
| ... | NAT44_ENDPOINT_DEPENDENT | SCALE | HOSTS_4096 | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-nat44ed-h4096-p63-s258048-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${20}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${20}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.3
| ${out_mask}= | ${30}
# Scale settings
| ${n_hosts}= | ${4096}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${transaction_scale}= | ${n_sessions}
| ${packets_per_transaction_and_direction}= | ${4}
| ${packets_per_transaction_aggregated}= | ${7}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h
| ${transaction_type}= | tcp_cps
| ${disable_latency}= | ${True}

7.5.75.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Find NDR and PDR intervals using optimized search

7.5.75.2. 64B-1c-ethip4tcp-nat44ed-h4096-p63-s258048-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.75.3. 64B-2c-ethip4tcp-nat44ed-h4096-p63-s258048-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.75.4. 64B-4c-ethip4tcp-nat44ed-h4096-p63-s258048-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.76. 2n1l-10ge2p1x710-ethip4tcp-nat44ed-h4096-p63-s258048-tput-ndrpdr suite

TPUT on lightweight TCP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains client and server ASTF programs, generating packets containing Ethernet header, IPv4 header, TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | NAT44 | TCP | TCP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_4096 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-nat44ed-h4096-p63-s258048-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| # TODO CSIT-1765: Unify suite Documentation.
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${20}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${20}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.3
| ${out_mask}= | ${30}
# Scale settings
| ${n_hosts}= | ${4096}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${packets_per_transaction_and_direction}= | ${4 + ${ASTF_N_DATA_FRAMES}}
| ${packets_per_transaction_aggregated}= | ${6 + 2 * ${ASTF_N_DATA_FRAMES}}
| ${transaction_scale}= | ${n_sessions}
# Ramp-up settings
| ${ramp_up_rate}= | ${30000}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h-pps
| ${transaction_type}= | tcp_pps
| ${disable_latency}= | ${True}

7.5.76.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Send ramp-up traffic
  And Verify NAT44 TCP sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search
  And Verify NAT44 TCP sessions number on DUT1 node

7.5.76.2. 100B-1c-ethip4tcp-nat44ed-h4096-p63-s258048-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.76.3. 100B-2c-ethip4tcp-nat44ed-h4096-p63-s258048-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.76.4. 100B-4c-ethip4tcp-nat44ed-h4096-p63-s258048-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.76.5. 1518B-1c-ethip4tcp-nat44ed-h4096-p63-s258048-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.76.6. 1518B-2c-ethip4tcp-nat44ed-h4096-p63-s258048-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.76.7. 1518B-4c-ethip4tcp-nat44ed-h4096-p63-s258048-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.76.8. 9000B-1c-ethip4tcp-nat44ed-h4096-p63-s258048-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.76.9. 9000B-2c-ethip4tcp-nat44ed-h4096-p63-s258048-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.76.10. 9000B-4c-ethip4tcp-nat44ed-h4096-p63-s258048-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.77. 2n1l-10ge2p1x710-ethip4tcp-nat44ed-h65536-p63-s4128768-cps-ndrpdr suite

CPS on empty TCP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and one static IPv4 /18 route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional TCP flows) with all packets containing Ethernet header, IPv4 header with TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: Benchmarking Methodology for Network Security Device Performance (draft-ietf-bmwg-ngfw-performance-03).

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
| Resource | resources/libraries/robot/ip/nat.robot
| Resource | resources/libraries/robot/shared/traffic.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | TCP | TCP_CPS
| ... | NAT44_ENDPOINT_DEPENDENT | SCALE | HOSTS_65536 | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-nat44ed-h65536-p63-s4128768-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${16}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${16}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.63
| ${out_mask}= | ${26}
# Scale settings
| ${n_hosts}= | ${65536}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${transaction_scale}= | ${n_sessions}
| ${packets_per_transaction_and_direction}= | ${4}
| ${packets_per_transaction_aggregated}= | ${7}
# Main heap size multiplicator
| ${heap_size_mult}= | ${2}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h
| ${transaction_type}= | tcp_cps
| ${disable_latency}= | ${True}

7.5.77.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Find NDR and PDR intervals using optimized search

7.5.77.2. 64B-1c-ethip4tcp-nat44ed-h65536-p63-s4128768-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.77.3. 64B-2c-ethip4tcp-nat44ed-h65536-p63-s4128768-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.77.4. 64B-4c-ethip4tcp-nat44ed-h65536-p63-s4128768-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.78. 2n1l-10ge2p1x710-ethip4tcp-nat44ed-h65536-p63-s4128768-tput-ndrpdr suite

TPUT on lightweight TCP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-TCP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains client and server ASTF programs, generating packets containing Ethernet header, IPv4 header, TCP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | NAT44 | TCP | TCP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_65536 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4tcp-nat44ed-h65536-p63-s4128768-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| # TODO CSIT-1765: Unify suite Documentation.
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${16}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${16}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.63
| ${out_mask}= | ${26}
# Scale settings
| ${n_hosts}= | ${65536}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${packets_per_transaction_and_direction}= | ${4 + ${ASTF_N_DATA_FRAMES}}
| ${packets_per_transaction_aggregated}= | ${6 + 2 * ${ASTF_N_DATA_FRAMES}}
| ${transaction_scale}= | ${n_sessions}
# Main heap size multiplicator
| ${heap_size_mult}= | ${2}
# Ramp-up settings
| ${ramp_up_rate}= | ${30000}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4tcp-${n_hosts}h-pps
| ${transaction_type}= | tcp_pps
| ${disable_latency}= | ${True}

7.5.78.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Send ramp-up traffic
  And Verify NAT44 TCP sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search
  And Verify NAT44 TCP sessions number on DUT1 node

7.5.78.2. 100B-1c-ethip4tcp-nat44ed-h65536-p63-s4128768-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.78.3. 100B-2c-ethip4tcp-nat44ed-h65536-p63-s4128768-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.78.4. 100B-4c-ethip4tcp-nat44ed-h65536-p63-s4128768-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.78.5. 1518B-1c-ethip4tcp-nat44ed-h65536-p63-s4128768-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.78.6. 1518B-2c-ethip4tcp-nat44ed-h65536-p63-s4128768-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.78.7. 1518B-4c-ethip4tcp-nat44ed-h65536-p63-s4128768-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.78.8. 9000B-1c-ethip4tcp-nat44ed-h65536-p63-s4128768-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.78.9. 9000B-2c-ethip4tcp-nat44ed-h65536-p63-s4128768-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.78.10. 9000B-4c-ethip4tcp-nat44ed-h65536-p63-s4128768-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.79. 2n1l-10ge2p1x710-ethip4udp-ip4base-h1024-p63-s64512-cps-ndrpdr suite

CPS on empty UDP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /22 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional UDP flows) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | SCALE | IP4BASE | DRV_VFIO_PCI
| ... | UDP | UDP_CPS | HOSTS_1024 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-h1024-p63-s64512-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${1024}
| ${n_ports}= | ${63}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h
| ${transaction_type}= | udp_cps
| ${disable_latency}= | ${True}

7.5.79.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  192.168.0.0  20.0.0.0  ${22}
 Then Find NDR and PDR intervals using optimized search

7.5.79.2. 64B-1c-ethip4udp-ip4base-h1024-p63-s64512-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.79.3. 64B-2c-ethip4udp-ip4base-h1024-p63-s64512-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.79.4. 64B-4c-ethip4udp-ip4base-h1024-p63-s64512-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.80. 2n1l-10ge2p1x710-ethip4udp-ip4base-h1024-p63-s64512-tput-ndrpdr suite

TPUT on lightweight UDP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /22 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains client and server ASTF programs, generating packets containing Ethernet header, IPv4 header, UDP header and static MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | IP4BASE | UDP | UDP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_1024 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-h1024-p63-s64512-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| # TODO CSIT-1765: Unify suite Documentation.
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${1024}
| ${n_ports}= | ${63}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
| ${packets_per_transaction_and_direction}= | ${ASTF_N_DATA_FRAMES}
# Traffic profile:
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h-pps
| ${transaction_type}= | udp_pps
| ${disable_latency}= | ${True}

7.5.80.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  192.168.0.0  20.0.0.0  ${22}
 Then Find NDR and PDR intervals using optimized search

7.5.80.2. 100B-1c-ethip4udp-ip4base-h1024-p63-s64512-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.80.3. 100B-2c-ethip4udp-ip4base-h1024-p63-s64512-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.80.4. 100B-4c-ethip4udp-ip4base-h1024-p63-s64512-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.80.5. 1518B-1c-ethip4udp-ip4base-h1024-p63-s64512-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.80.6. 1518B-2c-ethip4udp-ip4base-h1024-p63-s64512-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.80.7. 1518B-4c-ethip4udp-ip4base-h1024-p63-s64512-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.80.8. 9000B-1c-ethip4udp-ip4base-h1024-p63-s64512-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.80.9. 9000B-2c-ethip4udp-ip4base-h1024-p63-s64512-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.80.10. 9000B-4c-ethip4udp-ip4base-h1024-p63-s64512-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.81. 2n1l-10ge2p1x710-ethip4udp-ip4base-h16384-p63-s1032192-cps-ndrpdr suite

CPS on empty UDP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /18 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional UDP flows) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | SCALE | IP4BASE | DRV_VFIO_PCI
| ... | UDP | UDP_CPS | HOSTS_16384 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-h16384-p63-s1032192-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${16384}
| ${n_ports}= | ${63}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h
| ${transaction_type}= | udp_cps
| ${disable_latency}= | ${True}

7.5.81.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  192.168.0.0  20.0.0.0  ${18}
 Then Find NDR and PDR intervals using optimized search

7.5.81.2. 64B-1c-ethip4udp-ip4base-h16384-p63-s1032192-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.81.3. 64B-2c-ethip4udp-ip4base-h16384-p63-s1032192-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.81.4. 64B-4c-ethip4udp-ip4base-h16384-p63-s1032192-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.82. 2n1l-10ge2p1x710-ethip4udp-ip4base-h16384-p63-s1032192-tput-ndrpdr suite

TPUT on lightweight UDP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /18 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | IP4BASE | UDP | UDP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_16384 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-h16384-p63-s1032192-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${16384}
| ${n_ports}= | ${63}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
| ${packets_per_transaction_and_direction}= | ${ASTF_N_DATA_FRAMES}
# Traffic profile:
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h-pps
| ${transaction_type}= | udp_pps
| ${disable_latency}= | ${True}

7.5.82.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  192.168.0.0  20.0.0.0  ${18}
 Then Find NDR and PDR intervals using optimized search

7.5.82.2. 100B-1c-ethip4udp-ip4base-h16384-p63-s1032192-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.82.3. 100B-2c-ethip4udp-ip4base-h16384-p63-s1032192-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.82.4. 100B-4c-ethip4udp-ip4base-h16384-p63-s1032192-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.82.5. 1518B-1c-ethip4udp-ip4base-h16384-p63-s1032192-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.82.6. 1518B-2c-ethip4udp-ip4base-h16384-p63-s1032192-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.82.7. 1518B-4c-ethip4udp-ip4base-h16384-p63-s1032192-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.82.8. 9000B-1c-ethip4udp-ip4base-h16384-p63-s1032192-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.82.9. 9000B-2c-ethip4udp-ip4base-h16384-p63-s1032192-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.82.10. 9000B-4c-ethip4udp-ip4base-h16384-p63-s1032192-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.83. 2n1l-10ge2p1x710-ethip4udp-ip4base-h262144-p63-s16515072-cps-ndrpdr suite

CPS on empty UDP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /14 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional UDP flows) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | SCALE | IP4BASE | DRV_VFIO_PCI
| ... | UDP | UDP_CPS | HOSTS_262144 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-h262144-p63-s16515072-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${262144}
| ${n_ports}= | ${63}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h
| ${transaction_type}= | udp_cps
| ${disable_latency}= | ${True}

7.5.83.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  172.16.0.0  20.16.0.0  ${14}
 Then Find NDR and PDR intervals using optimized search

7.5.83.2. 64B-1c-ethip4udp-ip4base-h262144-p63-s16515072-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.83.3. 64B-2c-ethip4udp-ip4base-h262144-p63-s16515072-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.83.4. 64B-4c-ethip4udp-ip4base-h262144-p63-s16515072-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.84. 2n1l-10ge2p1x710-ethip4udp-ip4base-h262144-p63-s16515072-tput-ndrpdr suite

TPUT on lightweight UDP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /14 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | IP4BASE | UDP | UDP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_262144 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-h262144-p63-s16515072-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${262144}
| ${n_ports}= | ${63}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
| ${packets_per_transaction_and_direction}= | ${ASTF_N_DATA_FRAMES}
# Traffic profile:
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h-pps
| ${transaction_type}= | udp_pps
| ${disable_latency}= | ${True}

7.5.84.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  172.16.0.0  20.16.0.0  ${14}
 Then Find NDR and PDR intervals using optimized search

7.5.84.2. 100B-1c-ethip4udp-ip4base-h262144-p63-s16515072-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.84.3. 100B-2c-ethip4udp-ip4base-h262144-p63-s16515072-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.84.4. 100B-4c-ethip4udp-ip4base-h262144-p63-s16515072-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.84.5. 1518B-1c-ethip4udp-ip4base-h262144-p63-s16515072-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.84.6. 1518B-2c-ethip4udp-ip4base-h262144-p63-s16515072-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.84.7. 1518B-4c-ethip4udp-ip4base-h262144-p63-s16515072-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.84.8. 9000B-1c-ethip4udp-ip4base-h262144-p63-s16515072-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.84.9. 9000B-2c-ethip4udp-ip4base-h262144-p63-s16515072-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.84.10. 9000B-4c-ethip4udp-ip4base-h262144-p63-s16515072-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.85. 2n1l-10ge2p1x710-ethip4udp-ip4base-h4096-p63-s258048-cps-ndrpdr suite

CPS on empty UDP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /20 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional UDP flows) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | SCALE | IP4BASE | DRV_VFIO_PCI
| ... | UDP | UDP_CPS | HOSTS_4096 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-h4096-p63-s258048-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${4096}
| ${n_ports}= | ${63}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h
| ${transaction_type}= | udp_cps
| ${disable_latency}= | ${True}

7.5.85.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  192.168.0.0  20.0.0.0  ${20}
 Then Find NDR and PDR intervals using optimized search

7.5.85.2. 64B-1c-ethip4udp-ip4base-h4096-p63-s258048-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.85.3. 64B-2c-ethip4udp-ip4base-h4096-p63-s258048-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.85.4. 64B-4c-ethip4udp-ip4base-h4096-p63-s258048-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.86. 2n1l-10ge2p1x710-ethip4udp-ip4base-h4096-p63-s258048-tput-ndrpdr suite

TPUT on lightweight UDP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /20 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | IP4BASE | UDP | UDP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_4096 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-h4096-p63-s258048-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${4096}
| ${n_ports}= | ${63}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
| ${packets_per_transaction_and_direction}= | ${ASTF_N_DATA_FRAMES}
# Traffic profile:
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h-pps
| ${transaction_type}= | udp_pps
| ${disable_latency}= | ${True}

7.5.86.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  192.168.0.0  20.0.0.0  ${20}
 Then Find NDR and PDR intervals using optimized search

7.5.86.2. 100B-1c-ethip4udp-ip4base-h4096-p63-s258048-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.86.3. 100B-2c-ethip4udp-ip4base-h4096-p63-s258048-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.86.4. 100B-4c-ethip4udp-ip4base-h4096-p63-s258048-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.86.5. 1518B-1c-ethip4udp-ip4base-h4096-p63-s258048-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.86.6. 1518B-2c-ethip4udp-ip4base-h4096-p63-s258048-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.86.7. 1518B-4c-ethip4udp-ip4base-h4096-p63-s258048-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.86.8. 9000B-1c-ethip4udp-ip4base-h4096-p63-s258048-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.86.9. 9000B-2c-ethip4udp-ip4base-h4096-p63-s258048-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.86.10. 9000B-4c-ethip4udp-ip4base-h4096-p63-s258048-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.87. 2n1l-10ge2p1x710-ethip4udp-ip4base-h65536-p63-s4128768-cps-ndrpdr suite

CPS on empty UDP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /16 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional UDP flows) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | SCALE | IP4BASE | DRV_VFIO_PCI
| ... | UDP | UDP_CPS | HOSTS_65536 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-h65536-p63-s4128768-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${65536}
| ${n_ports}= | ${63}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h
| ${transaction_type}= | udp_cps
| ${disable_latency}= | ${True}

7.5.87.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  192.168.0.0  20.0.0.0  ${16}
 Then Find NDR and PDR intervals using optimized search

7.5.87.2. 64B-1c-ethip4udp-ip4base-h65536-p63-s4128768-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.87.3. 64B-2c-ethip4udp-ip4base-h65536-p63-s4128768-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.87.4. 64B-4c-ethip4udp-ip4base-h65536-p63-s4128768-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.88. 2n1l-10ge2p1x710-ethip4udp-ip4base-h65536-p63-s4128768-tput-ndrpdr suite

TPUT on lightweight UDP transactions with IPv4 routing

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4 for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /16 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | IP4BASE | UDP | UDP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_65536 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-h65536-p63-s4128768-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# Scale settings
| ${n_hosts}= | ${65536}
| ${n_ports}= | ${63}
| ${transaction_scale}= | ${${n_hosts} * ${n_ports}}
| ${packets_per_transaction_and_direction}= | ${ASTF_N_DATA_FRAMES}
# Traffic profile:
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h-pps
| ${transaction_type}= | udp_pps
| ${disable_latency}= | ${True}

7.5.88.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding in circular topology  192.168.0.0  20.0.0.0  ${16}
 Then Find NDR and PDR intervals using optimized search

7.5.88.2. 100B-1c-ethip4udp-ip4base-h65536-p63-s4128768-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.88.3. 100B-2c-ethip4udp-ip4base-h65536-p63-s4128768-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.88.4. 100B-4c-ethip4udp-ip4base-h65536-p63-s4128768-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.88.5. 1518B-1c-ethip4udp-ip4base-h65536-p63-s4128768-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.88.6. 1518B-2c-ethip4udp-ip4base-h65536-p63-s4128768-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.88.7. 1518B-4c-ethip4udp-ip4base-h65536-p63-s4128768-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.88.8. 9000B-1c-ethip4udp-ip4base-h65536-p63-s4128768-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.88.9. 9000B-2c-ethip4udp-ip4base-h65536-p63-s4128768-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.88.10. 9000B-4c-ethip4udp-ip4base-h65536-p63-s4128768-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.89. 2n1l-10ge2p1x710-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | IACL | ACL1 | 10K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl1sf-10kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 1
| ${flows_per_dir}= | 10k
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-2n-ethip4udp-10u1000p-conc

7.5.89.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.89.2. 64B-1c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.89.3. 64B-2c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.89.4. 64B-4c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.89.5. 1518B-1c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.89.6. 1518B-2c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.89.7. 1518B-4c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.89.8. 9000B-1c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.89.9. 9000B-2c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.89.10. 9000B-4c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.89.11. IMIX-1c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.89.12. IMIX-2c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.89.13. IMIX-4c-ethip4udp-ip4base-iacl1sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.90. 2n1l-10ge2p1x710-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | IACL | ACL1 | 10K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl1sl-10kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 1
| ${flows_per_dir}= | 10k
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-2n-ethip4udp-10u1000p-conc

7.5.90.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.90.2. 64B-1c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.90.3. 64B-2c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.90.4. 64B-4c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.90.5. 1518B-1c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.90.6. 1518B-2c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.90.7. 1518B-4c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.90.8. 9000B-1c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.90.9. 9000B-2c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.90.10. 9000B-4c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.90.11. IMIX-1c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.90.12. IMIX-2c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.90.13. IMIX-4c-ethip4udp-ip4base-iacl1sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.91. 2n1l-10ge2p1x710-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | IACL | ACL50 | 10K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl50sf-10kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 50
| ${flows_per_dir}= | 10k
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-2n-ethip4udp-10u1000p-conc

7.5.91.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.91.2. 64B-1c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.91.3. 64B-2c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.91.4. 64B-4c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.91.5. 1518B-1c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.91.6. 1518B-2c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.91.7. 1518B-4c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.91.8. 9000B-1c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.91.9. 9000B-2c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.91.10. 9000B-4c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.91.11. IMIX-1c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.91.12. IMIX-2c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.91.13. IMIX-4c-ethip4udp-ip4base-iacl50sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.92. 2n1l-10ge2p1x710-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | IACL | ACL50 | 10K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-iacl50sl-10kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | input
| ${no_hit_aces_number}= | 50
| ${flows_per_dir}= | 10k
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-2n-ethip4udp-10u1000p-conc

7.5.92.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.92.2. 64B-1c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.92.3. 64B-2c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.92.4. 64B-4c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.92.5. 1518B-1c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.92.6. 1518B-2c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.92.7. 1518B-4c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.92.8. 9000B-1c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.92.9. 9000B-2c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.92.10. 9000B-4c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.92.11. IMIX-1c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.92.12. IMIX-2c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.92.13. IMIX-4c-ethip4udp-ip4base-iacl50sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.93. 2n1l-10ge2p1x710-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATEFUL
| ... | OACL | ACL50 | 10K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl50sf-10kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit+reflect
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 50
| ${flows_per_dir}= | 10k
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-2n-ethip4udp-10u1000p-conc

7.5.93.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.93.2. 64B-1c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.93.3. 64B-2c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.93.4. 64B-4c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.93.5. 1518B-1c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.93.6. 1518B-2c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.93.7. 1518B-4c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.93.8. 9000B-1c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.93.9. 9000B-2c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.93.10. 9000B-4c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.93.11. IMIX-1c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.93.12. IMIX-2c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.93.13. IMIX-4c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.94. 2n1l-10ge2p1x710-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr suite

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains two L3 flow-groups (flow-group per direction, ${flows_per_dir} flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | ACL | ACL_STATELESS
| ... | OACL | ACL50 | 10K_FLOWS | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-ip4base-oacl50sl-10kflows
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | acl
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | acl_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# ACL test setup
| ${acl_action}= | permit
| ${acl_apply_type}= | output
| ${no_hit_aces_number}= | 50
| ${flows_per_dir}= | 10k
| ${ip_nr}= | ${10}
# starting points for non-hitting ACLs
| ${src_ip_start}= | 30.30.30.1
| ${dst_ip_start}= | 40.40.40.1
| ${ip_step}= | ${1}
| ${sport_start}= | ${1000}
| ${dport_start}= | ${1000}
| ${port_step}= | ${1}
| ${trex_stream1_subnet}= | 10.10.10.0/24
| ${trex_stream2_subnet}= | 20.20.20.0/24
# Traffic profile
| ${traffic_profile}= | trex-stl-2n-ethip4udp-10u1000p-conc

7.5.94.1. Local Template

  • [Cfg] DUT runs IPv4 routing config. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 routing with IPv4 ACLs on DUT1 in circular topology  ${ip_nr}
 Then Find NDR and PDR intervals using optimized search

7.5.94.2. 64B-1c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.94.3. 64B-2c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.94.4. 64B-4c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.94.5. 1518B-1c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.94.6. 1518B-2c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.94.7. 1518B-4c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.94.8. 9000B-1c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.94.9. 9000B-2c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.94.10. 9000B-4c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.94.11. IMIX-1c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.94.12. IMIX-2c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.94.13. IMIX-4c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.95. 2n1l-10ge2p1x710-ethip4udp-nat44det-h1-p1-s1-ndrpdr suite

RFC2544: Pkt throughput NAT44 deterministic mode performance test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and one static IPv4 /18 route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains two L3 flow-groups (flow-group per direction, 1 flow per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
| Resource | resources/libraries/robot/ip/nat.robot
| Resource | resources/libraries/robot/shared/traffic.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | NAT44_DETERMINISTIC
| ... | BASE | UDP | UDP_BIDIR | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44det-h1-p1-s1
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | det44
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | det44_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# IP addresing
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${20}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${20}
| ${dest_net}= | 30.0.0.0
| ${dest_mask}= | ${24}
# NAT settings
| ${nat_mode}= | deterministic
| ${in_net}= | 20.0.0.0
| ${in_mask}= | ${32}
| ${out_net}= | 200.0.0.0
| ${out_mask}= | ${32}
# Scale settings
| ${n_hosts}= | ${1}
| ${n_ports}= | ${1}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
# Ramp-up settings
| ${ramp_up_rate}= | ${66061.0}
| ${ramp_up_duration}= | ${2.0}
# Traffic profile
| ${traffic_profile}= | trex-stl-2n-ethip4udp-${n_hosts}u${n_ports}p

7.5.95.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 deterministic mode in circular topology
 Then Send ramp-up traffic
  And Verify DET44 sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search

7.5.95.2. 64B-1c-ethip4udp-nat44det-h1-p1-s1-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.95.3. 64B-2c-ethip4udp-nat44det-h1-p1-s1-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.95.4. 64B-4c-ethip4udp-nat44det-h1-p1-s1-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.95.5. 1518B-1c-ethip4udp-nat44det-h1-p1-s1-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.95.6. 1518B-2c-ethip4udp-nat44det-h1-p1-s1-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.95.7. 1518B-4c-ethip4udp-nat44det-h1-p1-s1-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.95.8. 9000B-1c-ethip4udp-nat44det-h1-p1-s1-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.95.9. 9000B-2c-ethip4udp-nat44det-h1-p1-s1-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.95.10. 9000B-4c-ethip4udp-nat44det-h1-p1-s1-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.95.11. IMIX-1c-ethip4udp-nat44det-h1-p1-s1-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.95.12. IMIX-2c-ethip4udp-nat44det-h1-p1-s1-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.95.13. IMIX-4c-ethip4udp-nat44det-h1-p1-s1-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.96. 2n1l-10ge2p1x710-ethip4udp-nat44det-h1024-p63-s64512-ndrpdr suite

RFC2544: Pkt throughput NAT44 performance test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and two static IPv4 /22 and IPv4 /24 route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains two L3 flow-groups (flow-group per direction, 1 flow per flow-group) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | NAT44_DETERMINISTIC
| ... | SCALE | HOSTS_1024 | UDP | UDP_BIDIR | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44det-h1024-p63-s64512
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | det44
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | det44_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# IP addresing
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 11.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${20}
| ${dut1_if2_ip4}= | 11.0.0.1
| ${dut1_if2_mask}= | ${20}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${24}
# NAT settings
| ${nat_mode}= | deterministic
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${22}
| ${out_net}= | 68.142.68.0
| ${out_mask}= | ${32}
# Scale settings
| ${n_hosts}= | ${1024}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
# Ramp-up settings
| ${ramp_up_rate}= | ${66061.0}
| ${ramp_up_duration}= | ${2.0}
# Traffic profile
| ${traffic_profile}= | trex-stl-ethip4udp-${n_hosts}u${n_ports}p

7.5.96.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 deterministic mode in circular topology
 Then Send ramp-up traffic
  And Verify DET44 sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search

7.5.96.2. 64B-1c-ethip4udp-nat44det-h1024-p63-s64512-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.96.3. 64B-2c-ethip4udp-nat44det-h1024-p63-s64512-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.96.4. 64B-4c-ethip4udp-nat44det-h1024-p63-s64512-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.96.5. 1518B-1c-ethip4udp-nat44det-h1024-p63-s64512-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.96.6. 1518B-2c-ethip4udp-nat44det-h1024-p63-s64512-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.96.7. 1518B-4c-ethip4udp-nat44det-h1024-p63-s64512-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.96.8. 9000B-1c-ethip4udp-nat44det-h1024-p63-s64512-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.96.9. 9000B-2c-ethip4udp-nat44det-h1024-p63-s64512-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.96.10. 9000B-4c-ethip4udp-nat44det-h1024-p63-s64512-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.96.11. IMIX-1c-ethip4udp-nat44det-h1024-p63-s64512-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.96.12. IMIX-2c-ethip4udp-nat44det-h1024-p63-s64512-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.96.13. IMIX-4c-ethip4udp-nat44det-h1024-p63-s64512-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.97. 2n1l-10ge2p1x710-ethip4udp-nat44det-h16384-p63-s1032192-ndrpdr suite

RFC2544: Pkt throughput NAT44 performance test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and two static IPv4 /18 and IPv4 /24 route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains two L3 flow-groups (flow-group per direction, 1 flow per flow-group) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | NAT44_DETERMINISTIC
| ... | SCALE | HOSTS_16384 | UDP | UDP_BIDIR | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44det-h16384-p63-s1032192
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | det44
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | det44_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# IP addresing
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${20}
| ${dut1_if2_ip4}= | 11.0.0.1
| ${dut1_if2_mask}= | ${20}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${24}
# NAT settings
| ${nat_mode}= | deterministic
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${18}
| ${out_net}= | 68.142.68.0
| ${out_mask}= | ${28}
# Scale settings
| ${n_hosts}= | ${16384}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
# Ramp-up settings
| ${ramp_up_rate}= | ${66061.0}
| ${ramp_up_duration}= | ${16.8}
# Traffic profile
| ${traffic_profile}= | trex-stl-ethip4udp-${n_hosts}u${n_ports}p

7.5.97.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 deterministic mode in circular topology
 Then Send ramp-up traffic
  And Verify DET44 sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search

7.5.97.2. 64B-1c-ethip4udp-nat44det-h16384-p63-s1032192-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.97.3. 64B-2c-ethip4udp-nat44det-h16384-p63-s1032192-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.97.4. 64B-4c-ethip4udp-nat44det-h16384-p63-s1032192-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.97.5. 1518B-1c-ethip4udp-nat44det-h16384-p63-s1032192-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.97.6. 1518B-2c-ethip4udp-nat44det-h16384-p63-s1032192-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.97.7. 1518B-4c-ethip4udp-nat44det-h16384-p63-s1032192-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.97.8. 9000B-1c-ethip4udp-nat44det-h16384-p63-s1032192-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.97.9. 9000B-2c-ethip4udp-nat44det-h16384-p63-s1032192-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.97.10. 9000B-4c-ethip4udp-nat44det-h16384-p63-s1032192-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.97.11. IMIX-1c-ethip4udp-nat44det-h16384-p63-s1032192-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.97.12. IMIX-2c-ethip4udp-nat44det-h16384-p63-s1032192-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.97.13. IMIX-4c-ethip4udp-nat44det-h16384-p63-s1032192-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.98. 2n1l-10ge2p1x710-ethip4udp-nat44det-h262144-p63-s16515072-ndrpdr suite

RFC2544: Pkt throughput NAT44 performance test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and two static IPv4 /14 and IPv4 /24 route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains two L3 flow-groups (flow-group per direction, 1 flow per flow-group) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | NAT44_DETERMINISTIC
| ... | SCALE | HOSTS_262144 | UDP | UDP_BIDIR | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44det-h262144-p63-s16515072
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | det44
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | det44_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# IP addresing
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${20}
| ${dut1_if2_ip4}= | 11.0.0.1
| ${dut1_if2_mask}= | ${20}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${24}
# NAT settings
| ${nat_mode}= | deterministic
| ${in_net}= | 172.16.0.0
| ${in_mask}= | ${14}
| ${out_net}= | 68.142.68.0
| ${out_mask}= | ${24}
# Scale settings
| ${n_hosts}= | ${262144}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
# Main heap size multiplicator
| ${heap_size_mult}= | ${7}
# Ramp-up settings
| ${ramp_up_rate}= | ${66061.0}
| ${ramp_up_duration}= | ${252.3}
# Traffic profile
| ${traffic_profile}= | trex-stl-ethip4udp-${n_hosts}u${n_ports}p

7.5.98.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 deterministic mode in circular topology
 Then Send ramp-up traffic
  And Verify DET44 sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search

7.5.98.2. 64B-1c-ethip4udp-nat44det-h262144-p63-s16515072-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.98.3. 64B-2c-ethip4udp-nat44det-h262144-p63-s16515072-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.98.4. 64B-4c-ethip4udp-nat44det-h262144-p63-s16515072-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.98.5. 1518B-1c-ethip4udp-nat44det-h262144-p63-s16515072-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.98.6. 1518B-2c-ethip4udp-nat44det-h262144-p63-s16515072-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.98.7. 1518B-4c-ethip4udp-nat44det-h262144-p63-s16515072-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.98.8. 9000B-1c-ethip4udp-nat44det-h262144-p63-s16515072-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.98.9. 9000B-2c-ethip4udp-nat44det-h262144-p63-s16515072-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.98.10. 9000B-4c-ethip4udp-nat44det-h262144-p63-s16515072-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.98.11. IMIX-1c-ethip4udp-nat44det-h262144-p63-s16515072-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.98.12. IMIX-2c-ethip4udp-nat44det-h262144-p63-s16515072-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.98.13. IMIX-4c-ethip4udp-nat44det-h262144-p63-s16515072-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.99. 2n1l-10ge2p1x710-ethip4udp-nat44det-h4096-p63-s258048-ndrpdr suite

RFC2544: Pkt throughput NAT44 performance test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and two static IPv4 /20 and IPv4 /24 route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains two L3 flow-groups (flow-group per direction, 1 flow per flow-group) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | NAT44_DETERMINISTIC
| ... | SCALE | HOSTS_4096 | UDP | UDP_BIDIR | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44det-h4096-p63-s258048
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | det44
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | det44_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${20}
| ${dut1_if2_ip4}= | 11.0.0.1
| ${dut1_if2_mask}= | ${20}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${24}
# NAT settings
| ${nat_mode}= | deterministic
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${20}
| ${out_net}= | 68.142.68.0
| ${out_mask}= | ${30}
# Scale settings
| ${n_hosts}= | ${4096}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
# Ramp-up settings
| ${ramp_up_rate}= | ${66061.0}
| ${ramp_up_duration}= | ${5.0}
# Traffic profile
| ${traffic_profile}= | trex-stl-ethip4udp-${n_hosts}u${n_ports}p

7.5.99.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 deterministic mode in circular topology
 Then Send ramp-up traffic
  And Verify DET44 sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search

7.5.99.2. 64B-1c-ethip4udp-nat44det-h4096-p63-s258048-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.99.3. 64B-2c-ethip4udp-nat44det-h4096-p63-s258048-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.99.4. 64B-4c-ethip4udp-nat44det-h4096-p63-s258048-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.99.5. 1518B-1c-ethip4udp-nat44det-h4096-p63-s258048-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.99.6. 1518B-2c-ethip4udp-nat44det-h4096-p63-s258048-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.99.7. 1518B-4c-ethip4udp-nat44det-h4096-p63-s258048-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.99.8. 9000B-1c-ethip4udp-nat44det-h4096-p63-s258048-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.99.9. 9000B-2c-ethip4udp-nat44det-h4096-p63-s258048-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.99.10. 9000B-4c-ethip4udp-nat44det-h4096-p63-s258048-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.99.11. IMIX-1c-ethip4udp-nat44det-h4096-p63-s258048-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.99.12. IMIX-2c-ethip4udp-nat44det-h4096-p63-s258048-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.99.13. IMIX-4c-ethip4udp-nat44det-h4096-p63-s258048-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.100. 2n1l-10ge2p1x710-ethip4udp-nat44det-h65536-p63-s4128758-ndrpdr suite

RFC2544: Pkt throughput NAT44 performance test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and two static IPv4 /16 and IPv4 /24 route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUT1. TG traffic profile contains two L3 flow-groups (flow-group per direction, 1 flow per flow-group) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | NAT44_DETERMINISTIC
| ... | SCALE | HOSTS_65536 | UDP | UDP_BIDIR | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44det-h65536-p63-s4128758
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | det44
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | det44_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# IP addresing
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${20}
| ${dut1_if2_ip4}= | 11.0.0.1
| ${dut1_if2_mask}= | ${20}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${24}
# NAT settings
| ${nat_mode}= | deterministic
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${16}
| ${out_net}= | 68.142.68.0
| ${out_mask}= | ${26}
# Scale settings
| ${n_hosts}= | ${65536}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
# Main heap size multiplicator
| ${heap_size_mult}= | ${2}
# Ramp-up settings
| ${ramp_up_rate}= | ${66061.0}
| ${ramp_up_duration}= | ${63.9}
# Traffic profile
| ${traffic_profile}= | trex-stl-ethip4udp-${n_hosts}u${n_ports}p

7.5.100.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 deterministic mode in circular topology
 Then Send ramp-up traffic
  And Verify DET44 sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search

7.5.100.2. 64B-1c-ethip4udp-nat44det-h65536-p63-s4128758-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.100.3. 64B-2c-ethip4udp-nat44det-h65536-p63-s4128758-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.100.4. 64B-4c-ethip4udp-nat44det-h65536-p63-s4128758-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.100.5. 1518B-1c-ethip4udp-nat44det-h65536-p63-s4128758-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.100.6. 1518B-2c-ethip4udp-nat44det-h65536-p63-s4128758-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.100.7. 1518B-4c-ethip4udp-nat44det-h65536-p63-s4128758-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.100.8. 9000B-1c-ethip4udp-nat44det-h65536-p63-s4128758-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.100.9. 9000B-2c-ethip4udp-nat44det-h65536-p63-s4128758-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.100.10. 9000B-4c-ethip4udp-nat44det-h65536-p63-s4128758-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.100.11. IMIX-1c-ethip4udp-nat44det-h65536-p63-s4128758-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.100.12. IMIX-2c-ethip4udp-nat44det-h65536-p63-s4128758-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.100.13. IMIX-4c-ethip4udp-nat44det-h65536-p63-s4128758-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.101. 2n1l-10ge2p1x710-ethip4udp-nat44ed-h1024-p63-s64512-cps-ndrpdr suite

CPS on empty UDP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and one static IPv4 /${dest_mask} route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional UDP flows) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: Benchmarking Methodology for Network Security Device Performance (draft-ietf-bmwg-ngfw-performance-03).

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
| Resource | resources/libraries/robot/ip/nat.robot
| Resource | resources/libraries/robot/shared/traffic.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | UDP | UDP_CPS
| ... | NAT44_ENDPOINT_DEPENDENT | SCALE | HOSTS_1024 | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44ed-h1024-p63-s64512-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${22}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${22}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.0
| ${out_mask}= | ${32}
# Scale settings
| ${n_hosts}= | ${1024}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${transaction_scale}= | ${n_sessions}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h
| ${transaction_type}= | udp_cps
| ${disable_latency}= | ${True}

7.5.101.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Find NDR and PDR intervals using optimized search

7.5.101.2. 64B-1c-ethip4udp-nat44ed-h1024-p63-s64512-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.101.3. 64B-2c-ethip4udp-nat44ed-h1024-p63-s64512-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.101.4. 64B-4c-ethip4udp-nat44ed-h1024-p63-s64512-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.102. 2n1l-10ge2p1x710-ethip4udp-nat44ed-h1024-p63-s64512-tput-ndrpdr suite

TPUT on lightweight UDP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains client and server ASTF programs, generating packets containing Ethernet header, IPv4 header, UDP header and static MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | NAT44 | UDP | UDP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_1024 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44ed-h1024-p63-s64512-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| # TODO CSIT-1765: Unify suite Documentation.
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${22}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${22}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.0
| ${out_mask}= | ${32}
# Scale settings
| ${n_hosts}= | ${1024}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${transaction_scale}= | ${n_sessions}
| ${packets_per_transaction_and_direction}= | ${ASTF_N_DATA_FRAMES}
# Ramp-up settings
| ${ramp_up_rate}= | ${30000}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h-pps
| ${transaction_type}= | udp_pps
| ${disable_latency}= | ${True}

7.5.102.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Send ramp-up traffic
  And Verify NAT44 UDP sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search
  And Verify NAT44 UDP sessions number on DUT1 node

7.5.102.2. 100B-1c-ethip4udp-nat44ed-h1024-p63-s64512-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.102.3. 100B-2c-ethip4udp-nat44ed-h1024-p63-s64512-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.102.4. 100B-4c-ethip4udp-nat44ed-h1024-p63-s64512-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.102.5. 1518B-1c-ethip4udp-nat44ed-h1024-p63-s64512-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.102.6. 1518B-2c-ethip4udp-nat44ed-h1024-p63-s64512-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.102.7. 1518B-4c-ethip4udp-nat44ed-h1024-p63-s64512-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.102.8. 9000B-1c-ethip4udp-nat44ed-h1024-p63-s64512-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.102.9. 9000B-2c-ethip4udp-nat44ed-h1024-p63-s64512-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.102.10. 9000B-4c-ethip4udp-nat44ed-h1024-p63-s64512-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.103. 2n1l-10ge2p1x710-ethip4udp-nat44ed-h1024-p63-s64512-udir-ndrpdr suite

RFC2544: Pkt throughput NAT44 endpoint-dependent mode performance test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and one static IPv4 /${dest_mask} route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L4 flows (uni-directional UDP flows) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: Benchmarking Methodology for Network Security Device Performance (draft-ietf-bmwg-ngfw-performance-03).

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | UDP | UDP_UDIR
| ... | NAT44_ENDPOINT_DEPENDENT | SCALE | HOSTS_1024 | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44ed-h1024-p63-s64512-udir
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${8}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${22}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.0
| ${out_mask}= | ${32}
# Scale settings
| ${n_hosts}= | ${1024}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
# Ramp-up settings
| ${ramp_up_rate}= | ${500000}
| ${ramp_up_duration}= | ${1}
# Traffic profile
| ${traffic_profile}= | trex-stl-ethip4udp-${n_hosts}u${n_ports}p-udir
| ${traffic_directions}= | ${1}

7.5.103.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Send ramp-up traffic
  And Verify NAT44 UDP sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search

7.5.103.2. 64B-1c-ethip4udp-nat44ed-h1024-p63-s64512-udir-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.103.3. 64B-2c-ethip4udp-nat44ed-h1024-p63-s64512-udir-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.103.4. 64B-4c-ethip4udp-nat44ed-h1024-p63-s64512-udir-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.103.5. 1518B-1c-ethip4udp-nat44ed-h1024-p63-s64512-udir-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.103.6. 1518B-2c-ethip4udp-nat44ed-h1024-p63-s64512-udir-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.103.7. 1518B-4c-ethip4udp-nat44ed-h1024-p63-s64512-udir-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.103.8. 9000B-1c-ethip4udp-nat44ed-h1024-p63-s64512-udir-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.103.9. 9000B-2c-ethip4udp-nat44ed-h1024-p63-s64512-udir-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.103.10. 9000B-4c-ethip4udp-nat44ed-h1024-p63-s64512-udir-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.103.11. IMIX-1c-ethip4udp-nat44ed-h1024-p63-s64512-udir-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.103.12. IMIX-2c-ethip4udp-nat44ed-h1024-p63-s64512-udir-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.103.13. IMIX-4c-ethip4udp-nat44ed-h1024-p63-s64512-udir-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.104. 2n1l-10ge2p1x710-ethip4udp-nat44ed-h16384-p63-s1032192-cps-ndrpdr suite

CPS on empty UDP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and one static IPv4 /${dest_mask} route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional UDP flows) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: Benchmarking Methodology for Network Security Device Performance (draft-ietf-bmwg-ngfw-performance-03).

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
| Resource | resources/libraries/robot/ip/nat.robot
| Resource | resources/libraries/robot/shared/traffic.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | UDP | UDP_CPS
| ... | NAT44_ENDPOINT_DEPENDENT | SCALE | HOSTS_16384 | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44ed-h16384-p63-s1032192-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${18}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${18}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.15
| ${out_mask}= | ${28}
# Scale settings
| ${n_hosts}= | ${16384}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${transaction_scale}= | ${n_sessions}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h
| ${transaction_type}= | udp_cps
| ${disable_latency}= | ${True}

7.5.104.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Find NDR and PDR intervals using optimized search

7.5.104.2. 64B-1c-ethip4udp-nat44ed-h16384-p63-s1032192-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.104.3. 64B-2c-ethip4udp-nat44ed-h16384-p63-s1032192-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.104.4. 64B-4c-ethip4udp-nat44ed-h16384-p63-s1032192-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.105. 2n1l-10ge2p1x710-ethip4udp-nat44ed-h16384-p63-s1032192-tput-ndrpdr suite

TPUT on lightweight UDP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains client and server ASTF programs, generating packets containing Ethernet header, IPv4 header, UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | NAT44 | UDP | UDP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_16384 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44ed-h16384-p63-s1032192-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| # TODO CSIT-1765: Unify suite Documentation.
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${18}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${18}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.15
| ${out_mask}= | ${28}
# Scale settings
| ${n_hosts}= | ${16384}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${transaction_scale}= | ${n_sessions}
| ${packets_per_transaction_and_direction}= | ${ASTF_N_DATA_FRAMES}
# Ramp-up settings
| ${ramp_up_rate}= | ${30000}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h-pps
| ${transaction_type}= | udp_pps
| ${disable_latency}= | ${True}

7.5.105.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Send ramp-up traffic
  And Verify NAT44 UDP sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search
  And Verify NAT44 UDP sessions number on DUT1 node

7.5.105.2. 100B-1c-ethip4udp-nat44ed-h16384-p63-s1032192-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.105.3. 100B-2c-ethip4udp-nat44ed-h16384-p63-s1032192-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.105.4. 100B-4c-ethip4udp-nat44ed-h16384-p63-s1032192-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.105.5. 1518B-1c-ethip4udp-nat44ed-h16384-p63-s1032192-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.105.6. 1518B-2c-ethip4udp-nat44ed-h16384-p63-s1032192-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.105.7. 1518B-4c-ethip4udp-nat44ed-h16384-p63-s1032192-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.105.8. 9000B-1c-ethip4udp-nat44ed-h16384-p63-s1032192-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.105.9. 9000B-2c-ethip4udp-nat44ed-h16384-p63-s1032192-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.105.10. 9000B-4c-ethip4udp-nat44ed-h16384-p63-s1032192-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.106. 2n1l-10ge2p1x710-ethip4udp-nat44ed-h16384-p63-s1032192-udir-ndrpdr suite

RFC2544: Pkt throughput NAT44 endpoint-dependent mode performance test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and one static IPv4 /${dest_mask} route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L4 flows (un-directional UDP flows) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: Benchmarking Methodology for Network Security Device Performance (draft-ietf-bmwg-ngfw-performance-03).

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | UDP | UDP_UDIR
| ... | NAT44_ENDPOINT_DEPENDENT | SCALE | HOSTS_16384 | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44ed-h16384-p63-s1032192-udir
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${8}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${18}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.15
| ${out_mask}= | ${28}
# Scale settings
| ${n_hosts}= | ${16384}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
# Ramp-up settings
| ${ramp_up_rate}= | ${500000}
| ${ramp_up_duration}= | ${4.5}
# Traffic profile
| ${traffic_profile}= | trex-stl-ethip4udp-${n_hosts}u${n_ports}p-udir
| ${traffic_directions}= | ${1}

7.5.106.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Send ramp-up traffic
  And Verify NAT44 UDP sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search

7.5.106.2. 64B-1c-ethip4udp-nat44ed-h16384-p63-s1032192-udir-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.106.3. 64B-2c-ethip4udp-nat44ed-h16384-p63-s1032192-udir-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.106.4. 64B-4c-ethip4udp-nat44ed-h16384-p63-s1032192-udir-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.106.5. 1518B-1c-ethip4udp-nat44ed-h16384-p63-s1032192-udir-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.106.6. 1518B-2c-ethip4udp-nat44ed-h16384-p63-s1032192-udir-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.106.7. 1518B-4c-ethip4udp-nat44ed-h16384-p63-s1032192-udir-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.106.8. 9000B-1c-ethip4udp-nat44ed-h16384-p63-s1032192-udir-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.106.9. 9000B-2c-ethip4udp-nat44ed-h16384-p63-s1032192-udir-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.106.10. 9000B-4c-ethip4udp-nat44ed-h16384-p63-s1032192-udir-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.106.11. IMIX-1c-ethip4udp-nat44ed-h16384-p63-s1032192-udir-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.106.12. IMIX-2c-ethip4udp-nat44ed-h16384-p63-s1032192-udir-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.106.13. IMIX-4c-ethip4udp-nat44ed-h16384-p63-s1032192-udir-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.107. 2n1l-10ge2p1x710-ethip4udp-nat44ed-h262144-p63-s16515072-cps-ndrpdr suite

CPS on empty UDP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and one static IPv4 /${dest_mask} route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional UDP flows) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: Benchmarking Methodology for Network Security Device Performance (draft-ietf-bmwg-ngfw-performance-03).

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
| Resource | resources/libraries/robot/ip/nat.robot
| Resource | resources/libraries/robot/shared/traffic.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | UDP | UDP_CPS
| ... | NAT44_ENDPOINT_DEPENDENT | SCALE | HOSTS_262144 | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44ed-h262144-p63-s16515072-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.16.0.0
| ${dest_mask}= | ${14}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 172.16.0.0
| ${in_mask}= | ${14}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.255
| ${out_mask}= | ${24}
# Scale settings
| ${n_hosts}= | ${262144}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${transaction_scale}= | ${n_sessions}
# Main heap size multiplicator
| ${heap_size_mult}= | ${7}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h
| ${transaction_type}= | udp_cps
| ${disable_latency}= | ${True}

7.5.107.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Find NDR and PDR intervals using optimized search

7.5.107.2. 64B-1c-ethip4udp-nat44ed-h262144-p63-s16515072-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.107.3. 64B-2c-ethip4udp-nat44ed-h262144-p63-s16515072-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.107.4. 64B-4c-ethip4udp-nat44ed-h262144-p63-s16515072-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.108. 2n1l-10ge2p1x710-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr suite

TPUT on lightweight UDP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains client and server ASTF programs, generating packets containing Ethernet header, IPv4 header, UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | NAT44 | UD | UDP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_262144 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44ed-h262144-p63-s16515072-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| # TODO CSIT-1765: Unify suite Documentation.
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.16.0.0
| ${dest_mask}= | ${14}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 172.16.0.0
| ${in_mask}= | ${14}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.255
| ${out_mask}= | ${24}
# Scale settings
| ${n_hosts}= | ${262144}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${transaction_scale}= | ${n_sessions}
| ${packets_per_transaction_and_direction}= | ${ASTF_N_DATA_FRAMES}
# Main heap size multiplicator
| ${heap_size_mult}= | ${7}
# Ramp-up settings
# This scale needs more than 55 ktps, which is more than current NDR results.
| ${ramp_up_rate}= | ${30000}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h-pps
| ${transaction_type}= | udp_pps
| ${disable_latency}= | ${True}

7.5.108.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Send ramp-up traffic
  And Verify NAT44 UDP sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search
  And Verify NAT44 UDP sessions number on DUT1 node

7.5.108.2. 100B-1c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.108.3. 100B-2c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.108.4. 100B-4c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.108.5. 1518B-1c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.108.6. 1518B-2c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.108.7. 1518B-4c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.108.8. 9000B-1c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.108.9. 9000B-2c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.108.10. 9000B-4c-ethip4udp-nat44ed-h262144-p63-s16515072-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.109. 2n1l-10ge2p1x710-ethip4udp-nat44ed-h262144-p63-s16515072-udir-ndrpdr suite

RFC2544: Pkt throughput NAT44 endpoint-dependent mode performance test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and one static IPv4 /${dest_mask} route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L4 flows (uni-directional UDP flows) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: Benchmarking Methodology for Network Security Device Performance (draft-ietf-bmwg-ngfw-performance-03).

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | UDP | UDP_UDIR
| ... | NAT44_ENDPOINT_DEPENDENT | SCALE | HOSTS_262144 | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44ed-h262144-p63-s16515072-udir
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${8}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${14}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.255
| ${out_mask}= | ${24}
# Scale settings
| ${n_hosts}= | ${262144}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
# Main heap size multiplicator
| ${heap_size_mult}= | ${7}
# Ramp-up settings
| ${ramp_up_rate}= | ${500000}
| ${ramp_up_duration}= | ${72.7}
# Traffic profile
| ${traffic_profile}= | trex-stl-ethip4udp-${n_hosts}u${n_ports}p-udir
| ${traffic_directions}= | ${1}

7.5.109.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Send ramp-up traffic
  And Verify NAT44 UDP sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search

7.5.109.2. 64B-1c-ethip4udp-nat44ed-h262144-p63-s16515072-udir-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.109.3. 64B-2c-ethip4udp-nat44ed-h262144-p63-s16515072-udir-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.109.4. 64B-4c-ethip4udp-nat44ed-h262144-p63-s16515072-udir-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.109.5. 1518B-1c-ethip4udp-nat44ed-h262144-p63-s16515072-udir-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.109.6. 1518B-2c-ethip4udp-nat44ed-h262144-p63-s16515072-udir-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.109.7. 1518B-4c-ethip4udp-nat44ed-h262144-p63-s16515072-udir-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.109.8. 9000B-1c-ethip4udp-nat44ed-h262144-p63-s16515072-udir-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.109.9. 9000B-2c-ethip4udp-nat44ed-h262144-p63-s16515072-udir-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.109.10. 9000B-4c-ethip4udp-nat44ed-h262144-p63-s16515072-udir-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.109.11. IMIX-1c-ethip4udp-nat44ed-h262144-p63-s16515072-udir-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.109.12. IMIX-2c-ethip4udp-nat44ed-h262144-p63-s16515072-udir-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.109.13. IMIX-4c-ethip4udp-nat44ed-h262144-p63-s16515072-udir-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.110. 2n1l-10ge2p1x710-ethip4udp-nat44ed-h4096-p63-s258048-cps-ndrpdr suite

CPS on empty UDP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and one static IPv4 /${dest_mask} route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional UDP flows) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: Benchmarking Methodology for Network Security Device Performance (draft-ietf-bmwg-ngfw-performance-03).

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
| Resource | resources/libraries/robot/ip/nat.robot
| Resource | resources/libraries/robot/shared/traffic.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | UDP | UDP_CPS
| ... | NAT44_ENDPOINT_DEPENDENT | SCALE | HOSTS_4096 | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44ed-h4096-p63-s258048-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${20}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${20}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.3
| ${out_mask}= | ${30}
# Scale settings
| ${n_hosts}= | ${4096}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${transaction_scale}= | ${n_sessions}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h
| ${transaction_type}= | udp_cps
| ${disable_latency}= | ${True}

7.5.110.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Find NDR and PDR intervals using optimized search

7.5.110.2. 64B-1c-ethip4udp-nat44ed-h4096-p63-s258048-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.110.3. 64B-2c-ethip4udp-nat44ed-h4096-p63-s258048-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.110.4. 64B-4c-ethip4udp-nat44ed-h4096-p63-s258048-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.111. 2n1l-10ge2p1x710-ethip4udp-nat44ed-h4096-p63-s258048-tput-ndrpdr suite

TPUT on lightweight UDP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains client and server ASTF programs, generating packets containing Ethernet header, IPv4 header, UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | NAT44 | UDP | UDP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_4096 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44ed-h4096-p63-s258048-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| # TODO CSIT-1765: Unify suite Documentation.
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${20}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${20}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.3
| ${out_mask}= | ${20}
# Scale settings
| ${n_hosts}= | ${4096}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${transaction_scale}= | ${n_sessions}
| ${packets_per_transaction_and_direction}= | ${ASTF_N_DATA_FRAMES}
# Ramp-up settings
| ${ramp_up_rate}= | ${30000}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h-pps
| ${transaction_type}= | udp_pps
| ${disable_latency}= | ${True}

7.5.111.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Send ramp-up traffic
  And Verify NAT44 UDP sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search
  And Verify NAT44 UDP sessions number on DUT1 node

7.5.111.2. 100B-1c-ethip4udp-nat44ed-h4096-p63-s258048-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.111.3. 100B-2c-ethip4udp-nat44ed-h4096-p63-s258048-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.111.4. 100B-4c-ethip4udp-nat44ed-h4096-p63-s258048-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.111.5. 1518B-1c-ethip4udp-nat44ed-h4096-p63-s258048-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.111.6. 1518B-2c-ethip4udp-nat44ed-h4096-p63-s258048-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.111.7. 1518B-4c-ethip4udp-nat44ed-h4096-p63-s258048-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.111.8. 9000B-1c-ethip4udp-nat44ed-h4096-p63-s258048-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.111.9. 9000B-2c-ethip4udp-nat44ed-h4096-p63-s258048-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.111.10. 9000B-4c-ethip4udp-nat44ed-h4096-p63-s258048-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.112. 2n1l-10ge2p1x710-ethip4udp-nat44ed-h4096-p63-s258048-udir-ndrpdr suite

RFC2544: Pkt throughput NAT44 endpoint-dependent mode performance test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and one static IPv4 /${dest_mask} route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L4 flows (uni-directional UDP flows) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: Benchmarking Methodology for Network Security Device Performance (draft-ietf-bmwg-ngfw-performance-03).

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | UDP | UDP_UDIR
| ... | NAT44_ENDPOINT_DEPENDENT | SCALE | HOSTS_4096 | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44ed-h4096-p63-s258048-udir
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${8}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${20}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.3
| ${out_mask}= | ${30}
# Scale settings
| ${n_hosts}= | ${4096}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
# Ramp-up settings
| ${ramp_up_rate}= | ${500000}
| ${ramp_up_duration}= | ${1.1}
# Traffic profile
| ${traffic_profile}= | trex-stl-ethip4udp-${n_hosts}u${n_ports}p-udir
| ${traffic_directions}= | ${1}

7.5.112.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Send ramp-up traffic
  And Verify NAT44 UDP sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search

7.5.112.2. 64B-1c-ethip4udp-nat44ed-h4096-p63-s258048-udir-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.112.3. 64B-2c-ethip4udp-nat44ed-h4096-p63-s258048-udir-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.112.4. 64B-4c-ethip4udp-nat44ed-h4096-p63-s258048-udir-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.112.5. 1518B-1c-ethip4udp-nat44ed-h4096-p63-s258048-udir-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.112.6. 1518B-2c-ethip4udp-nat44ed-h4096-p63-s258048-udir-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.112.7. 1518B-4c-ethip4udp-nat44ed-h4096-p63-s258048-udir-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.112.8. 9000B-1c-ethip4udp-nat44ed-h4096-p63-s258048-udir-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.112.9. 9000B-2c-ethip4udp-nat44ed-h4096-p63-s258048-udir-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.112.10. 9000B-4c-ethip4udp-nat44ed-h4096-p63-s258048-udir-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.112.11. IMIX-1c-ethip4udp-nat44ed-h4096-p63-s258048-udir-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.112.12. IMIX-2c-ethip4udp-nat44ed-h4096-p63-s258048-udir-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.112.13. IMIX-4c-ethip4udp-nat44ed-h4096-p63-s258048-udir-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}

7.5.113. 2n1l-10ge2p1x710-ethip4udp-nat44ed-h65536-p63-s4128768-cps-ndrpdr suite

CPS on empty UDP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and one static IPv4 /${dest_mask} route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L7 flows (${cps} bi-directional UDP flows) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: Benchmarking Methodology for Network Security Device Performance (draft-ietf-bmwg-ngfw-performance-03).

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
| Resource | resources/libraries/robot/ip/nat.robot
| Resource | resources/libraries/robot/shared/traffic.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | UDP | UDP_CPS
| ... | NAT44_ENDPOINT_DEPENDENT | SCALE | HOSTS_65536 | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44ed-h65536-p63-s4128768-cps
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${16}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${16}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.63
| ${out_mask}= | ${26}
# Scale settings
| ${n_hosts}= | ${65536}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${transaction_scale}= | ${n_sessions}
# Main heap size multiplicator
| ${heap_size_mult}= | ${2}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h
| ${transaction_type}= | udp_cps
| ${disable_latency}= | ${True}

7.5.113.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Find NDR and PDR intervals using optimized search

7.5.113.2. 64B-1c-ethip4udp-nat44ed-h65536-p63-s4128768-cps-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.113.3. 64B-2c-ethip4udp-nat44ed-h65536-p63-s4128768-cps-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.113.4. 64B-4c-ethip4udp-nat44ed-h65536-p63-s4128768-cps-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.114. 2n1l-10ge2p1x710-ethip4udp-nat44ed-h65536-p63-s4128768-tput-ndrpdr suite

TPUT on lightweight UDP transactions with NAT44ED

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4. routing and two static IPv4 /24 route entries. DUT1 is tested with with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contains client and server ASTF programs, generating packets containing Ethernet header, IPv4 header, UDP header and static MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: RFC2544.

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | NAT44 | UDP | UDP_TPUT | DRV_VFIO_PCI
| ... | SCALE | HOSTS_65536 | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44ed-h65536-p63-s4128768-tput
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| # TODO CSIT-1765: Unify suite Documentation.
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L7
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${16}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${16}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.63
| ${out_mask}= | ${26}
# Scale settings
| ${n_hosts}= | ${65536}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
| ${transaction_scale}= | ${n_sessions}
| ${packets_per_transaction_and_direction}= | ${ASTF_N_DATA_FRAMES}
# Main heap size multiplicator
| ${heap_size_mult}= | ${2}
# Ramp-up settings
| ${ramp_up_rate}= | ${30000}
# Traffic profile
| ${traffic_profile}= | trex-astf-ethip4udp-${n_hosts}h-pps
| ${transaction_type}= | udp_pps
| ${disable_latency}= | ${True}

7.5.114.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
${pre_stats}=  Create List  vpp-clear-stats  vpp-enable-packettrace  vpp-enable-elog  vpp-clear-runtime
Set Test Variable  ${pre_stats}
${post_stats}=  Create List  vpp-show-stats  vpp-show-packettrace  vpp-show-elog  vpp-show-runtime
Set Test Variable  ${post_stats}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Send ramp-up traffic
  And Verify NAT44 UDP sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search
  And Verify NAT44 UDP sessions number on DUT1 node

7.5.114.2. 100B-1c-ethip4udp-nat44ed-h65536-p63-s4128768-tput-ndrpdr


frame_size=${100}  phy_cores=${1}

7.5.114.3. 100B-2c-ethip4udp-nat44ed-h65536-p63-s4128768-tput-ndrpdr


frame_size=${100}  phy_cores=${2}

7.5.114.4. 100B-4c-ethip4udp-nat44ed-h65536-p63-s4128768-tput-ndrpdr


frame_size=${100}  phy_cores=${4}

7.5.114.5. 1518B-1c-ethip4udp-nat44ed-h65536-p63-s4128768-tput-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.114.6. 1518B-2c-ethip4udp-nat44ed-h65536-p63-s4128768-tput-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.114.7. 1518B-4c-ethip4udp-nat44ed-h65536-p63-s4128768-tput-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.114.8. 9000B-1c-ethip4udp-nat44ed-h65536-p63-s4128768-tput-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.114.9. 9000B-2c-ethip4udp-nat44ed-h65536-p63-s4128768-tput-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.114.10. 9000B-4c-ethip4udp-nat44ed-h65536-p63-s4128768-tput-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.115. 2n1l-10ge2p1x710-ethip4udp-nat44ed-h65536-p63-s4128768-udir-ndrpdr suite

RFC2544: Pkt throughput NAT44 endpoint-dependent mode performance test cases

  • [Top] Network Topologies: TG-DUT1-TG 2-node circular topology with single links between nodes.

  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.

  • [Cfg] DUT configuration: DUT1 is configured with IPv4 routing and one static IPv4 /${dest_mask} route entries. DUT1 is tested with ${nic_name}.

  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library.

Test packets are generated by TG on links to DUTs. TG traffic profile contain L4 flows (uni-directional UDP flows) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.

  • [Ref] Applicable standard specifications: Benchmarking Methodology for Network Security Device Performance (draft-ietf-bmwg-ngfw-performance-03).

*** Settings ***
| Resource | resources/libraries/robot/shared/default.robot
|
| Force Tags | 2_NODE_SINGLE_LINK_TOPO | PERFTEST | HW_ENV | NDRPDR
| ... | NIC_Intel-X710 | ETH | IP4FWD | FEATURE | NAT44 | UDP | UDP_UDIR
| ... | NAT44_ENDPOINT_DEPENDENT | SCALE | HOSTS_65536 | DRV_VFIO_PCI
| ... | RXQ_SIZE_0 | TXQ_SIZE_0
| ... | ethip4udp-nat44ed-h65536-p63-s4128768-udir
|
| Suite Setup | Setup suite topology interfaces | performance
| Suite Teardown | Tear down suite | performance
| Test Setup | Setup test | performance
| Test Teardown | Tear down test | performance | nat-ed
|
| Test Template | Local Template
|
| 
*** Variables ***
| @{plugins_to_enable}= | dpdk_plugin.so | perfmon_plugin.so | nat_plugin.so
| ${crypto_type}= | ${None}
| ${nic_name}= | Intel-X710
| ${nic_driver}= | vfio-pci
| ${nic_rxq_size}= | 0
| ${nic_txq_size}= | 0
| ${nic_pfs}= | 2
| ${nic_vfs}= | 0
| ${osi_layer}= | L3
| ${overhead}= | ${0}
# IP settings
| ${tg_if1_ip4}= | 10.0.0.2
| ${tg_if1_mask}= | ${20}
| ${tg_if2_ip4}= | 12.0.0.2
| ${tg_if2_mask}= | ${20}
| ${dut1_if1_ip4}= | 10.0.0.1
| ${dut1_if1_mask}= | ${24}
| ${dut1_if2_ip4}= | 12.0.0.1
| ${dut1_if2_mask}= | ${24}
| ${dest_net}= | 20.0.0.0
| ${dest_mask}= | ${8}
# NAT settings
| ${nat_mode}= | endpoint-dependent
| ${in_net}= | 192.168.0.0
| ${in_mask}= | ${16}
| ${out_net}= | 68.142.68.0
| ${out_net_end}= | 68.142.68.63
| ${out_mask}= | ${26}
# Scale settings
| ${n_hosts}= | ${65536}
| ${n_ports}= | ${63}
| ${n_sessions}= | ${${n_hosts} * ${n_ports}}
# Main heap size multiplicator
| ${heap_size_mult}= | ${2}
# Ramp-up settings
| ${ramp_up_rate}= | ${500000}
| ${ramp_up_duration}= | ${18.2}
# Traffic profile
| ${traffic_profile}= | trex-stl-ethip4udp-${n_hosts}u${n_ports}p-udir
| ${traffic_directions}= | ${1}

7.5.115.1. Local Template

  • [Cfg] DUT runs NAT44 ${nat_mode} configuration. Each DUT uses ${phy_cores} physical core(s) for worker threads.

  • [Ver] Measure NDR and PDR values using MLRsearch algorithm.

Arguments: - frame_size - Framesize in Bytes in integer or string (IMIX_v4_1). Type: integer, string - phy_cores - Number of physical cores. Type: integer - rxq - Number of RX queues, default value: ${None}. Type: integer


Set Test Variable  \${frame_size}
Given Set Max Rate And Jumbo
  And Add worker threads to all DUTs  ${phy_cores}  ${rxq}
  And Pre-initialize layer driver  ${nic_driver}
  And Apply startup configuration on all VPP DUTs
 When Initialize layer driver  ${nic_driver}
  And Initialize layer interface
  And Initialize IPv4 forwarding for NAT44 in circular topology
  And Initialize NAT44 endpoint-dependent mode in circular topology
 Then Send ramp-up traffic
  And Verify NAT44 UDP sessions number on DUT1 node
  And Find NDR and PDR intervals using optimized search

7.5.115.2. 64B-1c-ethip4udp-nat44ed-h65536-p63-s4128768-udir-ndrpdr


frame_size=${64}  phy_cores=${1}

7.5.115.3. 64B-2c-ethip4udp-nat44ed-h65536-p63-s4128768-udir-ndrpdr


frame_size=${64}  phy_cores=${2}

7.5.115.4. 64B-4c-ethip4udp-nat44ed-h65536-p63-s4128768-udir-ndrpdr


frame_size=${64}  phy_cores=${4}

7.5.115.5. 1518B-1c-ethip4udp-nat44ed-h65536-p63-s4128768-udir-ndrpdr


frame_size=${1518}  phy_cores=${1}

7.5.115.6. 1518B-2c-ethip4udp-nat44ed-h65536-p63-s4128768-udir-ndrpdr


frame_size=${1518}  phy_cores=${2}

7.5.115.7. 1518B-4c-ethip4udp-nat44ed-h65536-p63-s4128768-udir-ndrpdr


frame_size=${1518}  phy_cores=${4}

7.5.115.8. 9000B-1c-ethip4udp-nat44ed-h65536-p63-s4128768-udir-ndrpdr


frame_size=${9000}  phy_cores=${1}

7.5.115.9. 9000B-2c-ethip4udp-nat44ed-h65536-p63-s4128768-udir-ndrpdr


frame_size=${9000}  phy_cores=${2}

7.5.115.10. 9000B-4c-ethip4udp-nat44ed-h65536-p63-s4128768-udir-ndrpdr


frame_size=${9000}  phy_cores=${4}

7.5.115.11. IMIX-1c-ethip4udp-nat44ed-h65536-p63-s4128768-udir-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${1}

7.5.115.12. IMIX-2c-ethip4udp-nat44ed-h65536-p63-s4128768-udir-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${2}

7.5.115.13. IMIX-4c-ethip4udp-nat44ed-h65536-p63-s4128768-udir-ndrpdr


frame_size=IMIX_v4_1  phy_cores=${4}