3.3. hoststack¶
3.3.1. hoststack suite¶
3.3.1.1. Set VPP Hoststack Attributes¶
Set the VPP HostStack attributes in the vpp_hoststack_attr dictionary. Arguments: - ${rxq} - Number of Rx Queues Type: int - ${rxd} - Number of Rx Descriptors Type: int - ${txd} - Number of Tx Descriptors Type: int - ${phy_cores} - Number of cores for workers Type: int - ${vpp_api_socket} - Path to VPP api socket file Type: string - ${api_seg_global_size} - Global API segment size Type: string - ${api_seg_api_size} - API segment API fifo size Type: string - ${tcp_cc_algo} - TCP congestion control algorithm Type: string - ${sess_evt_q_seg_size} - Session event queue segment size Type: string - ${sess_evt_q_length} - Session event queue length Type: string - ${sess_prealloc_sess} - Number of sessions to preallocate Type: string - ${sess_v4_tbl_buckets} - Number of IPv4 session table buckets Type: string - ${sess_v4_tbl_mem} - IPv4 session table memory size Type: string - ${sess_v4_hopen_buckets} - Number of IPv4 session half open table buckets Type: string - ${sess_v4_hopen_mem} - IPv4 session half open table memory size Type: string - ${sess_lendpt_buckets} - Number of session local endpoint table buckets Type: string - ${sess_lendpt_mem} - Session local endpoint table memory size Type: string Example: | Set VPP Hoststack Attributes | phy_cores=${phy_cores} |
Set To Dictionary ${vpp_hoststack_attr} rxq ${rxq}
Set To Dictionary ${vpp_hoststack_attr} rxd ${rxd}
Set To Dictionary ${vpp_hoststack_attr} txd ${txd}
Set To Dictionary ${vpp_hoststack_attr} phy_cores ${phy_cores}
Set To Dictionary ${vpp_hoststack_attr} vpp_api_socket ${vpp_api_socket}
Set To Dictionary ${vpp_hoststack_attr} api_seg_global_size ${api_seg_global_size}
Set To Dictionary ${vpp_hoststack_attr} api_seg_api_size ${api_seg_api_size}
Set To Dictionary ${vpp_hoststack_attr} tcp_cc_algo ${tcp_cc_algo}
Set To Dictionary ${vpp_hoststack_attr} sess_evt_q_seg_size ${sess_evt_q_seg_size}
Set To Dictionary ${vpp_hoststack_attr} sess_evt_q_length ${sess_evt_q_length}
Set To Dictionary ${vpp_hoststack_attr} sess_prealloc_sess ${sess_prealloc_sess}
Set To Dictionary ${vpp_hoststack_attr} sess_v4_tbl_buckets ${sess_v4_tbl_buckets}
Set To Dictionary ${vpp_hoststack_attr} sess_v4_tbl_mem ${sess_v4_tbl_mem}
Set To Dictionary ${vpp_hoststack_attr} sess_v4_hopen_buckets ${sess_v4_hopen_buckets}
Set To Dictionary ${vpp_hoststack_attr} sess_v4_hopen_mem ${sess_v4_hopen_mem}
Set To Dictionary ${vpp_hoststack_attr} sess_lendpt_buckets ${sess_lendpt_buckets}
Set To Dictionary ${vpp_hoststack_attr} sess_lendpt_mem ${sess_lendpt_mem}
3.3.1.2. Set VPP Echo Server Attributes¶
Set the HostStack vpp_echo test program attributes in the vpp_echo_server_attr dictionary. Arguments: - ${cfg_vpp_feature} - VPP Feature requiring config Type: string - ${namespace} - Namespace Type: string - ${nthreads} - Number of threads Type: string - ${mq_size} - Number of threads Type: string - ${nclients} - Number of clients Type: string - ${quic_streams} - Number of quic streams Type: string - ${fifo_size} - Session Fifo Size Type: integer - ${time} - Timing events (start:end) Type: string - ${rx_bytes} - Number of Bytes to receive Type: string - ${tx_bytes} - Number of Bytes to send Type: string - ${rx_results_diff} - Rx Results are different to pass Type: boolean - ${tx_results_diff} - Tx Results are different to pass Type: boolean Example: | Set VPP Echo Server Attributes | nclients=${nclients} | | tx_bytes=${tx_bytes} |
Set To Dictionary ${vpp_echo_server_attr} cfg_vpp_feature ${cfg_vpp_feature}
Set To Dictionary ${vpp_echo_server_attr} namespace ${namespace}
Set To Dictionary ${vpp_echo_server_attr} nthreads ${nthreads}
Set To Dictionary ${vpp_echo_server_attr} mq_size ${mq_size}
Set To Dictionary ${vpp_echo_server_attr} nclients ${nclients}
Set To Dictionary ${vpp_echo_server_attr} quic_streams ${quic_streams}
Set To Dictionary ${vpp_echo_server_attr} time ${time}
Set To Dictionary ${vpp_echo_server_attr} fifo_size ${fifo_size}
Set To Dictionary ${vpp_echo_server_attr} rx_bytes ${rx_bytes}
Set To Dictionary ${vpp_echo_server_attr} tx_bytes ${tx_bytes}
Set To Dictionary ${vpp_echo_server_attr} rx_results_diff ${rx_results_diff}
Set To Dictionary ${vpp_echo_server_attr} tx_results_diff ${tx_results_diff}
3.3.1.3. Set VPP Echo Client Attributes¶
Set the HostStack vpp_echo test program attributes in the vpp_echo_client_attr dictionary. Arguments: - ${cfg_vpp_feature} - VPP Feature requiring config Type: string - ${namespace} - Namespace Type: string - ${nthreads} - Number of threads Type: string - ${mq_size} - Number of threads Type: string - ${nclients} - Number of clients Type: string - ${quic_streams} - Number of quic streams Type: string - ${fifo_size} - Session Fifo Size Type: integer - ${time} - Timing events (start:end) Type: string - ${rx_bytes} - Number of Bytes to receive Type: string - ${tx_bytes} - Number of Bytes to send Type: string - ${rx_results_diff} - Rx Results are different to pass Type: boolean - ${tx_results_diff} - Tx Results are different to pass Type: boolean Example: | Set VPP Echo Client Attributes | nclients=${nclients} | | tx_bytes=${tx_bytes} |
Set To Dictionary ${vpp_echo_client_attr} cfg_vpp_feature ${cfg_vpp_feature}
Set To Dictionary ${vpp_echo_client_attr} namespace ${namespace}
Set To Dictionary ${vpp_echo_client_attr} nthreads ${nthreads}
Set To Dictionary ${vpp_echo_client_attr} mq_size ${mq_size}
Set To Dictionary ${vpp_echo_client_attr} nclients ${nclients}
Set To Dictionary ${vpp_echo_client_attr} quic_streams ${quic_streams}
Set To Dictionary ${vpp_echo_client_attr} time ${time}
Set To Dictionary ${vpp_echo_client_attr} fifo_size ${fifo_size}
Set To Dictionary ${vpp_echo_client_attr} rx_bytes ${rx_bytes}
Set To Dictionary ${vpp_echo_client_attr} tx_bytes ${tx_bytes}
Set To Dictionary ${vpp_echo_client_attr} rx_results_diff ${rx_results_diff}
Set To Dictionary ${vpp_echo_client_attr} tx_results_diff ${tx_results_diff}
3.3.1.4. Set Iperf3 Server Attributes¶
Set the HostStack iperf3 test program attributes in the iperf3_server_attr dictionary. Arguments: - ${vcl_config} - VCL configuration file name Type: string - ${ld_preload} - Use the VCL LD_PRELOAD library Type: boolean - ${transparent_tls} - Use VCL Transparent-TLS mode Type: boolean - ${ip_version} - IP version (4 or 6) Type: int Example: | Set Iperf3 Server Attributes | vcl_config=${vcl_config} | | ip_version=${ip_version} |
Set To Dictionary ${iperf3_server_attr} vcl_config ${vcl_config}
Set To Dictionary ${iperf3_server_attr} ld_preload ${ld_preload}
Set To Dictionary ${iperf3_server_attr} transparent_tls ${transparent_tls}
Set To Dictionary ${iperf3_server_attr} ip_version ${ip_version}
3.3.1.5. Set Iperf3 Client Attributes¶
Set the HostStack iperf3 test program attributes in the iperf3_client_attr dictionary. Arguments: - ${vcl_config} - VCL configuration file name Type: string - ${ld_preload} - Use the VCL LD_PRELOAD library Type: boolean - ${transparent_tls} - Use VCL Transparent-TLS mode Type: boolean - ${ip_version} - IP version (4 or 6) Type: int - ${parallel} - Number of parallel streams Type: int - ${bandwidth} - Target bandwidth in bits/sec Type: int - ${udp} - UDP or TCP protocol Type: boolean - ${length} - Packet Length Type: int Example: | Set Iperf3 Client Attributes | vcl_config=${vcl_config} | | ip_version=${ip_version} | parallel=${streams} | | bandwidth=${bandwidth} udp=${True} |
Set To Dictionary ${iperf3_client_attr} vcl_config ${vcl_config}
Set To Dictionary ${iperf3_client_attr} ld_preload ${ld_preload}
Set To Dictionary ${iperf3_client_attr} transparent_tls ${transparent_tls}
Set To Dictionary ${iperf3_client_attr} ip_version ${ip_version}
Set To Dictionary ${iperf3_client_attr} parallel ${parallel}
Set To Dictionary ${iperf3_client_attr} bandwidth ${bandwidth}
Set To Dictionary ${iperf3_client_attr} udp ${udp}
Set To Dictionary ${iperf3_client_attr} length ${length}
3.3.1.6. Run hoststack test program on DUT¶
Configure IP address on the port, set it up and start the specified HostStack test program on the specified DUT. Arguments: - ${node} - VPP DUT node Type: Node - ${intf} - VPP DUT node interface key Type: string - ${ip4_addr} - VPP DUT node interface ip4 address Type: string - ${ip4_mask} - VPP DUT node interface ip4 network mask Type: string - ${namespace} - Network namespace to run test program in Type: string - ${cfg_vpp_feature} - VPP hoststack feature requiring additional VPP configuration Type: string - ${core_list} - Cpu core affinity list Type: string - ${test_program} - Host Stack test program Type: dict Example: | Run hoststack test program on DUT | ${dut1} | ${dut1_if1} | | ${dut1_if1_ip4_addr} | ${dut1_if1_ip4_mask} | default | | quic | ${vpp_echo_server} |
${is_dut1}= Run Keyword And Return Status Dictionaries should be equal ${node} ${dut1}
Run Keyword If ${is_dut1} and ${vpp_nsim_attr}[output_nsim_enable] Configure VPP NSIM ${node} ${vpp_nsim_attr} ${intf}
Run Keyword If '${cfg_vpp_feature}' != '' Additional VPP Config for Feature ${cfg_vpp_feature} ${node}
VPP Get Interface Data ${node}
Set Interface State ${node} ${intf} up
VPP Interface Set IP Address ${node} ${intf} ${ip4_addr} ${ip4_mask}
Vpp Node Interfaces Ready Wait ${node}
${hoststack_test_program_pid}= Start Hoststack Test Program ${node} ${namespace} ${core_list} ${test_program}
Return From Keyword ${hoststack_test_program_pid}
3.3.1.7. Additional VPP Config For Feature quic¶
Configure VPP quic attributes on the specified DUT. Arguments: - ${node} - VPP DUT node Type: Node
Set hoststack quic fifo size ${node} ${quic_fifo_size}
Set hoststack quic crypto engine ${node} ${quic_crypto_engine}
3.3.1.8. Configure VPP hoststack attributes on all DUTs¶
Configure VPP HostStack attributes on all DUTs.
Set Max Rate And Jumbo
Add worker threads to all DUTs ${vpp_hoststack_attr}[phy_cores] ${vpp_hoststack_attr}[rxq] ${vpp_hoststack_attr}[rxd] ${vpp_hoststack_attr}[txd]
Pre-initialize layer driver ${nic_driver}
FOR ${dut} IN @{duts}
\ Import Library resources.libraries.python.VppConfigGenerator WITH NAME ${dut}
\ Run keyword ${dut}.Add socksvr ${vpp_hoststack_attr}[vpp_api_socket]
\ Run keyword ${dut}.Add api segment global size ${vpp_hoststack_attr}[api_seg_global_size]
\ Run keyword ${dut}.Add api segment api size ${vpp_hoststack_attr}[api_seg_api_size]
\ Run Keyword If '${dut}' == 'DUT1' and ${vpp_nsim_attr}[output_nsim_enable] ${dut}.Add Nsim poll main thread
\ Run keyword ${dut}.Add api segment gid testuser
\ Run keyword ${dut}.Add tcp congestion control algorithm ${vpp_hoststack_attr}[tcp_cc_algo]
\ Run keyword ${dut}.Add session enable
\ Run keyword ${dut}.Add session event queues memfd segment
\ Run keyword ${dut}.Add session event queues segment size ${vpp_hoststack_attr}[sess_evt_q_seg_size]
\ Run keyword ${dut}.Add session event queue length ${vpp_hoststack_attr}[sess_evt_q_length]
\ Run keyword ${dut}.Add session preallocated sessions ${vpp_hoststack_attr}[sess_prealloc_sess]
\ Run keyword ${dut}.Add session v4 session table buckets ${vpp_hoststack_attr}[sess_v4_tbl_buckets]
\ Run keyword ${dut}.Add session v4 session table memory ${vpp_hoststack_attr}[sess_v4_tbl_mem]
\ Run keyword ${dut}.Add session v4 halfopen table buckets ${vpp_hoststack_attr}[sess_v4_hopen_buckets]
\ Run keyword ${dut}.Add session v4 halfopen table memory ${vpp_hoststack_attr}[sess_v4_hopen_mem]
\ Run keyword ${dut}.Add session local endpoints table buckets ${vpp_hoststack_attr}[sess_lendpt_buckets]
\ Run keyword ${dut}.Add session local endpoints table memory ${vpp_hoststack_attr}[sess_lendpt_mem]
Apply startup configuration on all VPP DUTs
3.3.1.9. Get Test Results From Hoststack VPP Echo Test¶
Configure IP address on the port, set it up and start the specified HostStack test programs on the DUTs. Gather test program output and append JSON formatted test data in message. Return boolean indicating there was a defered failure of either the server and/or client test programs.
Set To Dictionary ${vpp_echo_server_attr} uri_ip4_addr ${dut2_if1_ip4_addr}
Set To Dictionary ${vpp_echo_client_attr} uri_ip4_addr ${dut2_if1_ip4_addr}
Configure VPP Hoststack Attributes on all DUTs
${vpp_echo_server}= Get VPP Echo Command ${vpp_echo_server_attr}
${skip_cnt}= Evaluate ${CPU_CNT_SYSTEM} + ${CPU_CNT_MAIN} + ${vpp_hoststack_attr}[phy_cores]
${numa}= Get interfaces numa node ${dut2} ${dut2_if1}
${core_list}= Cpu list per node str ${dut2} ${numa} skip_cnt=${skip_cnt} cpu_cnt=${vpp_echo_server_attr}[cpu_cnt]
${server_pid}= Run hoststack test program on DUT ${dut2} ${dut2_if1} ${dut2_if1_ip4_addr} ${dut2_if1_ip4_prefix} ${vpp_echo_server_attr}[namespace] ${core_list} ${vpp_echo_server_attr}[cfg_vpp_feature] ${vpp_echo_server}
${vpp_echo_client}= Get VPP Echo Command ${vpp_echo_client_attr}
${numa}= Get interfaces numa node ${dut1} ${dut1_if1}
${core_list}= Cpu list per node str ${dut1} ${numa} skip_cnt=${skip_cnt} cpu_cnt=${vpp_echo_client_attr}[cpu_cnt]
${client_pid}= Run hoststack test program on DUT ${dut1} ${dut1_if1} ${dut1_if1_ip4_addr} ${dut1_if1_ip4_prefix} ${vpp_echo_client_attr}[namespace] ${core_list} ${vpp_echo_client_attr}[cfg_vpp_feature] ${vpp_echo_client}
When Hoststack Test Program Finished ${dut1} ${client_pid}
${client_defer_fail} ${client_output}= Analyze hoststack test program output ${dut1} Client ${vpp_nsim_attr} ${vpp_echo_client}
Then Set test message ${client_output}
And Hoststack Test Program Finished ${dut2} ${server_pid}
${server_defer_fail} ${server_output}= Analyze hoststack test program output ${dut2} Server ${vpp_nsim_attr} ${vpp_echo_server}
Set test message ${server_output} append=True
Run Keyword And Return Hoststack Test Program Defer Fail ${server_defer_fail} ${client_defer_fail}
3.3.1.10. Get Test Results From Hoststack Iperf3 Test¶
Configure IP address on the port, set it up and start the specified HostStack test programs on the DUTs. Gather test program output and append JSON formatted test data in message. Return boolean indicating there was a defered failure of either the server and/or client test programs.
Set To Dictionary ${iperf3_client_attr} ip_address ${dut2_if1_ip4_addr}
Configure VPP Hoststack Attributes on all DUTs
${iperf3_server}= Get Iperf3 Command ${iperf3_server_attr}
${skip_cnt}= Evaluate ${CPU_CNT_SYSTEM} + ${CPU_CNT_MAIN} + ${vpp_hoststack_attr}[phy_cores]
${numa}= Get interfaces numa node ${dut2} ${dut2_if1}
${core_list}= Cpu list per node str ${dut2} ${numa} skip_cnt=${skip_cnt} cpu_cnt=${iperf3_server_attr}[cpu_cnt]
${server_pid}= Run hoststack test program on DUT ${dut2} ${dut2_if1} ${dut2_if1_ip4_addr} ${dut2_if1_ip4_prefix} ${iperf3_server_attr}[namespace] ${core_list} ${iperf3_server_attr}[cfg_vpp_feature] ${iperf3_server}
${iperf3_client}= Get Iperf3 Command ${iperf3_client_attr}
${numa}= Get interfaces numa node ${dut1} ${dut1_if1}
${core_list}= Cpu list per node str ${dut1} ${numa} skip_cnt=${skip_cnt} cpu_cnt=${iperf3_client_attr}[cpu_cnt]
${client_pid}= Run hoststack test program on DUT ${dut1} ${dut1_if1} ${dut1_if1_ip4_addr} ${dut1_if1_ip4_prefix} ${iperf3_client_attr}[namespace] ${core_list} ${iperf3_client_attr}[cfg_vpp_feature] ${iperf3_client}
When Hoststack Test Program Finished ${dut1} ${client_pid}
${client_defer_fail} ${client_output}= Analyze hoststack test program output ${dut1} Client ${vpp_nsim_attr} ${iperf3_client}
Then Set test message ${client_output}
Return From Keyword ${client_defer_fail}
3.3.1.11. Set up LDP or VCL Nginx on DUT node¶
Setup for suites which uses VCL or LDP Nginx on DUT. Arguments: - dut - DUT node. Type: string - mode - VCL Nginx or LDP Nginx. Type: string - rps_cps - Test request or connect. Type: string - core_num - Nginx work processes number. Type: int - qat - Whether to use the qat engine. Type: string - tls_tcp - TLS or TCP. Example: | Set up LDP or VCL NGINX on DUT node | ${dut} |${mode}| ${rps_cps} | ${phy_cores} | ${qat} | ${tls_tcp} |
Set Interface State ${dut} ${DUT1_${int}1}[0] up
VPP Interface Set IP Address ${dut} ${DUT1_${int}1}[0] ${dut_ip_addrs}[0] ${dut_ip_prefix}
Vpp Node Interfaces Ready Wait ${dut}
${skip_cnt}= Evaluate ${CPU_CNT_SYSTEM} + ${CPU_CNT_MAIN} + ${vpp_hoststack_attr}[phy_cores]
${numa}= Get interfaces numa node ${dut} ${DUT1_${int}1}[0]
Apply Nginx configuration on DUT ${dut} ${phy_cores}
Set To Dictionary ${nginx_server_attr} ip_address ${dut_ip_addrs}[0]
${core_list}= Cpu list per node str ${dut} ${numa} skip_cnt=${skip_cnt} cpu_cnt=${nginx_server_attr}[cpu_cnt]
${cpu_idle_list}= Get cpu idle list ${dut} ${numa} ${smt_used} ${cpu_alloc_str}
${nginx_server}= Get Nginx Command ${nginx_server_attr} ${nginx_version} ${packages_dir}
${server_pid}= Start Hoststack Test Program ${dut} ${nginx_server_attr}[namespace] ${core_list} ${nginx_server}
Taskset Nginx PID to idle cores ${dut} ${cpu_idle_list}
3.3.1.12. Measure TLS requests or connections per second¶
Measure number of requests or connections per second using ab. Arguments: - ${ciphers} - Specify SSL/TLS cipher suite - ${files} - Filename to be requested from the servers - ${tls_tcp} - Test TLS or TCP. - ${mode} - VCL Nginx or LDP Nginx. Example: | Measure TLS requests or connections per second | AES128-SHA | 64 | tls | rps |
${output}= Run ab ${tg} ${dut_ip_addrs}[0] ${ab_ip_addrs}[0] ${tls_tcp} ${ciphers} ${files} ${mode} ${r_total} ${c_total} ${listen_port}
Set test message ${output}
Log VPP Hoststack data ${dut1}