crypto

40ge2p1xl710-ethip4ipsecbasetnl-ip4base-int-aes-gcm-ndrpdr

RFC2544: Pkt throughput IPv4 IPsec tunnel mode.

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 on TG-DUTn, Eth-IPv4-IPSec on DUT1-DUT2
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with multiple IPsec tunnels between them. DUTs get IPv4 traffic from TG, encrypt it and send to another DUT, where packets are decrypted and sent back to TG
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, number of flows per flow-group equals to number of IPSec tunnels) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. Incrementing of IP.dst (IPv4 destination address) field is applied to both streams.
  • [Ref] Applicable standard specifications: RFC4303 and RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4ipsecbasetnl-ip4base-int-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 51 3.95e4 0.00
dpdk-process any wait 0 0 1 2.38e4 0.00
fib-walk any wait 0 0 2 1.96e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 4.09e3 0.00
lisp-retry-service any wait 0 0 2 1.53e3 0.00
unix-epoll-input polling 3482 0 0 2.59e6 0.00
vpe-oam-process any wait 0 0 2 8.06e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 131.96, last 128 main loops 22.86 per node 172.12
vector rates in 7.3910e6, out 5.5424e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 60126 7285337 0 1.26e1 121.17
FortyGigabitEthernet88/0/0-tx active 60126 7285337 0 4.88e1 121.17
FortyGigabitEthernet88/0/1-out active 63685 7272532 0 1.24e1 114.19
FortyGigabitEthernet88/0/1-tx active 63685 7272532 0 5.12e1 114.19
dpdk-crypto-input polling 73552 14557869 0 6.37e1 197.93
dpdk-esp4-decrypt active 62106 7285952 0 1.50e2 117.31
dpdk-esp4-decrypt-post active 63685 7272532 0 6.00e1 114.19
dpdk-esp4-encrypt-tun active 66991 7286364 0 2.15e2 108.77
dpdk-input polling 73552 14572316 0 5.54e1 198.12
ethernet-input active 129097 14572316 0 2.09e1 112.88
ip4-input-no-checksum active 119745 21844848 0 2.36e1 182.43
ip4-local active 62106 7285952 0 4.87e1 117.31
ip4-lookup active 179871 29130185 0 3.76e1 161.95
ip4-midchain active 66991 7286364 0 5.06e1 108.77
ip4-rewrite active 123811 14557869 0 2.83e1 117.58
ipsec4-if-input active 62106 7285952 0 3.07e1 117.31
unix-epoll-input polling 71 0 0 1.58e3 0.00
64b-2t2c-ethip4ipsecbasetnl-ip4base-int-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 4.23e4 0.00
dhcp-client-process any wait 0 0 1 2.23e3 0.00
dpdk-process any wait 0 0 1 9.73e5 0.00
fib-walk any wait 0 0 2 7.83e3 0.00
ip-neighbor-scan-process any wait 0 0 1 1.51e4 0.00
ip-route-resolver-process any wait 0 0 1 3.79e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 2.28e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.39e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 2.48e3 0.00
lisp-retry-service any wait 0 0 2 2.06e3 0.00
statseg-collector-process time wait 0 0 1 5.76e3 0.00
unix-epoll-input polling 4241 0 0 2.13e6 0.00
vpe-oam-process any wait 0 0 2 8.34e2 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 141.45, last 128 main loops 14.66 per node 134.00
vector rates in 7.4419e6, out 3.7209e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 113824 14699667 0 1.21e1 129.14
FortyGigabitEthernet88/0/1-tx active 113824 14699667 0 4.73e1 129.14
dpdk-crypto-input polling 116074 14699667 0 5.89e1 126.64
dpdk-esp4-decrypt active 113745 14699700 0 1.47e2 129.23
dpdk-esp4-decrypt-post active 113824 14699667 0 5.99e1 129.14
dpdk-input polling 116074 14699700 0 5.23e1 126.64
ethernet-input active 113745 14699700 0 2.10e1 129.23
ip4-input-no-checksum active 173327 29399367 0 2.32e1 169.62
ip4-local active 113745 14699700 0 5.11e1 129.23
ip4-lookup active 173327 29399367 0 3.12e1 169.62
ip4-rewrite active 113824 14699667 0 2.76e1 129.14
ipsec4-if-input active 113745 14699700 0 2.84e1 129.23
unix-epoll-input polling 113 0 0 1.42e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 94.05, last 128 main loops 6.08 per node 70.73
vector rates in 7.4419e6, out 7.4419e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 155695 14699732 0 1.32e1 94.41
FortyGigabitEthernet88/0/0-tx active 155695 14699732 0 4.72e1 94.41
dpdk-crypto-input polling 158658 14699732 0 6.04e1 92.65
dpdk-esp4-encrypt-tun active 156738 14699680 0 2.12e2 93.79
dpdk-input polling 158658 14699680 0 5.36e1 92.65
ethernet-input active 156738 14699680 0 1.97e1 93.79
ip4-input-no-checksum active 156738 14699680 0 2.68e1 93.79
ip4-lookup active 312433 29399412 0 5.13e1 94.09
ip4-midchain active 156738 14699680 0 4.93e1 93.79
ip4-rewrite active 155695 14699732 0 2.94e1 94.41
unix-epoll-input polling 155 0 0 1.57e3 0.00
64b-4t4c-ethip4ipsecbasetnl-ip4base-int-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 50 4.47e4 0.00
dpdk-process any wait 0 0 1 1.39e4 0.00
fib-walk any wait 0 0 2 5.37e3 0.00
ip-neighbor-scan-process any wait 0 0 1 3.92e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 5.66e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 2.18e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 5.41e3 0.00
lisp-retry-service any wait 0 0 2 4.58e3 0.00
statseg-collector-process time wait 0 0 1 6.29e3 0.00
unix-epoll-input polling 3216 0 0 2.82e6 0.00
vpe-oam-process any wait 0 0 1 4.36e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 236.64, last 128 main loops 28.00 per node 256.00
vector rates in 7.7627e6, out 3.8813e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 65183 15414421 0 1.03e1 236.48
FortyGigabitEthernet88/0/1-tx active 65183 15414421 0 4.65e1 236.48
dpdk-crypto-input polling 67087 15414421 0 6.16e1 229.77
dpdk-esp4-decrypt active 65145 15414528 0 1.50e2 236.62
dpdk-esp4-decrypt-post active 65183 15414421 0 5.81e1 236.48
dpdk-input polling 67087 15414528 0 5.08e1 229.77
ethernet-input active 65145 15414528 0 1.77e1 236.62
ip4-input-no-checksum active 130193 30828949 0 2.11e1 236.79
ip4-local active 65145 15414528 0 4.29e1 236.62
ip4-lookup active 130193 30828949 0 2.91e1 236.79
ip4-rewrite active 65183 15414421 0 2.50e1 236.48
ipsec4-if-input active 65145 15414528 0 2.52e1 236.62
unix-epoll-input polling 65 0 0 1.46e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 41100076 0 0 4.77e1 0.00
dpdk-input polling 41100076 0 0 1.02e2 0.00
unix-epoll-input polling 40097 0 0 9.02e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 22)
Time 3.9, average vectors/node 105.45, last 128 main loops 9.85 per node 114.64
vector rates in 7.7627e6, out 7.7627e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 146291 15414556 0 1.26e1 105.37
FortyGigabitEthernet88/0/0-tx active 146291 15414556 0 4.66e1 105.37
dpdk-crypto-input polling 147103 15414556 0 6.13e1 104.79
dpdk-esp4-encrypt-tun active 146085 15414508 0 2.09e2 105.52
dpdk-input polling 147103 15414508 0 5.19e1 104.79
ethernet-input active 146085 15414508 0 1.82e1 105.52
ip4-input-no-checksum active 146085 15414508 0 2.60e1 105.52
ip4-lookup active 292376 30829064 0 4.19e1 105.44
ip4-midchain active 146085 15414508 0 5.09e1 105.52
ip4-rewrite active 146291 15414556 0 2.87e1 105.37
unix-epoll-input polling 143 0 0 1.48e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 23)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 39677027 0 0 4.44e1 0.00
dpdk-input polling 39677027 0 0 1.04e2 0.00
unix-epoll-input polling 38710 0 0 8.99e2 0.00

40ge2p1xl710-ethip4ipsecbasetnl-ip4base-int-cbc-sha1-ndrpdr

RFC2544: Pkt throughput IPv4 IPsec tunnel mode.

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 on TG-DUTn, Eth-IPv4-IPSec on DUT1-DUT2
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with multiple IPsec tunnels between them. DUTs get IPv4 traffic from TG, encrypt it and send to another DUT, where packets are decrypted and sent back to TG
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, number of flows per flow-group equals to number of IPSec tunnels) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. Incrementing of IP.dst (IPv4 destination address) field is applied to both streams.
  • [Ref] Applicable standard specifications: RFC4303 and RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4ipsecbasetnl-ip4base-int-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 50 4.77e4 0.00
dpdk-process any wait 0 0 1 2.28e4 0.00
fib-walk any wait 0 0 2 2.66e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 4.12e3 0.00
lisp-retry-service any wait 0 0 2 1.19e4 0.00
unix-epoll-input polling 2944 0 0 3.04e6 0.00
vpe-oam-process any wait 0 0 2 7.05e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 134.22, last 128 main loops 21.58 per node 162.47
vector rates in 7.3659e6, out 5.5208e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 58499 7214179 0 1.26e1 123.32
FortyGigabitEthernet88/0/0-tx active 58499 7214179 0 4.89e1 123.32
FortyGigabitEthernet88/0/1-out active 61839 7157985 0 1.23e1 115.75
FortyGigabitEthernet88/0/1-tx active 61839 7157985 0 5.19e1 115.75
dpdk-crypto-input polling 74064 14372164 0 6.44e1 194.05
dpdk-esp4-decrypt active 60755 7215617 0 1.49e2 118.77
dpdk-esp4-decrypt-post active 61839 7157985 0 6.16e1 115.75
dpdk-esp4-encrypt-tun active 62817 7218424 0 2.10e2 114.91
dpdk-input polling 74064 14434041 0 5.53e1 194.89
ethernet-input active 123572 14434041 0 2.09e1 116.81
ip4-input-no-checksum active 117960 21592026 0 2.46e1 183.05
ip4-local active 60755 7215617 0 4.86e1 118.77
ip4-lookup active 176459 28806205 0 3.76e1 163.25
ip4-midchain active 62817 7218424 0 5.04e1 114.91
ip4-rewrite active 120338 14372164 0 2.98e1 119.43
ipsec4-if-input active 60755 7215617 0 3.06e1 118.77
unix-epoll-input polling 73 0 0 1.52e3 0.00
64b-2t2c-ethip4ipsecbasetnl-ip4base-int-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 3.36e4 0.00
dpdk-process any wait 0 0 2 1.78e4 0.00
fib-walk any wait 0 0 2 3.07e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 3.61e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.96e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 3.02e3 0.00
lisp-retry-service any wait 0 0 2 7.31e3 0.00
statseg-collector-process time wait 0 0 1 5.95e3 0.00
unix-epoll-input polling 5994 0 0 1.51e6 0.00
vpe-oam-process any wait 0 0 2 4.43e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 125.06, last 128 main loops 14.71 per node 134.50
vector rates in 7.3498e6, out 3.6749e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 133349 14520922 0 1.26e1 108.89
FortyGigabitEthernet88/0/1-tx active 133349 14520922 0 4.76e1 108.89
dpdk-crypto-input polling 138534 14520922 0 5.74e1 104.82
dpdk-esp4-decrypt active 133022 14520896 0 1.45e2 109.16
dpdk-esp4-decrypt-post active 133349 14520922 0 6.17e1 108.89
dpdk-input polling 138534 14520896 0 5.32e1 104.82
ethernet-input active 133022 14520896 0 2.14e1 109.16
ip4-input-no-checksum active 172546 29041818 0 2.44e1 168.31
ip4-local active 133022 14520896 0 5.12e1 109.16
ip4-lookup active 172546 29041818 0 3.18e1 168.31
ip4-rewrite active 133349 14520922 0 2.99e1 108.89
ipsec4-if-input active 133022 14520896 0 2.96e1 109.16
unix-epoll-input polling 136 0 0 1.38e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 60.15, last 128 main loops 2.48 per node 28.91
vector rates in 7.3498e6, out 7.3498e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 245334 14520995 0 1.51e1 59.19
FortyGigabitEthernet88/0/0-tx active 245334 14520995 0 4.80e1 59.19
dpdk-crypto-input polling 316732 14520995 0 5.69e1 45.85
dpdk-esp4-encrypt-tun active 238478 14520960 0 1.99e2 60.89
dpdk-input polling 316732 14520960 0 5.73e1 45.85
ethernet-input active 238478 14520960 0 2.14e1 60.89
ip4-input-no-checksum active 238478 14520960 0 3.07e1 60.89
ip4-lookup active 483812 29041955 0 5.34e1 60.03
ip4-midchain active 238478 14520960 0 5.35e1 60.89
ip4-rewrite active 245334 14520995 0 3.21e1 59.19
unix-epoll-input polling 309 0 0 1.41e3 0.00
64b-4t4c-ethip4ipsecbasetnl-ip4base-int-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 6.59e4 0.00
dpdk-process any wait 0 0 1 1.69e4 0.00
fib-walk any wait 0 0 2 1.74e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 2.58e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.32e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 1.68e3 0.00
lisp-retry-service any wait 0 0 2 8.06e3 0.00
statseg-collector-process time wait 0 0 1 4.14e3 0.00
unix-epoll-input polling 3382 0 0 2.69e6 0.00
vpe-oam-process any wait 0 0 2 5.88e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 238.87, last 128 main loops 28.00 per node 256.00
vector rates in 7.6859e6, out 3.8429e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 63977 15265016 0 1.03e1 238.60
FortyGigabitEthernet88/0/1-tx active 63977 15265016 0 4.63e1 238.60
dpdk-crypto-input polling 65541 15265016 0 6.16e1 232.91
dpdk-esp4-decrypt active 63967 15265016 0 1.49e2 238.64
dpdk-esp4-decrypt-post active 63977 15265016 0 5.98e1 238.60
dpdk-input polling 65541 15265016 0 5.08e1 232.91
ethernet-input active 63967 15265016 0 1.75e1 238.64
ip4-input-no-checksum active 127586 30530032 0 2.25e1 239.29
ip4-local active 63967 15265016 0 4.35e1 238.64
ip4-lookup active 127586 30530032 0 2.89e1 239.29
ip4-rewrite active 63977 15265016 0 2.74e1 238.60
ipsec4-if-input active 63967 15265016 0 2.52e1 238.64
unix-epoll-input polling 64 0 0 1.52e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 40955527 0 0 4.81e1 0.00
dpdk-input polling 40955527 0 0 1.02e2 0.00
unix-epoll-input polling 39957 0 0 9.00e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 22)
Time 3.9, average vectors/node 70.97, last 128 main loops 8.30 per node 96.64
vector rates in 7.6859e6, out 7.6859e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 214501 15265049 0 1.44e1 71.17
FortyGigabitEthernet88/0/0-tx active 214501 15265049 0 4.67e1 71.17
dpdk-crypto-input polling 235181 15265049 0 5.79e1 64.91
dpdk-esp4-encrypt-tun active 215559 15265036 0 1.99e2 70.82
dpdk-input polling 235181 15265036 0 5.52e1 64.91
ethernet-input active 215559 15265036 0 2.05e1 70.82
ip4-input-no-checksum active 215559 15265036 0 2.87e1 70.82
ip4-lookup active 430060 30530085 0 4.37e1 70.99
ip4-midchain active 215559 15265036 0 5.38e1 70.82
ip4-rewrite active 214501 15265049 0 3.09e1 71.17
unix-epoll-input polling 229 0 0 1.46e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 23)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 39800262 0 0 4.54e1 0.00
dpdk-input polling 39800262 0 0 1.02e2 0.00
unix-epoll-input polling 38830 0 0 8.99e2 0.00

40ge2p1xl710-ethip4ipsecbasetnl-ip4base-tnl-aes-gcm-ndrpdr

IPv4 IPsec tunnel mode performance test suite.

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 on TG-DUTn, Eth-IPv4-IPSec on DUT1-DUT2
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with multiple IPsec tunnels between them. DUTs get IPv4 traffic from TG, encrypt it and send to another DUT, where packets are decrypted and sent back to TG
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, number of flows per flow-group equals to number of IPSec tunnels) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. Incrementing of IP.dst (IPv4 destination address) field is applied to both streams.
  • [Ref] Applicable standard specifications: RFC4303 and RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4ipsecbasetnl-ip4base-tnl-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 51 4.44e4 0.00
dpdk-process any wait 0 0 1 2.18e4 0.00
fib-walk any wait 0 0 2 5.14e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 3 6.19e3 0.00
lisp-retry-service any wait 0 0 2 4.61e3 0.00
unix-epoll-input polling 2087 0 0 4.35e6 0.00
vpe-oam-process any wait 0 0 2 3.12e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 110.43, last 128 main loops 20.48 per node 131.10
vector rates in 6.4736e6, out 4.8551e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 75032 6424804 0 1.42e1 85.63
FortyGigabitEthernet88/0/0-tx active 75032 6424804 0 4.91e1 85.63
FortyGigabitEthernet88/0/1-out active 68998 6420817 0 1.37e1 93.06
FortyGigabitEthernet88/0/1-tx active 68998 6420817 0 5.07e1 93.06
dpdk-crypto-input polling 80660 12845621 0 6.09e1 159.26
dpdk-esp4-decrypt active 67701 6424634 0 1.53e2 94.89
dpdk-esp4-decrypt-post active 68998 6420817 0 5.97e1 93.06
dpdk-esp4-encrypt active 75317 6427617 0 2.09e2 85.34
dpdk-input polling 80660 12852251 0 5.55e1 159.34
ethernet-input active 143018 12852251 0 2.20e1 89.86
interface-output active 75032 6424804 0 1.39e1 85.63
ip4-input-no-checksum active 112925 19273068 0 3.42e1 170.67
ip4-lookup active 158976 19273238 0 3.47e1 121.23
ip4-rewrite active 158976 19273238 0 3.69e1 121.23
ipsec4-input-feature active 83533 12845451 0 5.90e1 153.78
ipsec4-output-feature active 150349 12852421 0 6.89e1 85.48
unix-epoll-input polling 78 0 0 1.46e3 0.00
64b-2t2c-ethip4ipsecbasetnl-ip4base-tnl-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 7.53e4 0.00
dpdk-process any wait 0 0 1 8.96e3 0.00
fib-walk any wait 0 0 2 7.86e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 4.33e3 0.00
lisp-retry-service any wait 0 0 2 1.72e3 0.00
unix-epoll-input polling 3081 0 0 2.95e6 0.00
vpe-oam-process any wait 0 0 2 1.09e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 42.03, last 128 main loops 0.00 per node 0.00
vector rates in 6.2714e6, out 3.1357e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 387842 12456763 0 1.93e1 32.12
FortyGigabitEthernet88/0/1-tx active 387842 12456763 0 5.05e1 32.12
dpdk-crypto-input polling 1850219 12456763 0 7.48e1 6.73
dpdk-esp4-decrypt active 250161 12456740 0 1.53e2 49.79
dpdk-esp4-decrypt-post active 387842 12456763 0 6.16e1 32.12
dpdk-input polling 1850219 12456740 0 7.31e1 6.73
ethernet-input active 250161 12456740 0 2.49e1 49.79
ip4-input-no-checksum active 456009 24913503 0 4.24e1 54.63
ip4-lookup active 387842 12456763 0 3.45e1 32.12
ip4-rewrite active 387842 12456763 0 3.92e1 32.12
ipsec4-input-feature active 456009 24913503 0 5.16e1 54.63
unix-epoll-input polling 1805 0 0 1.33e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 237.15, last 128 main loops 28.00 per node 256.00
vector rates in 6.2715e6, out 6.2715e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 52528 12456766 0 9.98e0 237.15
FortyGigabitEthernet88/0/0-tx active 52528 12456766 0 4.71e1 237.15
dpdk-crypto-input polling 52528 12456766 0 6.54e1 237.15
dpdk-esp4-encrypt active 52528 12456960 0 2.17e2 237.15
dpdk-input polling 52528 12456960 0 5.18e1 237.15
ethernet-input active 52528 12456960 0 1.53e1 237.15
interface-output active 52528 12456766 0 1.06e1 237.15
ip4-input-no-checksum active 52528 12456960 0 2.23e1 237.15
ip4-lookup active 105056 24913726 0 4.17e1 237.15
ip4-rewrite active 105056 24913726 0 3.55e1 237.15
ipsec4-output-feature active 105056 24913726 0 6.74e1 237.15
unix-epoll-input polling 51 0 0 1.54e3 0.00
64b-4t4c-ethip4ipsecbasetnl-ip4base-tnl-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 51 6.37e4 0.00
dpdk-process any wait 0 0 2 4.88e5 0.00
fib-walk any wait 0 0 2 6.73e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 4.73e3 0.00
lisp-retry-service any wait 0 0 2 3.36e3 0.00
unix-epoll-input polling 3916 0 0 2.31e6 0.00
vpe-oam-process any wait 0 0 2 7.72e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 47.74, last 128 main loops 0.00 per node 0.00
vector rates in 6.4104e6, out 3.2052e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 374623 12666155 0 1.88e1 33.81
FortyGigabitEthernet88/0/1-tx active 374623 12666155 0 5.07e1 33.81
dpdk-crypto-input polling 1533920 12666155 0 7.84e1 8.26
dpdk-esp4-decrypt active 173747 12666109 0 1.47e2 72.89
dpdk-esp4-decrypt-post active 374623 12666155 0 6.33e1 33.81
dpdk-input polling 1533920 12666109 0 6.65e1 8.26
ethernet-input active 173747 12666109 0 2.16e1 72.89
ip4-input-no-checksum active 403714 25332264 0 4.13e1 62.75
ip4-lookup active 374623 12666155 0 3.35e1 33.81
ip4-rewrite active 374623 12666155 0 3.79e1 33.81
ipsec4-input-feature active 403714 25332264 0 5.24e1 62.75
unix-epoll-input polling 1497 0 0 1.32e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 40516372 0 0 4.77e1 0.00
dpdk-input polling 40516372 0 0 1.04e2 0.00
unix-epoll-input polling 39528 0 0 9.05e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 22)
Time 3.9, average vectors/node 232.96, last 128 main loops 28.00 per node 256.00
vector rates in 6.4102e6, out 6.4102e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 54370 12665856 0 1.01e1 232.96
FortyGigabitEthernet88/0/0-tx active 54370 12665856 0 4.63e1 232.96
dpdk-crypto-input polling 54370 12665856 0 6.55e1 232.96
dpdk-esp4-encrypt active 54370 12665880 0 2.15e2 232.96
dpdk-input polling 54370 12665880 0 5.14e1 232.96
ethernet-input active 54370 12665880 0 1.54e1 232.96
interface-output active 54370 12665856 0 1.07e1 232.96
ip4-input-no-checksum active 54370 12665880 0 2.16e1 232.96
ip4-lookup active 108740 25331736 0 3.45e1 232.96
ip4-rewrite active 108740 25331736 0 3.65e1 232.96
ipsec4-output-feature active 108740 25331736 0 6.76e1 232.96
unix-epoll-input polling 53 0 0 1.52e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 23)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 40194699 0 0 4.79e1 0.00
dpdk-input polling 40194699 0 0 1.05e2 0.00
unix-epoll-input polling 39214 0 0 8.99e2 0.00

40ge2p1xl710-ethip4ipsecbasetnl-ip4base-tnl-cbc-sha1-ndrpdr

IPv4 IPsec tunnel mode performance test suite.

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 on TG-DUTn, Eth-IPv4-IPSec on DUT1-DUT2
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with multiple IPsec tunnels between them. DUTs get IPv4 traffic from TG, encrypt it and send to another DUT, where packets are decrypted and sent back to TG
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. TG traffic profile contains two L3 flow-groups (flow-group per direction, number of flows per flow-group equals to number of IPSec tunnels) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. Incrementing of IP.dst (IPv4 destination address) field is applied to both streams.
  • [Ref] Applicable standard specifications: RFC4303 and RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4ipsecbasetnl-ip4base-tnl-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 50 3.91e4 0.00
dpdk-process any wait 0 0 1 9.36e5 0.00
fib-walk any wait 0 0 2 5.18e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 4.30e3 0.00
lisp-retry-service any wait 0 0 2 3.75e3 0.00
unix-epoll-input polling 3083 0 0 2.94e6 0.00
vpe-oam-process any wait 0 0 2 1.26e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 110.45, last 128 main loops 2.05 per node 21.92
vector rates in 6.4856e6, out 4.8639e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 71974 6422797 0 1.42e1 89.24
FortyGigabitEthernet88/0/0-tx active 71974 6422797 0 4.95e1 89.24
FortyGigabitEthernet88/0/1-out active 67824 6422556 0 1.39e1 94.69
FortyGigabitEthernet88/0/1-tx active 67824 6422556 0 5.11e1 94.69
dpdk-crypto-input polling 88311 12845353 0 6.15e1 145.46
dpdk-esp4-decrypt active 71395 6423969 0 1.49e2 89.98
dpdk-esp4-decrypt-post active 67824 6422556 0 6.16e1 94.69
dpdk-esp4-encrypt active 72732 6423732 0 2.04e2 88.32
dpdk-input polling 88311 12847701 0 5.60e1 145.48
ethernet-input active 144127 12847701 0 2.21e1 89.14
interface-output active 71974 6422797 0 1.39e1 89.24
ip4-input-no-checksum active 115331 19270257 0 3.45e1 167.09
ip4-lookup active 159836 19269085 0 3.44e1 120.56
ip4-rewrite active 159836 19269085 0 3.79e1 120.56
ipsec4-input-feature active 88258 12846525 0 5.92e1 145.56
ipsec4-output-feature active 144706 12846529 0 6.73e1 88.78
unix-epoll-input polling 86 0 0 1.46e3 0.00
64b-2t2c-ethip4ipsecbasetnl-ip4base-tnl-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 51 6.06e4 0.00
dpdk-process any wait 0 0 2 4.87e5 0.00
fib-walk any wait 0 0 2 3.63e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.67e3 0.00
lisp-retry-service any wait 0 0 2 2.72e3 0.00
unix-epoll-input polling 4233 0 0 2.14e6 0.00
vpe-oam-process any wait 0 0 2 7.72e2 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 35.70, last 128 main loops 0.00 per node 0.00
vector rates in 6.2864e6, out 3.1432e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 434395 12453146 0 2.06e1 28.67
FortyGigabitEthernet88/0/1-tx active 434395 12453146 0 5.08e1 28.67
dpdk-crypto-input polling 1931365 12453146 0 7.46e1 6.45
dpdk-esp4-decrypt active 332269 12453172 0 1.39e2 37.48
dpdk-esp4-decrypt-post active 434395 12453146 0 5.99e1 28.67
dpdk-input polling 1931365 12453172 0 7.71e1 6.45
ethernet-input active 332269 12453172 0 2.72e1 37.48
ip4-input-no-checksum active 542971 24906318 0 4.38e1 45.87
ip4-lookup active 434395 12453146 0 3.53e1 28.67
ip4-rewrite active 434395 12453146 0 4.15e1 28.67
ipsec4-input-feature active 542971 24906318 0 5.16e1 45.87
unix-epoll-input polling 1884 0 0 1.29e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 216.80, last 128 main loops 26.52 per node 242.50
vector rates in 6.2864e6, out 6.2864e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 57440 12453200 0 1.04e1 216.80
FortyGigabitEthernet88/0/0-tx active 57440 12453200 0 4.77e1 216.80
dpdk-crypto-input polling 57440 12453200 0 6.49e1 216.80
dpdk-esp4-encrypt active 57440 12453304 0 2.13e2 216.81
dpdk-input polling 57440 12453304 0 5.22e1 216.81
ethernet-input active 57440 12453304 0 1.62e1 216.81
interface-output active 57440 12453200 0 1.09e1 216.80
ip4-input-no-checksum active 57440 12453304 0 2.27e1 216.81
ip4-lookup active 114880 24906504 0 4.19e1 216.80
ip4-rewrite active 114880 24906504 0 3.62e1 216.80
ipsec4-output-feature active 114880 24906504 0 6.65e1 216.80
unix-epoll-input polling 56 0 0 1.57e3 0.00
64b-4t4c-ethip4ipsecbasetnl-ip4base-tnl-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 5.04e4 0.00
dpdk-process any wait 0 0 1 9.72e5 0.00
fib-walk any wait 0 0 2 2.66e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.36e3 0.00
lisp-retry-service any wait 0 0 2 2.18e3 0.00
unix-epoll-input polling 3195 0 0 2.83e6 0.00
vpe-oam-process any wait 0 0 2 6.06e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 50.66, last 128 main loops 1.44 per node 23.00
vector rates in 6.4509e6, out 3.2255e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 343752 12772383 0 1.78e1 37.16
FortyGigabitEthernet88/0/1-tx active 343752 12772383 0 4.97e1 37.16
dpdk-crypto-input polling 2458748 12772383 0 7.61e1 5.19
dpdk-esp4-decrypt active 143756 12772416 0 1.39e2 88.85
dpdk-esp4-decrypt-post active 343752 12772383 0 6.28e1 37.16
dpdk-input polling 2458748 12772416 0 7.26e1 5.19
ethernet-input active 143756 12772416 0 2.03e1 88.85
ip4-input-no-checksum active 429336 25544799 0 4.13e1 59.49
ip4-lookup active 343752 12772383 0 3.24e1 37.16
ip4-rewrite active 343752 12772383 0 3.62e1 37.16
ipsec4-input-feature active 429336 25544799 0 5.27e1 59.49
unix-epoll-input polling 2399 0 0 1.35e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 40897688 0 0 4.68e1 0.00
dpdk-input polling 40897688 0 0 1.02e2 0.00
unix-epoll-input polling 39900 0 0 9.05e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 22)
Time 3.9, average vectors/node 194.72, last 128 main loops 24.50 per node 224.00
vector rates in 6.4509e6, out 6.4509e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 65592 12772472 0 1.05e1 194.73
FortyGigabitEthernet88/0/0-tx active 65592 12772472 0 4.67e1 194.73
dpdk-crypto-input polling 65592 12772472 0 6.42e1 194.73
dpdk-esp4-encrypt active 65592 12772275 0 2.09e2 194.72
dpdk-input polling 65592 12772275 0 5.16e1 194.72
ethernet-input active 65592 12772275 0 1.64e1 194.72
interface-output active 65592 12772472 0 1.07e1 194.73
ip4-input-no-checksum active 65592 12772275 0 2.25e1 194.72
ip4-lookup active 131184 25544747 0 3.51e1 194.72
ip4-rewrite active 131184 25544747 0 3.66e1 194.72
ipsec4-output-feature active 131184 25544747 0 6.69e1 194.72
unix-epoll-input polling 64 0 0 1.48e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 23)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 40341323 0 0 4.77e1 0.00
dpdk-input polling 40341323 0 0 1.05e2 0.00
unix-epoll-input polling 39357 0 0 9.01e2 0.00

40ge2p1xl710-ethip4ipsecbasetnlsw-ip4base-int-aes-gcm-ndrpdr

RFC2544: Pkt throughput IPv4 IPsec tunnel mode.

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 on TG-DUTn, Eth-IPv4-IPSec on DUT1-DUT2
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with DPDK SW crypto devices and multiple IPsec tunnels between them. DUTs get IPv4 traffic from TG, encrypt it and send to another DUT, where packets are decrypted and sent back to TG
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, number of flows per flow-group equals to number of IPSec tunnels) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. Incrementing of IP.dst (IPv4 destination address) field is applied to both streams.
  • [Ref] Applicable standard specifications: RFC4303 and RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4ipsecbasetnlsw-ip4base-int-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 49 6.05e4 0.00
dpdk-process any wait 0 0 1 1.44e4 0.00
fib-walk any wait 0 0 2 2.61e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 3.84e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 2.14e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 6.39e3 0.00
lisp-retry-service any wait 0 0 2 2.95e3 0.00
statseg-collector-process time wait 0 0 1 1.13e4 0.00
unix-epoll-input polling 4553 0 0 1.97e6 0.00
vpe-oam-process any wait 0 0 2 1.25e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 148.15, last 128 main loops 25.74 per node 156.90
vector rates in 5.9182e6, out 4.4001e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 43985 5785528 0 1.24e1 131.53
FortyGigabitEthernet88/0/0-tx active 43985 5785528 0 4.74e1 131.53
FortyGigabitEthernet88/0/1-out active 43981 5474754 0 1.16e1 124.48
FortyGigabitEthernet88/0/1-tx active 43981 5474754 0 5.01e1 124.48
dpdk-crypto-input polling 43986 11260282 0 3.07e2 255.99
dpdk-esp4-decrypt active 43955 5953188 0 7.64e1 135.44
dpdk-esp4-decrypt-post active 43981 5474754 0 5.82e1 124.48
dpdk-esp4-encrypt-tun active 43986 5994678 0 1.42e2 136.29
dpdk-input polling 43986 11947866 0 5.43e1 271.63
ethernet-input active 87941 11947866 0 1.94e1 135.86
ip4-input-no-checksum active 88594 17422620 0 2.31e1 196.66
ip4-local active 43955 5953188 0 5.28e1 135.44
ip4-lookup active 132579 23208148 0 3.53e1 175.05
ip4-midchain active 43986 5994678 0 4.93e1 136.29
ip4-rewrite active 87966 11260282 0 2.79e1 128.01
ipsec4-if-input active 43955 5953188 0 2.92e1 135.44
unix-epoll-input polling 43 0 0 1.52e3 0.00
64b-2t2c-ethip4ipsecbasetnlsw-ip4base-int-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 50 2.82e4 0.00
dpdk-process any wait 0 0 1 2.26e4 0.00
fib-walk any wait 0 0 2 2.37e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 2.11e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 3.75e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 2.49e3 0.00
lisp-retry-service any wait 0 0 2 7.12e3 0.00
statseg-collector-process time wait 0 0 1 4.03e3 0.00
unix-epoll-input polling 4766 0 0 1.89e6 0.00
vpe-oam-process any wait 0 0 2 1.31e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 75.14, last 128 main loops 3.55 per node 37.92
vector rates in 6.3382e6, out 3.1691e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 202224 12521580 0 1.45e1 61.92
FortyGigabitEthernet88/0/1-tx active 202224 12521580 0 4.34e1 61.92
dpdk-crypto-input polling 246030 12521580 0 2.47e2 50.89
dpdk-esp4-decrypt active 202224 12521608 0 7.02e1 61.92
dpdk-esp4-decrypt-post active 202224 12521580 0 4.55e1 61.92
dpdk-input polling 246030 12521608 0 5.53e1 50.89
ethernet-input active 202224 12521608 0 2.13e1 61.92
ip4-input-no-checksum active 208766 25043188 0 2.36e1 119.96
ip4-local active 202224 12521608 0 4.81e1 61.92
ip4-lookup active 208766 25043188 0 3.30e1 119.96
ip4-rewrite active 202224 12521580 0 3.04e1 61.92
ipsec4-if-input active 202224 12521608 0 3.19e1 61.92
unix-epoll-input polling 240 0 0 1.37e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 83.03, last 128 main loops 9.11 per node 106.00
vector rates in 6.3382e6, out 6.3382e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 150804 12521639 0 1.31e1 83.03
FortyGigabitEthernet88/0/0-tx active 150804 12521639 0 4.23e1 83.03
dpdk-crypto-input polling 150906 12521639 0 2.66e2 82.98
dpdk-esp4-encrypt-tun active 150804 12521716 0 1.28e2 83.03
dpdk-input polling 150906 12521716 0 5.22e1 82.98
ethernet-input active 150804 12521716 0 1.95e1 83.03
ip4-input-no-checksum active 150804 12521716 0 2.72e1 83.03
ip4-lookup active 301608 25043355 0 4.76e1 83.03
ip4-midchain active 150804 12521716 0 4.96e1 83.03
ip4-rewrite active 150804 12521639 0 2.84e1 83.03
unix-epoll-input polling 147 0 0 1.44e3 0.00
64b-4t4c-ethip4ipsecbasetnlsw-ip4base-int-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 6.17e4 0.00
dpdk-process any wait 0 0 1 9.42e3 0.00
fib-walk any wait 0 0 2 1.35e4 0.00
ip4-reassembly-expire-walk any wait 0 0 1 3.07e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 4.27e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 3.08e3 0.00
lisp-retry-service any wait 0 0 2 6.53e3 0.00
statseg-collector-process time wait 0 0 1 1.57e4 0.00
unix-epoll-input polling 3336 0 0 2.72e6 0.00
vpe-oam-process any wait 0 0 2 5.68e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 229.82, last 128 main loops 14.05 per node 128.50
vector rates in 6.6356e6, out 3.3178e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 57369 13178529 0 1.03e1 229.72
FortyGigabitEthernet88/0/1-tx active 57369 13178529 0 4.53e1 229.72
dpdk-crypto-input polling 59350 13178529 0 2.46e2 222.05
dpdk-esp4-decrypt active 57369 13178436 0 7.62e1 229.71
dpdk-esp4-decrypt-post active 57369 13178529 0 5.15e1 229.72
dpdk-input polling 59350 13178436 0 5.00e1 222.05
ethernet-input active 57369 13178436 0 1.76e1 229.71
ip4-input-no-checksum active 114587 26356965 0 2.09e1 230.02
ip4-local active 57369 13178436 0 4.27e1 229.71
ip4-lookup active 114587 26356965 0 2.92e1 230.02
ip4-rewrite active 57369 13178529 0 2.48e1 229.72
ipsec4-if-input active 57369 13178436 0 2.51e1 229.71
unix-epoll-input polling 57 0 0 1.40e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 39666815 0 0 4.77e1 0.00
dpdk-input polling 39666815 0 0 1.04e2 0.00
unix-epoll-input polling 38700 0 0 9.02e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 22)
Time 3.9, average vectors/node 132.99, last 128 main loops 13.25 per node 154.18
vector rates in 6.6355e6, out 6.6355e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 99094 13178352 0 1.16e1 132.99
FortyGigabitEthernet88/0/0-tx active 99094 13178352 0 4.25e1 132.99
dpdk-crypto-input polling 99094 13178352 0 2.66e2 132.99
dpdk-esp4-encrypt-tun active 99094 13178372 0 1.30e2 132.99
dpdk-input polling 99094 13178372 0 5.01e1 132.99
ethernet-input active 99094 13178372 0 1.72e1 132.99
ip4-input-no-checksum active 99094 13178372 0 2.46e1 132.99
ip4-lookup active 198188 26356724 0 3.57e1 132.99
ip4-midchain active 99094 13178372 0 4.87e1 132.99
ip4-rewrite active 99094 13178352 0 2.70e1 132.99
unix-epoll-input polling 96 0 0 1.53e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 23)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 40384441 0 0 4.41e1 0.00
dpdk-input polling 40384441 0 0 1.03e2 0.00
unix-epoll-input polling 39400 0 0 8.96e2 0.00

40ge2p1xl710-ethip4ipsecbasetnlsw-ip4base-int-cbc-sha1-ndrpdr

RFC2544: Pkt throughput IPv4 IPsec tunnel mode.

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 on TG-DUTn, Eth-IPv4-IPSec on DUT1-DUT2
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with DPDK SW crypto devices and multiple IPsec tunnels between them. DUTs get IPv4 traffic from TG, encrypt it and send to another DUT, where packets are decrypted and sent back to TG
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, number of flows per flow-group equals to number of IPSec tunnels) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. Incrementing of IP.dst (IPv4 destination address) field is applied to both streams.
  • [Ref] Applicable standard specifications: RFC4303 and RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4ipsecbasetnlsw-ip4base-int-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 6.23e4 0.00
dpdk-process any wait 0 0 1 2.08e4 0.00
fib-walk any wait 0 0 2 1.84e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 4.04e3 0.00
lisp-retry-service any wait 0 0 2 7.17e3 0.00
unix-epoll-input polling 3476 0 0 2.59e6 0.00
vpe-oam-process any wait 0 0 2 1.15e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 144.63, last 128 main loops 35.78 per node 199.13
vector rates in 3.8279e6, out 2.8701e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 29519 3785595 0 1.27e1 128.24
FortyGigabitEthernet88/0/0-tx active 29519 3785595 0 4.98e1 128.24
FortyGigabitEthernet88/0/1-out active 29513 3771339 0 1.18e1 127.79
FortyGigabitEthernet88/0/1-tx active 29513 3771339 0 4.89e1 127.79
dpdk-crypto-input polling 29520 7556934 0 7.25e2 255.99
dpdk-esp4-decrypt active 29128 3785466 0 7.12e1 129.96
dpdk-esp4-decrypt-post active 29513 3771339 0 5.99e1 127.79
dpdk-esp4-encrypt-tun active 29519 3786469 0 1.36e2 128.27
dpdk-input polling 29520 7571935 0 5.62e1 256.50
ethernet-input active 58647 7571935 0 2.04e1 129.11
ip4-input-no-checksum active 59006 11343274 0 2.43e1 192.24
ip4-local active 29128 3785466 0 4.74e1 129.96
ip4-lookup active 88525 15128869 0 3.49e1 170.89
ip4-midchain active 29519 3786469 0 5.07e1 128.27
ip4-rewrite active 59032 7556934 0 2.92e1 128.01
ipsec4-if-input active 29128 3785466 0 2.99e1 129.96
unix-epoll-input polling 28 0 0 1.62e3 0.00
64b-2t2c-ethip4ipsecbasetnlsw-ip4base-int-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 7.04e4 0.00
dpdk-process any wait 0 0 1 1.48e4 0.00
fib-walk any wait 0 0 2 4.49e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 4.39e3 0.00
lisp-retry-service any wait 0 0 2 3.06e3 0.00
unix-epoll-input polling 3290 0 0 2.77e6 0.00
vpe-oam-process any wait 0 0 1 1.34e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 134.29, last 128 main loops 6.84 per node 72.92
vector rates in 3.9782e6, out 1.9891e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 69565 7921271 0 1.28e1 113.87
FortyGigabitEthernet88/0/1-tx active 69565 7921271 0 4.58e1 113.87
dpdk-crypto-input polling 72170 7921271 0 6.72e2 109.76
dpdk-esp4-decrypt active 69503 7921215 0 7.07e1 113.97
dpdk-esp4-decrypt-post active 69565 7921271 0 5.29e1 113.87
dpdk-input polling 72170 7921215 0 5.30e1 109.76
ethernet-input active 69503 7921215 0 2.07e1 113.97
ip4-input-no-checksum active 81046 15842486 0 2.38e1 195.48
ip4-local active 69503 7921215 0 5.09e1 113.97
ip4-lookup active 81046 15842486 0 3.23e1 195.48
ip4-rewrite active 69565 7921271 0 2.99e1 113.87
ipsec4-if-input active 69503 7921215 0 2.91e1 113.97
unix-epoll-input polling 71 0 0 1.49e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 152.32, last 128 main loops 16.16 per node 188.00
vector rates in 3.9783e6, out 3.9783e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 52005 7921408 0 1.12e1 152.32
FortyGigabitEthernet88/0/0-tx active 52005 7921408 0 4.65e1 152.32
dpdk-crypto-input polling 52005 7921408 0 7.01e2 152.32
dpdk-esp4-encrypt-tun active 52005 7921396 0 1.28e2 152.32
dpdk-input polling 52005 7921396 0 5.34e1 152.32
ethernet-input active 52005 7921396 0 1.78e1 152.32
ip4-input-no-checksum active 52005 7921396 0 2.38e1 152.32
ip4-lookup active 104010 15842804 0 4.71e1 152.32
ip4-midchain active 52005 7921396 0 4.68e1 152.32
ip4-rewrite active 52005 7921408 0 2.73e1 152.32
unix-epoll-input polling 50 0 0 1.48e3 0.00
64b-4t4c-ethip4ipsecbasetnlsw-ip4base-int-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 1.04e5 0.00
dpdk-process any wait 0 0 1 1.89e4 0.00
fib-walk any wait 0 0 2 1.18e4 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.21e3 0.00
lisp-retry-service any wait 0 0 2 2.20e3 0.00
unix-epoll-input polling 3326 0 0 2.72e6 0.00
vpe-oam-process any wait 0 0 2 1.07e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 227.96, last 128 main loops 24.72 per node 226.00
vector rates in 4.0728e6, out 2.0364e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 35526 8067840 0 1.06e1 227.09
FortyGigabitEthernet88/0/1-tx active 35526 8067840 0 4.63e1 227.09
dpdk-crypto-input polling 35972 8067840 0 6.66e2 224.28
dpdk-esp4-decrypt active 35515 8067840 0 7.30e1 227.17
dpdk-esp4-decrypt-post active 35526 8067840 0 5.54e1 227.09
dpdk-input polling 35972 8067840 0 5.09e1 224.28
ethernet-input active 35515 8067840 0 1.83e1 227.17
ip4-input-no-checksum active 70334 16135680 0 2.26e1 229.42
ip4-local active 35515 8067840 0 4.31e1 227.17
ip4-lookup active 70334 16135680 0 3.10e1 229.42
ip4-rewrite active 35526 8067840 0 2.79e1 227.09
ipsec4-if-input active 35515 8067840 0 2.56e1 227.17
unix-epoll-input polling 35 0 0 1.78e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 40361381 0 0 4.63e1 0.00
dpdk-input polling 40361381 0 0 1.03e2 0.00
unix-epoll-input polling 39377 0 0 9.00e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 22)
Time 3.9, average vectors/node 256.00, last 128 main loops 22.00 per node 256.00
vector rates in 4.0628e6, out 4.0628e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 31438 8048128 0 9.69e0 256.00
FortyGigabitEthernet88/0/0-tx active 31438 8048128 0 4.58e1 256.00
dpdk-crypto-input polling 31438 8048128 0 7.12e2 256.00
dpdk-esp4-encrypt-tun active 31438 8048128 0 1.29e2 256.00
dpdk-input polling 31438 8048128 0 5.19e1 256.00
ethernet-input active 31438 8048128 0 1.53e1 256.00
ip4-input-no-checksum active 31438 8048128 0 2.05e1 256.00
ip4-lookup active 62876 16096256 0 3.59e1 256.00
ip4-midchain active 31438 8048128 0 4.52e1 256.00
ip4-rewrite active 31438 8048128 0 2.50e1 256.00
unix-epoll-input polling 30 0 0 1.51e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 23)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 38262776 0 0 4.98e1 0.00
dpdk-input polling 38262776 0 0 1.14e2 0.00
unix-epoll-input polling 37329 0 0 9.01e2 0.00

40ge2p1xl710-ethip4ipsecbasetnlsw-ip4base-tnl-aes-gcm-ndrpdr

IPv4 IPsec tunnel mode performance test suite.

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 on TG-DUTn, Eth-IPv4-IPSec on DUT1-DUT2
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with DPDK SW crypto devices and multiple IPsec tunnels between them. DUTs get IPv4 traffic from TG, encrypt it and send to another DUT, where packets are decrypted and sent back to TG.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, number of flows per flow-group equals to number of IPSec tunnels) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. Incrementing of IP.dst (IPv4 destination address) field is applied to both streams.
  • [Ref] Applicable standard specifications: RFC4303 and RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4ipsecbasetnlsw-ip4base-tnl-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 49 3.52e4 0.00
dpdk-process any wait 0 0 1 2.47e4 0.00
fib-walk any wait 0 0 2 2.06e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 4.08e3 0.00
lisp-retry-service any wait 0 0 2 2.19e3 0.00
unix-epoll-input polling 3439 0 0 2.63e6 0.00
vpe-oam-process any wait 0 0 2 6.29e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 68.40, last 128 main loops 0.00 per node 0.00
vector rates in 5.2726e6, out 3.9805e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 107831 5279210 0 1.65e1 48.96
FortyGigabitEthernet88/0/0-tx active 107831 5279210 0 4.98e1 48.96
FortyGigabitEthernet88/0/1-out active 71647 5067525 0 1.55e1 70.73
FortyGigabitEthernet88/0/1-tx active 71647 5067525 0 5.01e1 70.73
dpdk-crypto-input polling 413186 10346735 0 2.77e2 25.04
dpdk-esp4-decrypt active 71638 5105626 0 7.74e1 71.27
dpdk-esp4-decrypt-post active 71647 5067525 0 5.15e1 70.73
dpdk-esp4-encrypt active 107825 5381299 0 1.37e2 49.91
dpdk-input polling 413186 10486925 0 6.33e1 25.38
ethernet-input active 179463 10486925 0 2.39e1 58.44
interface-output active 107831 5279210 0 1.60e1 48.96
ip4-input-no-checksum active 134597 15554450 0 3.67e1 115.56
ip4-lookup active 229382 15728034 0 3.39e1 68.57
ip4-rewrite active 229382 15728034 0 3.91e1 68.57
ipsec4-input-feature active 103238 10173151 0 5.89e1 98.54
ipsec4-output-feature active 215656 10660509 0 7.09e1 49.43
unix-epoll-input polling 403 0 0 1.36e3 0.00
64b-2t2c-ethip4ipsecbasetnlsw-ip4base-tnl-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 49 5.89e4 0.00
dpdk-process any wait 0 0 1 2.62e4 0.00
fib-walk any wait 0 0 2 3.04e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 1.74e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 3 1.32e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 2.78e3 0.00
lisp-retry-service any wait 0 0 2 6.92e3 0.00
statseg-collector-process time wait 0 0 1 5.32e3 0.00
unix-epoll-input polling 2565 0 0 3.52e6 0.00
vpe-oam-process any wait 0 0 2 1.49e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 54.95, last 128 main loops 0.00 per node 0.00
vector rates in 5.3361e6, out 2.6680e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 224349 10538431 0 1.56e1 46.97
FortyGigabitEthernet88/0/1-tx active 224349 10538431 0 4.47e1 46.97
dpdk-crypto-input polling 4863222 10538431 0 2.77e2 2.17
dpdk-esp4-decrypt active 224350 10538515 0 6.65e1 46.97
dpdk-esp4-decrypt-post active 224349 10538431 0 4.65e1 46.97
dpdk-input polling 4863222 10538515 0 1.03e2 2.17
ethernet-input active 224350 10538515 0 2.36e1 46.97
ip4-input-no-checksum active 285782 21076946 0 3.88e1 73.75
ip4-lookup active 224349 10538431 0 3.02e1 46.97
ip4-rewrite active 224349 10538431 0 3.18e1 46.97
ipsec4-input-feature active 285782 21076946 0 5.38e1 73.75
unix-epoll-input polling 4745 0 0 1.33e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 199.05, last 128 main loops 24.28 per node 222.00
vector rates in 5.3361e6, out 5.3361e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 52944 10538510 0 1.07e1 199.05
FortyGigabitEthernet88/0/0-tx active 52944 10538510 0 4.63e1 199.05
dpdk-crypto-input polling 52944 10538510 0 2.66e2 199.05
dpdk-esp4-encrypt active 52944 10538508 0 1.39e2 199.05
dpdk-input polling 52944 10538508 0 5.08e1 199.05
ethernet-input active 52944 10538508 0 1.63e1 199.05
interface-output active 52944 10538510 0 1.09e1 199.05
ip4-input-no-checksum active 52944 10538508 0 2.32e1 199.05
ip4-lookup active 105888 21077018 0 4.06e1 199.05
ip4-rewrite active 105888 21077018 0 3.61e1 199.05
ipsec4-output-feature active 105888 21077018 0 7.05e1 199.05
unix-epoll-input polling 51 0 0 1.93e3 0.00
64b-4t4c-ethip4ipsecbasetnlsw-ip4base-tnl-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 51 6.91e4 0.00
dpdk-process any wait 0 0 1 3.00e4 0.00
fib-walk any wait 0 0 2 1.56e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 6.02e3 0.00
lisp-retry-service any wait 0 0 2 8.03e3 0.00
unix-epoll-input polling 3358 0 0 2.68e6 0.00
vpe-oam-process any wait 0 0 2 5.95e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 75.14, last 128 main loops 0.00 per node 0.00
vector rates in 5.5207e6, out 2.7603e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 166635 10880956 0 1.36e1 65.29
FortyGigabitEthernet88/0/1-tx active 166635 10880956 0 4.35e1 65.29
dpdk-crypto-input polling 4620062 10880956 0 2.71e2 2.36
dpdk-esp4-decrypt active 166635 10880988 0 6.65e1 65.29
dpdk-esp4-decrypt-post active 166635 10880956 0 4.64e1 65.29
dpdk-input polling 4620062 10880988 0 9.67e1 2.36
ethernet-input active 166635 10880988 0 2.13e1 65.29
ip4-input-no-checksum active 224163 21761944 0 3.65e1 97.08
ip4-lookup active 166635 10880956 0 2.84e1 65.29
ip4-rewrite active 166635 10880956 0 2.93e1 65.29
ipsec4-input-feature active 224163 21761944 0 5.39e1 97.08
unix-epoll-input polling 4507 0 0 1.33e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 40559462 0 0 4.79e1 0.00
dpdk-input polling 40559462 0 0 1.03e2 0.00
unix-epoll-input polling 39570 0 0 8.99e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 22)
Time 3.9, average vectors/node 173.24, last 128 main loops 22.31 per node 204.00
vector rates in 5.5207e6, out 5.5207e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 62810 10881032 0 1.08e1 173.24
FortyGigabitEthernet88/0/0-tx active 62810 10881032 0 4.50e1 173.24
dpdk-crypto-input polling 62810 10881032 0 2.67e2 173.24
dpdk-esp4-encrypt active 62810 10881032 0 1.37e2 173.24
dpdk-input polling 62810 10881032 0 5.04e1 173.24
ethernet-input active 62810 10881032 0 1.66e1 173.24
interface-output active 62810 10881032 0 1.09e1 173.24
ip4-input-no-checksum active 62810 10881032 0 2.34e1 173.24
ip4-lookup active 125620 21762064 0 3.05e1 173.24
ip4-rewrite active 125620 21762064 0 3.63e1 173.24
ipsec4-output-feature active 125620 21762064 0 6.71e1 173.24
unix-epoll-input polling 62 0 0 1.45e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 23)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 40625973 0 0 4.73e1 0.00
dpdk-input polling 40625973 0 0 1.03e2 0.00
unix-epoll-input polling 39635 0 0 8.97e2 0.00

40ge2p1xl710-ethip4ipsecbasetnlsw-ip4base-tnl-cbc-sha1-ndrpdr

IPv4 IPsec tunnel mode performance test suite.

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 on TG-DUTn, Eth-IPv4-IPSec on DUT1-DUT2
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with DPDK SW crypto devices and multiple IPsec tunnels between them. DUTs get IPv4 traffic from TG, encrypt it and send to another DUT, where packets are decrypted and sent back to TG.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, number of flows per flow-group equals to number of IPSec tunnels) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. Incrementing of IP.dst (IPv4 destination address) field is applied to both streams.
  • [Ref] Applicable standard specifications: RFC4303 and RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4ipsecbasetnlsw-ip4base-tnl-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 51 1.24e5 0.00
dpdk-process any wait 0 0 1 2.26e4 0.00
fib-walk any wait 0 0 2 2.55e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 6.23e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 2.38e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 4.13e3 0.00
lisp-retry-service any wait 0 0 2 9.17e3 0.00
statseg-collector-process time wait 0 0 1 7.63e3 0.00
unix-epoll-input polling 3351 0 0 2.72e6 0.00
vpe-oam-process any wait 0 0 2 1.89e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 147.49, last 128 main loops 24.88 per node 132.67
vector rates in 3.5711e6, out 2.6709e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 27548 3492477 0 1.31e1 126.78
FortyGigabitEthernet88/0/0-tx active 27548 3492477 0 4.83e1 126.78
FortyGigabitEthernet88/0/1-out active 27552 3560835 0 1.24e1 129.24
FortyGigabitEthernet88/0/1-tx active 27552 3560835 0 4.98e1 129.24
dpdk-crypto-input polling 27552 7053312 0 7.29e2 256.00
dpdk-esp4-decrypt active 27505 3586119 0 7.67e1 130.38
dpdk-esp4-decrypt-post active 27552 3560835 0 6.05e1 129.24
dpdk-esp4-encrypt active 27539 3586318 0 1.30e2 130.23
dpdk-input polling 27552 7172437 0 5.55e1 260.32
ethernet-input active 55044 7172437 0 2.04e1 130.30
interface-output active 27548 3492477 0 1.33e1 126.78
ip4-input-no-checksum active 55766 10733272 0 3.28e1 192.47
ip4-lookup active 68497 10639630 0 3.22e1 155.33
ip4-rewrite active 68497 10639630 0 3.68e1 155.33
ipsec4-input-feature active 41485 7146954 0 5.98e1 172.28
ipsec4-output-feature active 55087 7078795 0 6.73e1 128.50
unix-epoll-input polling 27 0 0 1.65e3 0.00
64b-2t2c-ethip4ipsecbasetnlsw-ip4base-tnl-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 1.18e5 0.00
dpdk-process any wait 0 0 1 1.19e4 0.00
fib-walk any wait 0 0 2 3.17e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.98e3 0.00
lisp-retry-service any wait 0 0 2 9.37e3 0.00
unix-epoll-input polling 2329 0 0 3.88e6 0.00
vpe-oam-process any wait 0 0 2 2.82e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 31.93, last 128 main loops 3.95 per node 46.00
vector rates in 3.5406e6, out 1.7703e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 307477 6995250 0 2.15e1 22.75
FortyGigabitEthernet88/0/1-tx active 307477 6995250 0 5.13e1 22.75
dpdk-crypto-input polling 1054453 6995250 0 7.21e2 6.63
dpdk-esp4-decrypt active 162884 6995248 0 6.76e1 42.95
dpdk-esp4-decrypt-post active 307477 6995250 0 5.66e1 22.75
dpdk-input polling 1054453 6995248 0 7.49e1 6.63
ethernet-input active 162884 6995248 0 2.54e1 42.95
ip4-input-no-checksum active 317701 13990498 0 4.23e1 44.04
ip4-lookup active 307477 6995250 0 3.53e1 22.75
ip4-rewrite active 307477 6995250 0 3.97e1 22.75
ipsec4-input-feature active 317701 13990498 0 5.25e1 44.04
unix-epoll-input polling 1029 0 0 1.38e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 235.58, last 128 main loops 28.00 per node 256.00
vector rates in 3.5407e6, out 3.5407e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 29695 6995456 0 1.01e1 235.58
FortyGigabitEthernet88/0/0-tx active 29695 6995456 0 4.73e1 235.58
dpdk-crypto-input polling 29695 6995456 0 7.00e2 235.58
dpdk-esp4-encrypt active 29695 6995456 0 1.37e2 235.58
dpdk-input polling 29695 6995456 0 5.25e1 235.58
ethernet-input active 29695 6995456 0 1.54e1 235.58
interface-output active 29695 6995456 0 1.08e1 235.58
ip4-input-no-checksum active 29695 6995456 0 2.19e1 235.58
ip4-lookup active 59390 13990912 0 4.37e1 235.58
ip4-rewrite active 59390 13990912 0 3.57e1 235.58
ipsec4-output-feature active 59390 13990912 0 6.96e1 235.58
unix-epoll-input polling 29 0 0 1.65e3 0.00
64b-4t4c-ethip4ipsecbasetnlsw-ip4base-tnl-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 7.93e4 0.00
dpdk-process any wait 0 0 1 1.57e4 0.00
fib-walk any wait 0 0 2 3.21e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 4.78e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.99e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 5.02e3 0.00
lisp-retry-service any wait 0 0 2 4.79e3 0.00
statseg-collector-process time wait 0 0 1 6.49e3 0.00
unix-epoll-input polling 4477 0 0 2.02e6 0.00
vpe-oam-process any wait 0 0 2 2.23e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 56.12, last 128 main loops 0.00 per node 0.00
vector rates in 3.6398e6, out 1.8199e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 180582 7210675 0 1.67e1 39.93
FortyGigabitEthernet88/0/1-tx active 180582 7210675 0 4.89e1 39.93
dpdk-crypto-input polling 1019416 7210675 0 7.08e2 7.07
dpdk-esp4-decrypt active 85508 7210760 0 6.89e1 84.33
dpdk-esp4-decrypt-post active 180582 7210675 0 5.58e1 39.93
dpdk-input polling 1019416 7210760 0 7.08e1 7.07
ethernet-input active 85508 7210760 0 2.21e1 84.33
ip4-input-no-checksum active 195735 14421435 0 3.83e1 73.68
ip4-lookup active 180582 7210675 0 3.09e1 39.93
ip4-rewrite active 180582 7210675 0 3.50e1 39.93
ipsec4-input-feature active 195735 14421435 0 5.71e1 73.68
unix-epoll-input polling 994 0 0 1.37e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 40805004 0 0 4.82e1 0.00
dpdk-input polling 40805004 0 0 1.02e2 0.00
unix-epoll-input polling 39810 0 0 9.00e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 22)
Time 3.9, average vectors/node 197.69, last 128 main loops 24.50 per node 224.00
vector rates in 3.6397e6, out 3.6397e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 36475 7210655 0 1.06e1 197.69
FortyGigabitEthernet88/0/0-tx active 36475 7210655 0 4.66e1 197.69
dpdk-crypto-input polling 36475 7210655 0 7.03e2 197.69
dpdk-esp4-encrypt active 36475 7210652 0 1.32e2 197.69
dpdk-input polling 36475 7210652 0 5.16e1 197.69
ethernet-input active 36475 7210652 0 1.62e1 197.69
interface-output active 36475 7210655 0 1.09e1 197.69
ip4-input-no-checksum active 36475 7210652 0 2.30e1 197.69
ip4-lookup active 72950 14421307 0 3.09e1 197.69
ip4-rewrite active 72950 14421307 0 3.62e1 197.69
ipsec4-output-feature active 72950 14421307 0 6.46e1 197.69
unix-epoll-input polling 36 0 0 1.48e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 23)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 39840694 0 0 5.02e1 0.00
dpdk-input polling 39840694 0 0 1.04e2 0.00
unix-epoll-input polling 38869 0 0 9.01e2 0.00

40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-ndrpdr

RFC2544: Pkt throughput IPv4 IPsec tunnel mode.

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 on TG-DUTn, Eth-IPv4-IPSec on DUT1-DUT2
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with multiple IPsec tunnels between them. DUTs get IPv4 traffic from TG, encrypt it and send to another DUT, where packets are decrypted and sent back to TG
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, number of flows per flow-group equals to number of IPSec tunnels) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. Incrementing of IP.dst (IPv4 destination address) field is applied to both streams.
  • [Ref] Applicable standard specifications: RFC4303 and RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 47 1.11e5 0.00
dpdk-process any wait 0 0 2 7.41e3 0.00
fib-walk any wait 0 0 2 2.89e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 5.79e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.77e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 3.09e3 0.00
lisp-retry-service any wait 0 0 2 4.33e3 0.00
statseg-collector-process time wait 0 0 1 6.68e3 0.00
unix-epoll-input polling 5388 0 0 1.66e6 0.00
vpe-oam-process any wait 0 0 2 1.96e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 123.90, last 128 main loops 0.00 per node 0.00
vector rates in 5.3023e6, out 3.9619e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 46215 5236463 0 1.29e1 113.31
FortyGigabitEthernet88/0/0-tx active 46215 5236463 0 4.98e1 113.31
FortyGigabitEthernet88/0/1-out active 50115 4991654 0 1.38e1 99.60
FortyGigabitEthernet88/0/1-tx active 50115 4991654 0 5.40e1 99.60
dpdk-crypto-input polling 862907 10228117 0 7.48e1 11.85
dpdk-esp4-decrypt active 45075 5246220 0 2.55e2 116.39
dpdk-esp4-decrypt-post active 50115 4991654 0 7.95e1 99.60
dpdk-esp4-encrypt-tun active 39807 5278811 0 3.62e2 132.61
dpdk-input polling 862907 10525031 0 6.69e1 12.19
ethernet-input active 84882 10525031 0 2.10e1 123.99
ip4-input-no-checksum active 101887 15516685 0 2.94e1 152.29
ip4-local active 45075 5246220 0 5.22e1 116.39
ip4-lookup active 148102 20753148 0 3.88e1 140.13
ip4-midchain active 39807 5278811 0 6.16e1 132.61
ip4-rewrite active 96330 10228117 0 2.92e1 106.18
ipsec4-if-input active 45075 5246220 0 1.39e2 116.39
unix-epoll-input polling 841 0 0 1.77e3 0.00
64b-2t2c-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 50 2.89e5 0.00
dpdk-process any wait 0 0 2 1.05e4 0.00
fib-walk any wait 0 0 2 1.59e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 2.00e3 0.00
lisp-retry-service any wait 0 0 2 7.24e3 0.00
unix-epoll-input polling 4716 0 0 1.92e6 0.00
vpe-oam-process any wait 0 0 2 5.96e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 145.55, last 128 main loops 15.97 per node 146.00
vector rates in 5.1815e6, out 2.5908e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 76545 10277289 0 1.39e1 134.26
FortyGigabitEthernet88/0/1-tx active 76545 10277289 0 4.82e1 134.26
dpdk-crypto-input polling 78376 10277289 0 7.03e1 131.13
dpdk-esp4-decrypt active 76326 10277096 0 2.45e2 134.65
dpdk-esp4-decrypt-post active 76545 10277289 0 8.09e1 134.26
dpdk-input polling 78376 10277096 0 5.49e1 131.13
ethernet-input active 76326 10277096 0 2.21e1 134.65
ip4-input-no-checksum active 120876 20554385 0 3.35e1 170.05
ip4-local active 76326 10277096 0 4.61e1 134.65
ip4-lookup active 120876 20554385 0 3.24e1 170.05
ip4-rewrite active 76545 10277289 0 2.76e1 134.26
ipsec4-if-input active 76326 10277096 0 1.41e2 134.65
unix-epoll-input polling 77 0 0 1.71e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 48.25, last 128 main loops .23 per node 6.00
vector rates in 5.1815e6, out 5.1815e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 318952 10277077 0 1.93e1 32.22
FortyGigabitEthernet88/0/0-tx active 318952 10277077 0 5.44e1 32.22
dpdk-crypto-input polling 992203 10277077 0 9.76e1 10.36
dpdk-esp4-encrypt-tun active 133565 10277276 0 3.53e2 76.95
dpdk-input polling 992203 10277276 0 6.79e1 10.36
ethernet-input active 133565 10277276 0 2.12e1 76.95
ip4-input-no-checksum active 133565 10277276 0 2.95e1 76.95
ip4-lookup active 452517 20554353 0 6.39e1 45.42
ip4-midchain active 133565 10277276 0 6.71e1 76.95
ip4-rewrite active 318952 10277077 0 3.81e1 32.22
unix-epoll-input polling 968 0 0 1.41e3 0.00
64b-4t4c-ethip4ipsecscale1000tnl-ip4base-int-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 50 1.53e5 0.00
dpdk-process any wait 0 0 1 1.55e4 0.00
fib-walk any wait 0 0 2 4.27e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 2.98e3 0.00
lisp-retry-service any wait 0 0 2 1.27e4 0.00
unix-epoll-input polling 3015 0 0 2.97e6 0.00
vpe-oam-process any wait 0 0 2 3.16e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 196.23, last 128 main loops 19.03 per node 174.00
vector rates in 5.3173e6, out 2.6587e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 53508 10431060 0 1.08e1 194.94
FortyGigabitEthernet88/0/1-tx active 53508 10431060 0 4.67e1 194.94
dpdk-crypto-input polling 55619 10431060 0 6.73e1 187.54
dpdk-esp4-decrypt active 53511 10430929 0 2.55e2 194.93
dpdk-esp4-decrypt-post active 53508 10431060 0 7.77e1 194.94
dpdk-input polling 55619 10430929 0 5.20e1 187.54
ethernet-input active 53511 10430929 0 1.94e1 194.93
ip4-input-no-checksum active 105078 20861989 0 3.07e1 198.54
ip4-local active 53511 10430929 0 4.38e1 194.93
ip4-lookup active 105078 20861989 0 3.04e1 198.54
ip4-rewrite active 53508 10431060 0 2.57e1 194.94
ipsec4-if-input active 53511 10430929 0 1.39e2 194.93
unix-epoll-input polling 55 0 0 1.49e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 38257058 0 0 4.97e1 0.00
dpdk-input polling 38257058 0 0 1.11e2 0.00
unix-epoll-input polling 37324 0 0 9.08e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 22)
Time 3.9, average vectors/node 15.99, last 128 main loops .04 per node 1.00
vector rates in 2.6587e6, out 2.6587e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 476250 5215554 0 3.42e1 10.95
FortyGigabitEthernet88/0/0-tx active 476250 5215554 0 6.49e1 10.95
dpdk-crypto-input polling 16576343 5215554 0 2.85e2 .31
dpdk-esp4-encrypt-tun active 213656 5215462 0 3.53e2 24.41
dpdk-input polling 16576343 5215462 0 4.03e2 .31
ethernet-input active 213656 5215462 0 3.21e1 24.41
ip4-input-no-checksum active 213656 5215462 0 4.41e1 24.41
ip4-lookup active 689906 10431016 0 6.68e1 15.12
ip4-midchain active 213656 5215462 0 8.47e1 24.41
ip4-rewrite active 476250 5215554 0 5.44e1 10.95
unix-epoll-input polling 16172 0 0 1.41e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 23)
Time 3.9, average vectors/node 15.94, last 128 main loops .27 per node 7.00
vector rates in 2.6587e6, out 2.6587e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 486960 5215542 0 3.51e1 10.71
FortyGigabitEthernet88/0/0-tx active 486960 5215542 0 6.61e1 10.71
dpdk-crypto-input polling 15219859 5215542 0 2.68e2 .34
dpdk-esp4-encrypt-tun active 207427 5215462 0 3.67e2 25.14
dpdk-input polling 15219859 5215462 0 3.88e2 .34
ethernet-input active 207427 5215462 0 3.29e1 25.14
ip4-input-no-checksum active 207427 5215462 0 4.52e1 25.14
ip4-lookup active 694387 10431004 0 6.97e1 15.02
ip4-midchain active 207427 5215462 0 8.77e1 25.14
ip4-rewrite active 486960 5215542 0 5.45e1 10.71
unix-epoll-input polling 14848 0 0 1.42e3 0.00

40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-int-cbc-sha1-ndrpdr

RFC2544: Pkt throughput IPv4 IPsec tunnel mode.

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 on TG-DUTn, Eth-IPv4-IPSec on DUT1-DUT2
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with multiple IPsec tunnels between them. DUTs get IPv4 traffic from TG, encrypt it and send to another DUT, where packets are decrypted and sent back to TG
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, number of flows per flow-group equals to number of IPSec tunnels) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. Incrementing of IP.dst (IPv4 destination address) field is applied to both streams.
  • [Ref] Applicable standard specifications: RFC4303 and RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4ipsecscale1000tnl-ip4base-int-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 1.10e5 0.00
dpdk-process any wait 0 0 1 1.35e4 0.00
fib-walk any wait 0 0 2 2.21e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.43e3 0.00
lisp-retry-service any wait 0 0 2 3.39e3 0.00
unix-epoll-input polling 5443 0 0 1.65e6 0.00
vpe-oam-process any wait 0 0 2 2.16e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 122.41, last 128 main loops 0.00 per node 0.00
vector rates in 5.2139e6, out 3.8957e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 45040 5160930 0 1.29e1 114.59
FortyGigabitEthernet88/0/0-tx active 45040 5160930 0 5.00e1 114.59
FortyGigabitEthernet88/0/1-out active 50038 4920608 0 1.40e1 98.34
FortyGigabitEthernet88/0/1-tx active 50038 4920608 0 5.45e1 98.34
dpdk-crypto-input polling 859059 10081538 0 7.50e1 11.74
dpdk-esp4-decrypt active 45056 5170859 0 2.64e2 114.77
dpdk-esp4-decrypt-post active 50038 4920608 0 8.11e1 98.34
dpdk-esp4-encrypt-tun active 41181 5199052 0 3.74e2 126.25
dpdk-input polling 859059 10369911 0 6.74e1 12.07
ethernet-input active 86237 10369911 0 2.12e1 120.25
ip4-input-no-checksum active 101507 15290519 0 2.97e1 150.64
ip4-local active 45056 5170859 0 4.78e1 114.77
ip4-lookup active 146547 20451449 0 3.96e1 139.56
ip4-midchain active 41181 5199052 0 6.27e1 126.25
ip4-rewrite active 95078 10081538 0 3.04e1 106.03
ipsec4-if-input active 45056 5170859 0 1.39e2 114.77
unix-epoll-input polling 838 0 0 1.71e3 0.00
64b-2t2c-ethip4ipsecscale1000tnl-ip4base-int-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 50 1.38e5 0.00
dpdk-process any wait 0 0 1 1.35e4 0.00
fib-walk any wait 0 0 2 3.47e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 2.78e3 0.00
lisp-retry-service any wait 0 0 2 5.26e3 0.00
unix-epoll-input polling 2163 0 0 4.13e6 0.00
vpe-oam-process any wait 0 0 2 3.44e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 142.67, last 128 main loops 15.20 per node 139.00
vector rates in 5.0755e6, out 2.5378e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 76235 9925352 0 1.22e1 130.19
FortyGigabitEthernet88/0/1-tx active 76235 9925352 0 4.84e1 130.19
dpdk-crypto-input polling 78537 9925352 0 7.14e1 126.38
dpdk-esp4-decrypt active 76109 9925378 0 2.53e2 130.41
dpdk-esp4-decrypt-post active 76235 9925352 0 8.26e1 130.19
dpdk-input polling 78537 9925378 0 5.51e1 126.38
ethernet-input active 76109 9925378 0 2.25e1 130.41
ip4-input-no-checksum active 116064 19850730 0 3.34e1 171.03
ip4-local active 76109 9925378 0 5.37e1 130.41
ip4-lookup active 116064 19850730 0 3.35e1 171.03
ip4-rewrite active 76235 9925352 0 2.98e1 130.19
ipsec4-if-input active 76109 9925378 0 1.39e2 130.41
unix-epoll-input polling 77 0 0 1.66e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 45.87, last 128 main loops 2.04 per node 23.73
vector rates in 5.0755e6, out 5.0755e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 310980 9925377 0 1.94e1 31.92
FortyGigabitEthernet88/0/0-tx active 310980 9925377 0 5.34e1 31.92
dpdk-crypto-input polling 1431742 9925377 0 9.87e1 6.93
dpdk-esp4-encrypt-tun active 145415 9925252 0 3.58e2 68.25
dpdk-input polling 1431742 9925252 0 7.39e1 6.93
ethernet-input active 145415 9925252 0 2.20e1 68.25
ip4-input-no-checksum active 145415 9925252 0 3.02e1 68.25
ip4-lookup active 456395 19850629 0 6.47e1 43.49
ip4-midchain active 145415 9925252 0 6.71e1 68.25
ip4-rewrite active 310980 9925377 0 3.79e1 31.92
unix-epoll-input polling 1397 0 0 1.41e3 0.00
64b-4t4c-ethip4ipsecscale1000tnl-ip4base-int-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 49 1.08e5 0.00
dpdk-process any wait 0 0 1 1.20e4 0.00
fib-walk any wait 0 0 2 4.77e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 2.51e3 0.00
lisp-retry-service any wait 0 0 2 3.85e3 0.00
unix-epoll-input polling 3119 0 0 2.92e6 0.00
vpe-oam-process any wait 0 0 2 2.23e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 197.47, last 128 main loops 23.19 per node 212.00
vector rates in 5.2187e6, out 2.6093e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 53041 10392272 0 1.08e1 195.93
FortyGigabitEthernet88/0/1-tx active 53041 10392272 0 4.75e1 195.93
dpdk-crypto-input polling 55379 10392272 0 6.68e1 187.66
dpdk-esp4-decrypt active 53040 10392432 0 2.64e2 195.94
dpdk-esp4-decrypt-post active 53041 10392272 0 7.97e1 195.93
dpdk-input polling 55379 10392432 0 5.21e1 187.66
ethernet-input active 53040 10392432 0 2.03e1 195.94
ip4-input-no-checksum active 103807 20784704 0 3.05e1 200.22
ip4-local active 53040 10392432 0 4.38e1 195.94
ip4-lookup active 103807 20784704 0 3.08e1 200.22
ip4-rewrite active 53041 10392272 0 2.81e1 195.93
ipsec4-if-input active 53040 10392432 0 1.40e2 195.94
unix-epoll-input polling 54 0 0 1.62e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 41249145 0 0 4.75e1 0.00
dpdk-input polling 41249145 0 0 1.02e2 0.00
unix-epoll-input polling 40243 0 0 8.99e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 22)
Time 3.9, average vectors/node 16.97, last 128 main loops 0.00 per node 0.00
vector rates in 2.6093e6, out 2.6093e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 434288 5196148 0 3.27e1 11.96
FortyGigabitEthernet88/0/0-tx active 434288 5196148 0 6.36e1 11.96
dpdk-crypto-input polling 17177088 5196148 0 2.89e2 .30
dpdk-esp4-encrypt-tun active 210166 5196185 0 3.59e2 24.72
dpdk-input polling 17177088 5196185 0 4.18e2 .30
ethernet-input active 210166 5196185 0 3.23e1 24.72
ip4-input-no-checksum active 210166 5196185 0 4.33e1 24.72
ip4-lookup active 644454 10392333 0 6.95e1 16.13
ip4-midchain active 210166 5196185 0 8.32e1 24.72
ip4-rewrite active 434288 5196148 0 5.27e1 11.96
unix-epoll-input polling 16758 0 0 1.39e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 23)
Time 3.9, average vectors/node 17.25, last 128 main loops 0.00 per node 0.00
vector rates in 2.6093e6, out 2.6093e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 437505 5196145 0 3.35e1 11.88
FortyGigabitEthernet88/0/0-tx active 437505 5196145 0 6.57e1 11.88
dpdk-crypto-input polling 15940287 5196145 0 2.76e2 .33
dpdk-esp4-encrypt-tun active 199051 5196143 0 3.76e2 26.10
dpdk-input polling 15940287 5196143 0 3.93e2 .33
ethernet-input active 199051 5196143 0 3.25e1 26.10
ip4-input-no-checksum active 199051 5196143 0 4.39e1 26.10
ip4-lookup active 636556 10392288 0 7.22e1 16.33
ip4-midchain active 199051 5196143 0 8.61e1 26.10
ip4-rewrite active 437505 5196145 0 5.41e1 11.88
unix-epoll-input polling 15552 0 0 1.52e3 0.00

40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-tnl-aes-gcm-ndrpdr

IPv4 IPsec tunnel mode performance test suite.

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 on TG-DUTn, Eth-IPv4-IPSec on DUT1-DUT2
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with multiple IPsec tunnels between them. DUTs get IPv4 traffic from TG, encrypt it and send to another DUT, where packets are decrypted and sent back to TG
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, number of flows per flow-group equals to number of IPSec tunnels) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. Incrementing of IP.dst (IPv4 destination address) field is applied to both streams.
  • [Ref] Applicable standard specifications: RFC4303 and RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4ipsecscale1000tnl-ip4base-tnl-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 48 3.57e5 0.00
dpdk-process any wait 0 0 1 9.13e5 0.00
fib-walk any wait 0 0 2 2.29e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 3.49e3 0.00
lisp-retry-service any wait 0 0 2 2.64e3 0.00
unix-epoll-input polling 2611 0 0 3.49e6 0.00
vpe-oam-process any wait 0 0 2 1.25e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 104.15, last 128 main loops 0.00 per node 0.00
vector rates in 7.4904e5, out 5.6132e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 9137 752951 0 1.48e1 82.41
FortyGigabitEthernet88/0/0-tx active 9137 752951 0 5.31e1 82.41
FortyGigabitEthernet88/0/1-out active 7509 728091 0 1.51e1 96.96
FortyGigabitEthernet88/0/1-tx active 7509 728091 0 5.41e1 96.96
dpdk-crypto-input polling 5511312 1481042 0 2.46e2 .27
dpdk-esp4-decrypt active 6049 748352 0 2.55e2 123.71
dpdk-esp4-decrypt-post active 7509 728091 0 7.81e1 96.96
dpdk-esp4-encrypt active 6843 756668 0 3.12e2 110.58
dpdk-input polling 5511312 1505020 0 5.61e2 .27
ethernet-input active 12892 1505020 0 2.12e1 116.74
interface-output active 9137 752951 0 1.55e1 82.41
ip4-input-no-checksum active 17729 2233111 0 3.51e1 125.96
ip4-lookup active 22492 2237710 0 3.79e1 99.49
ip4-rewrite active 22492 2237710 0 3.88e1 99.49
ipsec4-input-feature active 12235 1476443 0 2.30e3 120.67
ipsec4-output-feature active 15980 1509619 0 2.10e3 94.47
unix-epoll-input polling 5377 0 0 1.10e3 0.00
64b-2t2c-ethip4ipsecscale1000tnl-ip4base-tnl-aes-gcm-ndrpdr
 Not Captured 
64b-4t4c-ethip4ipsecscale1000tnl-ip4base-tnl-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 3.14e5 0.00
dpdk-process any wait 0 0 2 1.19e4 0.00
fib-walk any wait 0 0 2 2.20e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 2.13e3 0.00
lisp-retry-service any wait 0 0 2 3.11e3 0.00
unix-epoll-input polling 4229 0 0 2.14e6 0.00
vpe-oam-process any wait 0 0 2 2.73e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 256.00, last 128 main loops 26.00 per node 256.00
vector rates in 8.7210e5, out 4.3605e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 6741 1725696 0 9.93e0 256.00
FortyGigabitEthernet88/0/1-tx active 6741 1725696 0 4.54e1 256.00
dpdk-crypto-input polling 6741 1725696 0 6.68e1 256.00
dpdk-esp4-decrypt active 6741 1725696 0 2.65e2 256.00
dpdk-esp4-decrypt-post active 6741 1725696 0 7.63e1 256.00
dpdk-input polling 6741 1725696 0 4.88e1 256.00
ethernet-input active 6741 1725696 0 1.71e1 256.00
ip4-input-no-checksum active 13482 3451392 0 3.59e1 256.00
ip4-lookup active 6741 1725696 0 3.42e1 256.00
ip4-rewrite active 6741 1725696 0 2.98e1 256.00
ipsec4-input-feature active 13482 3451392 0 2.29e3 256.00
unix-epoll-input polling 6 0 0 1.74e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 40705341 0 0 4.72e1 0.00
dpdk-input polling 40705341 0 0 1.03e2 0.00
unix-epoll-input polling 39712 0 0 9.12e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 22)
Time 3.9, average vectors/node 18.39, last 128 main loops 0.00 per node 0.00
vector rates in 4.4792e5, out 4.4792e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 55169 886269 0 3.20e1 16.06
FortyGigabitEthernet88/0/0-tx active 55169 886269 0 6.97e1 16.06
dpdk-crypto-input polling 19116865 886269 0 1.18e3 .05
dpdk-esp4-encrypt active 41205 886377 0 3.68e2 21.51
dpdk-input polling 19116865 886377 0 2.28e3 .05
ethernet-input active 41205 886377 0 4.46e1 21.51
interface-output active 55169 886269 0 2.66e1 16.06
ip4-input-no-checksum active 41205 886377 0 5.44e1 21.51
ip4-lookup active 96374 1772646 0 5.43e1 18.39
ip4-rewrite active 96374 1772646 0 6.29e1 18.39
ipsec4-output-feature active 96374 1772646 0 2.14e3 18.39
unix-epoll-input polling 18650 0 0 1.17e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 23)
Time 3.9, average vectors/node 18.59, last 128 main loops 0.00 per node 0.00
vector rates in 4.4791e5, out 4.4791e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 54530 886270 0 3.25e1 16.25
FortyGigabitEthernet88/0/0-tx active 54530 886270 0 7.10e1 16.25
dpdk-crypto-input polling 18642877 886270 0 1.16e3 .05
dpdk-esp4-encrypt active 40836 886339 0 3.73e2 21.70
dpdk-input polling 18642877 886339 0 2.29e3 .05
ethernet-input active 40836 886339 0 4.53e1 21.70
interface-output active 54530 886270 0 2.69e1 16.25
ip4-input-no-checksum active 40836 886339 0 5.61e1 21.70
ip4-lookup active 95366 1772609 0 5.60e1 18.59
ip4-rewrite active 95366 1772609 0 6.35e1 18.59
ipsec4-output-feature active 95366 1772609 0 2.15e3 18.59
unix-epoll-input polling 18188 0 0 1.26e3 0.00

40ge2p1xl710-ethip4ipsecscale1000tnl-ip4base-tnl-cbc-sha1-ndrpdr

IPv4 IPsec tunnel mode performance test suite.

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 on TG-DUTn, Eth-IPv4-IPSec on DUT1-DUT2
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with multiple IPsec tunnels between them. DUTs get IPv4 traffic from TG, encrypt it and send to another DUT, where packets are decrypted and sent back to TG
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, number of flows per flow-group equals to number of IPSec tunnels) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. Incrementing of IP.dst (IPv4 destination address) field is applied to both streams.
  • [Ref] Applicable standard specifications: RFC4303 and RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4ipsecscale1000tnl-ip4base-tnl-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 47 2.89e5 0.00
dpdk-process any wait 0 0 1 1.44e4 0.00
fib-walk any wait 0 0 2 1.98e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.92e3 0.00
lisp-retry-service any wait 0 0 2 3.30e3 0.00
unix-epoll-input polling 3204 0 0 2.82e6 0.00
vpe-oam-process any wait 0 0 2 1.19e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 106.71, last 128 main loops 0.00 per node 0.00
vector rates in 7.5345e5, out 5.6389e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 8739 749852 0 1.45e1 85.81
FortyGigabitEthernet88/0/0-tx active 8739 749852 0 5.32e1 85.81
FortyGigabitEthernet88/0/1-out active 7390 726423 0 1.49e1 98.29
FortyGigabitEthernet88/0/1-tx active 7390 726423 0 5.39e1 98.29
dpdk-crypto-input polling 5136248 1476275 0 2.39e2 .29
dpdk-esp4-decrypt active 5911 749404 0 2.63e2 126.78
dpdk-esp4-decrypt-post active 7390 726423 0 7.99e1 98.29
dpdk-esp4-encrypt active 6719 753061 0 3.23e2 112.08
dpdk-input polling 5136248 1502465 0 5.32e2 .29
ethernet-input active 12630 1502465 0 2.10e1 118.96
interface-output active 8739 749852 0 1.54e1 85.81
ip4-input-no-checksum active 17420 2228888 0 3.49e1 127.95
ip4-lookup active 21828 2229336 0 3.77e1 102.13
ip4-rewrite active 21828 2229336 0 3.97e1 102.13
ipsec4-input-feature active 12023 1475827 0 2.32e3 122.75
ipsec4-output-feature active 15458 1502913 0 2.09e3 97.23
unix-epoll-input polling 5011 0 0 1.11e3 0.00
64b-2t2c-ethip4ipsecscale1000tnl-ip4base-tnl-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 5.22e5 0.00
dpdk-process any wait 0 0 1 2.05e4 0.00
fib-walk any wait 0 0 2 4.21e3 0.00
ip-neighbor-scan-process any wait 0 0 1 2.84e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 2.86e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 2.87e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 3.29e3 0.00
lisp-retry-service any wait 0 0 2 6.84e3 0.00
statseg-collector-process time wait 0 0 1 6.57e3 0.00
unix-epoll-input polling 3831 0 0 2.36e6 0.00
vpe-oam-process any wait 0 0 2 2.16e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 256.00, last 128 main loops 26.00 per node 256.00
vector rates in 8.4439e5, out 4.2219e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 6534 1672704 0 1.00e1 256.00
FortyGigabitEthernet88/0/1-tx active 6534 1672704 0 4.54e1 256.00
dpdk-crypto-input polling 6534 1672704 0 6.86e1 256.00
dpdk-esp4-decrypt active 6534 1672704 0 2.72e2 256.00
dpdk-esp4-decrypt-post active 6534 1672704 0 7.76e1 256.00
dpdk-input polling 6534 1672704 0 4.88e1 256.00
ethernet-input active 6534 1672704 0 1.71e1 256.00
ip4-input-no-checksum active 13068 3345408 0 3.56e1 256.00
ip4-lookup active 6534 1672704 0 3.46e1 256.00
ip4-rewrite active 6534 1672704 0 3.52e1 256.00
ipsec4-input-feature active 13068 3345408 0 2.37e3 256.00
unix-epoll-input polling 6 0 0 1.75e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 112.79, last 128 main loops 0.00 per node 0.00
vector rates in 8.7422e5, out 8.7422e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 16413 1731828 0 1.27e1 105.52
FortyGigabitEthernet88/0/0-tx active 16413 1731828 0 5.07e1 105.52
dpdk-crypto-input polling 2033051 1731828 0 1.42e2 .85
dpdk-esp4-encrypt active 14294 1731736 0 3.35e2 121.15
dpdk-input polling 2033051 1731736 0 1.78e2 .85
ethernet-input active 14294 1731736 0 1.96e1 121.15
interface-output active 16413 1731828 0 1.25e1 105.52
ip4-input-no-checksum active 14294 1731736 0 2.63e1 121.15
ip4-lookup active 30707 3463564 0 4.55e1 112.79
ip4-rewrite active 30707 3463564 0 3.93e1 112.79
ipsec4-output-feature active 30707 3463564 0 2.09e3 112.79
unix-epoll-input polling 1984 0 0 1.48e3 0.00
64b-4t4c-ethip4ipsecscale1000tnl-ip4base-tnl-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 50 2.89e5 0.00
dpdk-process any wait 0 0 2 4.59e5 0.00
fib-walk any wait 0 0 2 3.39e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 3.75e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.93e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 6.60e3 0.00
lisp-retry-service any wait 0 0 2 2.85e3 0.00
statseg-collector-process time wait 0 0 1 7.94e3 0.00
unix-epoll-input polling 2730 0 0 3.28e6 0.00
vpe-oam-process any wait 0 0 1 2.00e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 140.38, last 128 main loops 0.00 per node 0.00
vector rates in 8.6412e5, out 4.3203e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 12986 1695975 0 1.19e1 130.60
FortyGigabitEthernet88/0/1-tx active 12986 1695975 0 4.77e1 130.60
dpdk-crypto-input polling 337382 1695975 0 8.09e1 5.03
dpdk-esp4-decrypt active 12278 1696220 0 2.68e2 138.15
dpdk-esp4-decrypt-post active 12986 1695975 0 7.92e1 130.60
dpdk-input polling 337382 1696220 0 7.24e1 5.03
ethernet-input active 12278 1696220 0 2.02e1 138.15
ip4-input-no-checksum active 22159 3392195 0 3.80e1 153.08
ip4-lookup active 12986 1695975 0 3.27e1 130.60
ip4-rewrite active 12986 1695975 0 3.46e1 130.60
ipsec4-input-feature active 22159 3392195 0 2.28e3 153.08
unix-epoll-input polling 329 0 0 1.40e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 40514035 0 0 4.82e1 0.00
dpdk-input polling 40514035 0 0 1.01e2 0.00
unix-epoll-input polling 39526 0 0 9.03e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 22)
Time 3.9, average vectors/node 27.55, last 128 main loops 0.00 per node 0.00
vector rates in 4.3203e5, out 4.3203e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 38553 847987 0 2.63e1 21.99
FortyGigabitEthernet88/0/0-tx active 38553 847987 0 6.19e1 21.99
dpdk-crypto-input polling 20371161 847987 0 1.27e3 .04
dpdk-esp4-encrypt active 23018 847987 0 3.62e2 36.84
dpdk-input polling 20371161 847987 0 2.51e3 .04
ethernet-input active 23018 847987 0 3.29e1 36.84
interface-output active 38553 847987 0 2.22e1 21.99
ip4-input-no-checksum active 23018 847987 0 4.07e1 36.84
ip4-lookup active 61571 1695974 0 4.96e1 27.55
ip4-rewrite active 61571 1695974 0 5.41e1 27.55
ipsec4-output-feature active 61571 1695974 0 2.12e3 27.55
unix-epoll-input polling 19874 0 0 1.11e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 23)
Time 3.9, average vectors/node 27.55, last 128 main loops 0.00 per node 0.00
vector rates in 4.3203e5, out 4.3203e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 38829 847988 0 2.66e1 21.84
FortyGigabitEthernet88/0/0-tx active 38829 847988 0 6.36e1 21.84
dpdk-crypto-input polling 19322932 847988 0 1.22e3 .04
dpdk-esp4-encrypt active 22739 847988 0 3.70e2 37.29
dpdk-input polling 19322932 847988 0 2.59e3 .04
ethernet-input active 22739 847988 0 3.40e1 37.29
interface-output active 38829 847988 0 2.27e1 21.84
ip4-input-no-checksum active 22739 847988 0 4.32e1 37.29
ip4-lookup active 61568 1695976 0 5.19e1 27.55
ip4-rewrite active 61568 1695976 0 5.48e1 27.55
ipsec4-output-feature active 61568 1695976 0 2.13e3 27.55
unix-epoll-input polling 18851 0 0 1.15e3 0.00

40ge2p1xl710-ethip4ipsecscale1000tnlsw-ip4base-int-aes-gcm-ndrpdr

RFC2544: Pkt throughput IPv4 IPsec tunnel mode.

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 on TG-DUTn, Eth-IPv4-IPSec on DUT1-DUT2
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with DPDK SW crypto devices and multiple IPsec tunnels between them. DUTs get IPv4 traffic from TG, encrypt it and send to another DUT, where packets are decrypted and sent back to TG
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, number of flows per flow-group equals to number of IPSec tunnels) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. Incrementing of IP.dst (IPv4 destination address) field is applied to both streams.
  • [Ref] Applicable standard specifications: RFC4303 and RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4ipsecscale1000tnlsw-ip4base-int-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 50 2.79e5 0.00
dpdk-process any wait 0 0 1 1.07e4 0.00
fib-walk any wait 0 0 1 1.98e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 3.47e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 4.94e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 2.11e3 0.00
lisp-retry-service any wait 0 0 1 2.05e3 0.00
statseg-collector-process time wait 0 0 1 4.92e3 0.00
unix-epoll-input polling 4652 0 0 1.94e6 0.00
vpe-oam-process any wait 0 0 2 1.93e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 79.88, last 128 main loops 0.00 per node 0.00
vector rates in 4.5531e6, out 3.4148e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 59397 4492213 0 1.48e1 75.63
FortyGigabitEthernet88/0/0-tx active 59397 4492213 0 4.74e1 75.63
FortyGigabitEthernet88/0/1-out active 67635 4492261 0 1.51e1 66.42
FortyGigabitEthernet88/0/1-tx active 67635 4492261 0 4.85e1 66.42
dpdk-crypto-input polling 468807 8984474 0 3.23e2 19.16
dpdk-esp4-decrypt active 67587 4492344 0 1.43e2 66.47
dpdk-esp4-decrypt-post active 67635 4492261 0 7.14e1 66.42
dpdk-esp4-encrypt-tun active 59392 4492156 0 2.47e2 75.64
dpdk-input polling 468807 8984500 0 6.64e1 19.16
ethernet-input active 126979 8984500 0 2.41e1 70.76
ip4-input-no-checksum active 121013 13476761 0 3.23e1 111.37
ip4-local active 67587 4492344 0 5.22e1 66.47
ip4-lookup active 180410 17968974 0 4.04e1 99.60
ip4-midchain active 59392 4492156 0 6.83e1 75.64
ip4-rewrite active 127032 8984474 0 3.11e1 70.73
ipsec4-if-input active 67587 4492344 0 1.47e2 66.47
unix-epoll-input polling 457 0 0 1.55e3 0.00
64b-2t2c-ethip4ipsecscale1000tnlsw-ip4base-int-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 49 8.21e4 0.00
dpdk-process any wait 0 0 1 9.43e5 0.00
fib-walk any wait 0 0 2 3.98e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 4.23e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.94e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 4.04e3 0.00
lisp-retry-service any wait 0 0 2 1.02e4 0.00
statseg-collector-process time wait 0 0 1 7.22e3 0.00
unix-epoll-input polling 3597 0 0 2.49e6 0.00
vpe-oam-process any wait 0 0 2 1.77e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 105.07, last 128 main loops 4.16 per node 44.33
vector rates in 4.4645e6, out 2.2323e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 100400 8751807 0 1.35e1 87.17
FortyGigabitEthernet88/0/1-tx active 100400 8751807 0 4.84e1 87.17
dpdk-crypto-input polling 197683 8751807 0 3.13e2 44.27
dpdk-esp4-decrypt active 100400 8751837 0 1.42e2 87.17
dpdk-esp4-decrypt-post active 100400 8751807 0 7.07e1 87.17
dpdk-input polling 197683 8751837 0 5.78e1 44.27
ethernet-input active 100400 8751837 0 2.30e1 87.17
ip4-input-no-checksum active 106703 17503644 0 3.37e1 164.04
ip4-local active 100400 8751837 0 4.87e1 87.17
ip4-lookup active 106703 17503644 0 3.38e1 164.04
ip4-rewrite active 100400 8751807 0 2.99e1 87.17
ipsec4-if-input active 100400 8751837 0 1.42e2 87.17
unix-epoll-input polling 193 0 0 1.46e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 64.02, last 128 main loops .04 per node 1.00
vector rates in 4.4645e6, out 4.4645e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 136710 8751740 0 1.46e1 64.02
FortyGigabitEthernet88/0/0-tx active 136710 8751740 0 4.78e1 64.02
dpdk-crypto-input polling 2651765 8751740 0 3.39e2 3.30
dpdk-esp4-encrypt-tun active 136711 8751837 0 2.44e2 64.02
dpdk-input polling 2651765 8751837 0 8.86e1 3.30
ethernet-input active 136711 8751837 0 2.21e1 64.02
ip4-input-no-checksum active 136711 8751837 0 3.06e1 64.02
ip4-lookup active 273421 17503577 0 5.79e1 64.02
ip4-midchain active 136711 8751837 0 6.79e1 64.02
ip4-rewrite active 136710 8751740 0 3.13e1 64.02
unix-epoll-input polling 2587 0 0 1.40e3 0.00
64b-4t4c-ethip4ipsecscale1000tnlsw-ip4base-int-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 1.19e5 0.00
dhcp-client-process any wait 0 0 1 1.22e4 0.00
dpdk-process any wait 0 0 1 1.91e4 0.00
fib-walk any wait 0 0 2 4.46e3 0.00
ip-route-resolver-process any wait 0 0 1 2.93e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 5.79e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 2.37e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 1.41e4 0.00
lisp-retry-service any wait 0 0 2 4.48e3 0.00
statseg-collector-process time wait 0 0 1 8.99e3 0.00
unix-epoll-input polling 3188 0 0 2.84e6 0.00
vpe-oam-process any wait 0 0 2 3.26e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 119.04, last 128 main loops 12.25 per node 130.67
vector rates in 4.5098e6, out 2.2549e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 91244 8936932 0 1.30e1 97.95
FortyGigabitEthernet88/0/1-tx active 91244 8936932 0 4.81e1 97.95
dpdk-crypto-input polling 94480 8936932 0 3.17e2 94.59
dpdk-esp4-decrypt active 91244 8936932 0 1.41e2 97.95
dpdk-esp4-decrypt-post active 91244 8936932 0 7.04e1 97.95
dpdk-input polling 94480 8936932 0 5.52e1 94.59
ethernet-input active 91244 8936932 0 2.19e1 97.95
ip4-input-no-checksum active 93561 17873864 0 3.13e1 191.04
ip4-local active 91244 8936932 0 4.74e1 97.95
ip4-lookup active 93561 17873864 0 3.28e1 191.04
ip4-rewrite active 91244 8936932 0 2.89e1 97.95
ipsec4-if-input active 91244 8936932 0 1.44e2 97.95
unix-epoll-input polling 92 0 0 1.44e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 40687844 0 0 4.46e1 0.00
dpdk-input polling 40687844 0 0 1.03e2 0.00
unix-epoll-input polling 39695 0 0 8.99e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 22)
Time 3.9, average vectors/node 30.38, last 128 main loops 0.00 per node 0.00
vector rates in 2.2549e6, out 2.2549e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 147063 4468464 0 2.03e1 30.38
FortyGigabitEthernet88/0/0-tx active 147063 4468464 0 5.21e1 30.38
dpdk-crypto-input polling 19457346 4468464 0 5.49e2 .23
dpdk-esp4-encrypt-tun active 147063 4468422 0 2.51e2 30.38
dpdk-input polling 19457346 4468422 0 5.39e2 .23
ethernet-input active 147063 4468422 0 2.82e1 30.38
ip4-input-no-checksum active 147063 4468422 0 4.12e1 30.38
ip4-lookup active 294126 8936886 0 5.36e1 30.38
ip4-midchain active 147063 4468422 0 8.34e1 30.38
ip4-rewrite active 147063 4468464 0 3.74e1 30.38
unix-epoll-input polling 18982 0 0 1.41e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 23)
Time 3.9, average vectors/node 30.70, last 128 main loops 0.00 per node 0.00
vector rates in 2.2549e6, out 2.2549e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 145546 4468463 0 2.06e1 30.70
FortyGigabitEthernet88/0/0-tx active 145546 4468463 0 5.27e1 30.70
dpdk-crypto-input polling 19198116 4468463 0 5.39e2 .23
dpdk-esp4-encrypt-tun active 145546 4468432 0 2.61e2 30.70
dpdk-input polling 19198116 4468432 0 5.19e2 .23
ethernet-input active 145546 4468432 0 2.89e1 30.70
ip4-input-no-checksum active 145546 4468432 0 4.17e1 30.70
ip4-lookup active 291092 8936895 0 5.55e1 30.70
ip4-midchain active 145546 4468432 0 8.41e1 30.70
ip4-rewrite active 145546 4468463 0 3.77e1 30.70
unix-epoll-input polling 18730 0 0 1.51e3 0.00

40ge2p1xl710-ethip4ipsecscale1000tnlsw-ip4base-int-cbc-sha1-ndrpdr

RFC2544: Pkt throughput IPv4 IPsec tunnel mode.

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 on TG-DUTn, Eth-IPv4-IPSec on DUT1-DUT2
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with DPDK SW crypto devices and multiple IPsec tunnels between them. DUTs get IPv4 traffic from TG, encrypt it and send to another DUT, where packets are decrypted and sent back to TG
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, number of flows per flow-group equals to number of IPSec tunnels) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. Incrementing of IP.dst (IPv4 destination address) field is applied to both streams.
  • [Ref] Applicable standard specifications: RFC4303 and RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4ipsecscale1000tnlsw-ip4base-int-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 49 1.03e5 0.00
dpdk-process any wait 0 0 1 2.07e4 0.00
fib-walk any wait 0 0 2 9.89e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.86e3 0.00
lisp-retry-service any wait 0 0 2 4.12e3 0.00
unix-epoll-input polling 3108 0 0 2.89e6 0.00
vpe-oam-process any wait 0 0 2 6.52e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 129.45, last 128 main loops 13.46 per node 114.87
vector rates in 3.1942e6, out 2.3956e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 28888 3139312 0 1.35e1 108.67
FortyGigabitEthernet88/0/0-tx active 28888 3139312 0 5.01e1 108.67
FortyGigabitEthernet88/0/1-out active 29249 3139288 0 1.32e1 107.33
FortyGigabitEthernet88/0/1-tx active 29249 3139288 0 5.12e1 107.33
dpdk-crypto-input polling 32734 6278600 0 7.71e2 191.81
dpdk-esp4-decrypt active 27849 3139264 0 1.47e2 112.72
dpdk-esp4-decrypt-post active 29249 3139288 0 8.07e1 107.33
dpdk-esp4-encrypt-tun active 22302 3139350 0 2.51e2 140.77
dpdk-input polling 32734 6278614 0 5.71e1 191.81
ethernet-input active 50151 6278614 0 2.16e1 125.19
ip4-input-no-checksum active 53052 9417902 0 2.97e1 177.52
ip4-local active 27849 3139264 0 4.88e1 112.72
ip4-lookup active 81940 12557214 0 3.93e1 153.25
ip4-midchain active 22302 3139350 0 6.25e1 140.77
ip4-rewrite active 58137 6278600 0 3.06e1 107.99
ipsec4-if-input active 27849 3139264 0 1.41e2 112.72
unix-epoll-input polling 32 0 0 1.98e3 0.00
64b-2t2c-ethip4ipsecscale1000tnlsw-ip4base-int-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 1.59e5 0.00
dpdk-process any wait 0 0 1 1.02e4 0.00
fib-walk any wait 0 0 2 4.37e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 6.20e3 0.00
lisp-retry-service any wait 0 0 2 6.01e3 0.00
unix-epoll-input polling 3044 0 0 2.99e6 0.00
vpe-oam-process any wait 0 0 2 1.54e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 162.09, last 128 main loops 22.15 per node 202.50
vector rates in 3.1714e6, out 1.5857e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 41399 6317855 0 1.19e1 152.61
FortyGigabitEthernet88/0/1-tx active 41399 6317855 0 4.85e1 152.61
dpdk-crypto-input polling 44624 6317855 0 7.33e2 141.58
dpdk-esp4-decrypt active 41357 6317892 0 1.41e2 152.76
dpdk-esp4-decrypt-post active 41399 6317855 0 8.18e1 152.61
dpdk-input polling 44624 6317892 0 5.47e1 141.58
ethernet-input active 41357 6317892 0 2.26e1 152.76
ip4-input-no-checksum active 69558 12635747 0 3.39e1 181.66
ip4-local active 41357 6317892 0 4.57e1 152.76
ip4-lookup active 69558 12635747 0 3.29e1 181.66
ip4-rewrite active 41399 6317855 0 2.95e1 152.61
ipsec4-if-input active 41357 6317892 0 1.41e2 152.76
unix-epoll-input polling 44 0 0 1.65e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 60.59, last 128 main loops .04 per node 1.00
vector rates in 3.1713e6, out 3.1713e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 141971 6317808 0 1.62e1 44.50
FortyGigabitEthernet88/0/0-tx active 141971 6317808 0 5.19e1 44.50
dpdk-crypto-input polling 142052 6317808 0 7.94e2 44.48
dpdk-esp4-encrypt-tun active 76008 6317862 0 2.47e2 83.12
dpdk-input polling 142052 6317862 0 6.08e1 44.48
ethernet-input active 76008 6317862 0 2.11e1 83.12
ip4-input-no-checksum active 76008 6317862 0 2.93e1 83.12
ip4-lookup active 217979 12635670 0 5.94e1 57.97
ip4-midchain active 76008 6317862 0 6.83e1 83.12
ip4-rewrite active 141971 6317808 0 3.42e1 44.50
unix-epoll-input polling 139 0 0 1.59e3 0.00
64b-4t4c-ethip4ipsecscale1000tnlsw-ip4base-int-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 1.34e5 0.00
dpdk-process any wait 0 0 2 1.86e4 0.00
fib-walk any wait 0 0 2 6.27e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 2.49e3 0.00
lisp-retry-service any wait 0 0 2 9.59e3 0.00
unix-epoll-input polling 4053 0 0 2.23e6 0.00
vpe-oam-process any wait 0 0 2 9.03e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 195.12, last 128 main loops 15.75 per node 144.00
vector rates in 3.1984e6, out 1.5992e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 33150 6334728 0 1.09e1 191.09
FortyGigabitEthernet88/0/1-tx active 33150 6334728 0 4.71e1 191.09
dpdk-crypto-input polling 34848 6334728 0 7.45e2 181.78
dpdk-esp4-decrypt active 33136 6334677 0 1.42e2 191.17
dpdk-esp4-decrypt-post active 33150 6334728 0 7.94e1 191.09
dpdk-input polling 34848 6334677 0 5.23e1 181.78
ethernet-input active 33136 6334677 0 1.99e1 191.17
ip4-input-no-checksum active 62561 12669405 0 3.11e1 202.51
ip4-local active 33136 6334677 0 4.46e1 191.17
ip4-lookup active 62561 12669405 0 3.09e1 202.51
ip4-rewrite active 33150 6334728 0 2.83e1 191.09
ipsec4-if-input active 33136 6334677 0 1.38e2 191.17
unix-epoll-input polling 34 0 0 1.51e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 40140080 0 0 4.46e1 0.00
dpdk-input polling 40140080 0 0 1.06e2 0.00
unix-epoll-input polling 39161 0 0 9.02e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 22)
Time 3.9, average vectors/node 12.00, last 128 main loops 0.00 per node 0.00
vector rates in 1.5992e6, out 1.5992e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 484908 3167479 0 4.54e1 6.53
FortyGigabitEthernet88/0/0-tx active 484908 3167479 0 7.53e1 6.53
dpdk-crypto-input polling 16201337 3167479 0 1.14e3 .19
dpdk-esp4-encrypt-tun active 98053 3167381 0 2.57e2 32.30
dpdk-input polling 16201337 3167381 0 6.09e2 .19
ethernet-input active 98053 3167381 0 2.95e1 32.30
ip4-input-no-checksum active 98053 3167381 0 4.26e1 32.30
ip4-lookup active 582961 6334860 0 7.26e1 10.87
ip4-midchain active 98053 3167381 0 8.59e1 32.30
ip4-rewrite active 484908 3167479 0 6.38e1 6.53
unix-epoll-input polling 15806 0 0 1.55e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 23)
Time 3.9, average vectors/node 12.10, last 128 main loops 0.00 per node 0.00
vector rates in 1.5992e6, out 1.5992e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 482725 3167475 0 4.42e1 6.56
FortyGigabitEthernet88/0/0-tx active 482725 3167475 0 7.73e1 6.56
dpdk-crypto-input polling 15610764 3167475 0 1.16e3 .20
dpdk-esp4-encrypt-tun active 95928 3167385 0 2.67e2 33.02
dpdk-input polling 15610764 3167385 0 5.81e2 .20
ethernet-input active 95928 3167385 0 3.08e1 33.02
ip4-input-no-checksum active 95928 3167385 0 4.36e1 33.02
ip4-lookup active 578653 6334860 0 7.50e1 10.95
ip4-midchain active 95928 3167385 0 8.91e1 33.02
ip4-rewrite active 482725 3167475 0 6.45e1 6.56
unix-epoll-input polling 15230 0 0 1.60e3 0.00

40ge2p1xl710-ethip4ipsecscale1000tnlsw-ip4base-tnl-aes-gcm-ndrpdr

IPv4 IPsec tunnel mode performance test suite.

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 on TG-DUTn, Eth-IPv4-IPSec on DUT1-DUT2
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with DPDK SW crypto devices and multiple IPsec tunnels between them. DUTs get IPv4 traffic from TG, encrypt it and send to another DUT, where packets are decrypted and sent back to TG.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, number of flows per flow-group equals to number of IPSec tunnels) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. Incrementing of IP.dst (IPv4 destination address) field is applied to both streams.
  • [Ref] Applicable standard specifications: RFC4303 and RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4ipsecscale1000tnlsw-ip4base-tnl-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 50 3.53e5 0.00
dpdk-process any wait 0 0 1 9.22e5 0.00
fib-walk any wait 0 0 2 7.64e3 0.00
ip-neighbor-scan-process any wait 0 0 1 1.64e4 0.00
ip4-reassembly-expire-walk any wait 0 0 1 2.00e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 2.33e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 3.40e3 0.00
lisp-retry-service any wait 0 0 2 7.33e3 0.00
statseg-collector-process time wait 0 0 1 5.70e3 0.00
unix-epoll-input polling 2878 0 0 3.15e6 0.00
vpe-oam-process any wait 0 0 2 5.59e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 116.61, last 128 main loops 0.00 per node 0.00
vector rates in 7.4583e5, out 5.5809e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 7410 741372 0 1.40e1 100.05
FortyGigabitEthernet88/0/0-tx active 7410 741372 0 5.28e1 100.05
FortyGigabitEthernet88/0/1-out active 6848 715338 0 1.49e1 104.46
FortyGigabitEthernet88/0/1-tx active 6848 715338 0 5.31e1 104.46
dpdk-crypto-input polling 4187281 1456710 0 4.78e2 .35
dpdk-esp4-decrypt active 5914 744713 0 1.54e2 125.92
dpdk-esp4-decrypt-post active 6848 715338 0 7.64e1 104.46
dpdk-esp4-encrypt active 6343 757011 0 2.10e2 119.35
dpdk-input polling 4187281 1501724 0 4.62e2 .36
ethernet-input active 12257 1501724 0 2.09e1 122.52
interface-output active 7410 741372 0 1.53e1 100.05
ip4-input-no-checksum active 15803 2217062 0 3.43e1 140.29
ip4-lookup active 19898 2213721 0 3.63e1 111.25
ip4-rewrite active 19898 2213721 0 3.76e1 111.25
ipsec4-input-feature active 10557 1460051 0 2.36e3 138.30
ipsec4-output-feature active 13753 1498383 0 2.13e3 108.95
unix-epoll-input polling 4085 0 0 1.14e3 0.00
64b-2t2c-ethip4ipsecscale1000tnlsw-ip4base-tnl-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 3.49e5 0.00
dpdk-process any wait 0 0 1 3.27e4 0.00
fib-walk any wait 0 0 2 1.28e4 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.67e3 0.00
lisp-retry-service any wait 0 0 2 3.54e3 0.00
unix-epoll-input polling 4404 0 0 2.04e6 0.00
vpe-oam-process any wait 0 0 2 7.26e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 165.08, last 128 main loops 0.00 per node 0.00
vector rates in 8.2851e5, out 4.1426e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 10404 1630912 0 1.10e1 156.76
FortyGigabitEthernet88/0/1-tx active 10404 1630912 0 4.64e1 156.76
dpdk-crypto-input polling 2214031 1630912 0 3.96e2 .74
dpdk-esp4-decrypt active 10404 1630875 0 1.51e2 156.75
dpdk-esp4-decrypt-post active 10404 1630912 0 7.49e1 156.76
dpdk-input polling 2214031 1630875 0 1.88e2 .74
ethernet-input active 10404 1630875 0 1.96e1 156.75
ip4-input-no-checksum active 18184 3261787 0 3.68e1 179.38
ip4-lookup active 10404 1630912 0 3.39e1 156.76
ip4-rewrite active 10404 1630912 0 2.88e1 156.76
ipsec4-input-feature active 18184 3261787 0 2.20e3 179.38
unix-epoll-input polling 2160 0 0 1.17e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 91.39, last 128 main loops 0.00 per node 0.00
vector rates in 8.2855e5, out 8.2855e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 17845 1631033 0 1.39e1 91.40
FortyGigabitEthernet88/0/0-tx active 17845 1631033 0 5.30e1 91.40
dpdk-crypto-input polling 2598959 1631033 0 4.15e2 .63
dpdk-esp4-encrypt active 17845 1630904 0 2.16e2 91.39
dpdk-input polling 2598959 1630904 0 2.49e2 .63
ethernet-input active 17845 1630904 0 2.12e1 91.39
interface-output active 17845 1631033 0 1.35e1 91.40
ip4-input-no-checksum active 17845 1630904 0 2.79e1 91.39
ip4-lookup active 35690 3261937 0 4.58e1 91.39
ip4-rewrite active 35690 3261937 0 4.06e1 91.39
ipsec4-output-feature active 35690 3261937 0 2.11e3 91.39
unix-epoll-input polling 2536 0 0 1.47e3 0.00
64b-4t4c-ethip4ipsecscale1000tnlsw-ip4base-tnl-aes-gcm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 4.59e5 0.00
dpdk-process any wait 0 0 2 1.45e4 0.00
fib-walk any wait 0 0 2 1.27e4 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 3 1.50e3 0.00
lisp-retry-service any wait 0 0 2 2.40e3 0.00
unix-epoll-input polling 2265 0 0 4.01e6 0.00
vpe-oam-process any wait 0 0 2 1.36e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 256.00, last 128 main loops 26.00 per node 256.00
vector rates in 8.2772e5, out 4.1386e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 6430 1646080 0 1.01e1 256.00
FortyGigabitEthernet88/0/1-tx active 6430 1646080 0 4.49e1 256.00
dpdk-crypto-input polling 6430 1646080 0 3.44e2 256.00
dpdk-esp4-decrypt active 6430 1646080 0 1.55e2 256.00
dpdk-esp4-decrypt-post active 6430 1646080 0 7.52e1 256.00
dpdk-input polling 6430 1646080 0 4.98e1 256.00
ethernet-input active 6430 1646080 0 1.70e1 256.00
ip4-input-no-checksum active 12860 3292160 0 3.43e1 256.00
ip4-lookup active 6430 1646080 0 3.48e1 256.00
ip4-rewrite active 6430 1646080 0 2.85e1 256.00
ipsec4-input-feature active 12860 3292160 0 2.35e3 256.00
unix-epoll-input polling 6 0 0 1.77e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 39887022 0 0 4.98e1 0.00
dpdk-input polling 39887022 0 0 1.04e2 0.00
unix-epoll-input polling 38914 0 0 9.02e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 22)
Time 3.9, average vectors/node 38.38, last 128 main loops 0.00 per node 0.00
vector rates in 4.3109e5, out 4.3109e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 22335 857313 0 2.00e1 38.38
FortyGigabitEthernet88/0/0-tx active 22335 857313 0 5.69e1 38.38
dpdk-crypto-input polling 17914157 857313 0 1.37e3 .05
dpdk-esp4-encrypt active 22335 857292 0 2.52e2 38.38
dpdk-input polling 17914157 857292 0 2.84e3 .05
ethernet-input active 22335 857292 0 3.04e1 38.38
interface-output active 22335 857313 0 1.87e1 38.38
ip4-input-no-checksum active 22335 857292 0 4.00e1 38.38
ip4-lookup active 44670 1714605 0 4.12e1 38.38
ip4-rewrite active 44670 1714605 0 4.86e1 38.38
ipsec4-output-feature active 44670 1714605 0 2.12e3 38.38
unix-epoll-input polling 17478 0 0 1.13e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 23)
Time 3.9, average vectors/node 38.36, last 128 main loops 0.00 per node 0.00
vector rates in 4.3109e5, out 4.3109e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 22350 857337 0 2.15e1 38.36
FortyGigabitEthernet88/0/0-tx active 22350 857337 0 5.93e1 38.36
dpdk-crypto-input polling 20155531 857337 0 1.47e3 .04
dpdk-esp4-encrypt active 22349 857289 0 2.58e2 38.36
dpdk-input polling 20155531 857289 0 2.48e3 .04
ethernet-input active 22349 857289 0 3.18e1 38.36
interface-output active 22350 857337 0 1.92e1 38.36
ip4-input-no-checksum active 22349 857289 0 4.25e1 38.36
ip4-lookup active 44699 1714626 0 4.32e1 38.36
ip4-rewrite active 44699 1714626 0 4.96e1 38.36
ipsec4-output-feature active 44699 1714626 0 2.13e3 38.36
unix-epoll-input polling 19663 0 0 1.15e3 0.00

40ge2p1xl710-ethip4ipsecscale1000tnlsw-ip4base-tnl-cbc-sha1-ndrpdr

IPv4 IPsec tunnel mode performance test suite.

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 on TG-DUTn, Eth-IPv4-IPSec on DUT1-DUT2
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with DPDK SW crypto devices and multiple IPsec tunnels between them. DUTs get IPv4 traffic from TG, encrypt it and send to another DUT, where packets are decrypted and sent back to TG.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, number of flows per flow-group equals to number of IPSec tunnels) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. Incrementing of IP.dst (IPv4 destination address) field is applied to both streams.
  • [Ref] Applicable standard specifications: RFC4303 and RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4ipsecscale1000tnlsw-ip4base-tnl-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 48 3.15e5 0.00
dpdk-process any wait 0 0 2 8.93e3 0.00
fib-walk any wait 0 0 2 1.83e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.39e3 0.00
lisp-retry-service any wait 0 0 2 5.65e3 0.00
unix-epoll-input polling 3388 0 0 2.67e6 0.00
vpe-oam-process any wait 0 0 2 1.19e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 65.52, last 128 main loops 0.00 per node 0.00
vector rates in 7.0742e5, out 5.3029e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 21039 703326 0 1.89e1 33.43
FortyGigabitEthernet88/0/0-tx active 21039 703326 0 5.78e1 33.43
FortyGigabitEthernet88/0/1-out active 10392 679183 0 1.68e1 65.36
FortyGigabitEthernet88/0/1-tx active 10392 679183 0 5.45e1 65.36
dpdk-crypto-input polling 3498785 1382509 0 9.26e2 .39
dpdk-esp4-decrypt active 5927 700618 0 1.53e2 118.21
dpdk-esp4-decrypt-post active 10392 679183 0 8.19e1 65.36
dpdk-esp4-encrypt active 5991 715014 0 2.11e2 119.35
dpdk-input polling 3498785 1415632 0 3.98e2 .40
ethernet-input active 11918 1415632 0 2.19e1 118.78
interface-output active 21039 703326 0 1.91e1 33.43
ip4-input-no-checksum active 18566 2094815 0 3.57e1 112.83
ip4-lookup active 36468 2097523 0 3.89e1 57.52
ip4-rewrite active 36468 2097523 0 4.17e1 57.52
ipsec4-input-feature active 13975 1379801 0 2.33e3 98.73
ipsec4-output-feature active 27030 1418340 0 2.11e3 52.47
unix-epoll-input polling 3414 0 0 1.19e3 0.00
64b-2t2c-ethip4ipsecscale1000tnlsw-ip4base-tnl-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 3.42e5 0.00
dpdk-process any wait 0 0 2 2.07e4 0.00
fib-walk any wait 0 0 2 5.01e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 4.55e3 0.00
lisp-retry-service any wait 0 0 2 9.76e3 0.00
unix-epoll-input polling 4932 0 0 1.84e6 0.00
vpe-oam-process any wait 0 0 2 1.69e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 240.63, last 128 main loops 26.00 per node 256.00
vector rates in 7.9944e5, out 3.9972e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 6624 1585920 0 1.03e1 239.42
FortyGigabitEthernet88/0/1-tx active 6624 1585920 0 4.54e1 239.42
dpdk-crypto-input polling 7729 1585920 0 7.51e2 205.19
dpdk-esp4-decrypt active 6595 1585939 0 1.52e2 240.48
dpdk-esp4-decrypt-post active 6624 1585920 0 7.68e1 239.42
dpdk-input polling 7729 1585939 0 5.06e1 205.19
ethernet-input active 6595 1585939 0 1.79e1 240.48
ip4-input-no-checksum active 13110 3171859 0 3.58e1 241.94
ip4-lookup active 6624 1585920 0 3.43e1 239.42
ip4-rewrite active 6624 1585920 0 3.38e1 239.42
ipsec4-input-feature active 13110 3171859 0 2.24e3 241.94
unix-epoll-input polling 8 0 0 1.61e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 70.61, last 128 main loops 0.00 per node 0.00
vector rates in 7.9999e5, out 7.9999e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 32899 1587000 0 1.53e1 48.24
FortyGigabitEthernet88/0/0-tx active 32899 1587000 0 5.41e1 48.24
dpdk-crypto-input polling 1127569 1587000 0 8.38e2 1.41
dpdk-esp4-encrypt active 12054 1587008 0 2.13e2 131.66
dpdk-input polling 1127569 1587008 0 1.29e2 1.41
ethernet-input active 12054 1587008 0 1.93e1 131.66
interface-output active 32899 1587000 0 1.48e1 48.24
ip4-input-no-checksum active 12054 1587008 0 2.62e1 131.66
ip4-lookup active 44953 3174008 0 4.56e1 70.61
ip4-rewrite active 44953 3174008 0 4.09e1 70.61
ipsec4-output-feature active 44953 3174008 0 2.09e3 70.61
unix-epoll-input polling 1100 0 0 1.43e3 0.00
64b-4t4c-ethip4ipsecscale1000tnlsw-ip4base-tnl-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 5.66e5 0.00
dpdk-process any wait 0 0 2 4.68e5 0.00
fib-walk any wait 0 0 2 2.82e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 2.04e3 0.00
lisp-retry-service any wait 0 0 2 4.74e3 0.00
unix-epoll-input polling 3060 0 0 2.97e6 0.00
vpe-oam-process any wait 0 0 2 2.39e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 256.00, last 128 main loops 26.00 per node 256.00
vector rates in 7.6742e5, out 3.8371e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 5974 1529344 0 9.96e0 256.00
FortyGigabitEthernet88/0/1-tx active 5974 1529344 0 4.49e1 256.00
dpdk-crypto-input polling 5974 1529344 0 7.63e2 256.00
dpdk-esp4-decrypt active 5974 1529344 0 1.52e2 256.00
dpdk-esp4-decrypt-post active 5974 1529344 0 7.72e1 256.00
dpdk-input polling 5974 1529344 0 5.07e1 256.00
ethernet-input active 5974 1529344 0 1.75e1 256.00
ip4-input-no-checksum active 11948 3058688 0 3.42e1 256.00
ip4-lookup active 5974 1529344 0 3.42e1 256.00
ip4-rewrite active 5974 1529344 0 3.34e1 256.00
ipsec4-input-feature active 11948 3058688 0 2.36e3 256.00
unix-epoll-input polling 6 0 0 1.98e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 40983302 0 0 4.62e1 0.00
dpdk-input polling 40983302 0 0 1.03e2 0.00
unix-epoll-input polling 39984 0 0 9.04e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 22)
Time 3.9, average vectors/node 10.24, last 128 main loops 0.00 per node 0.00
vector rates in 3.9241e5, out 3.9241e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 129792 782000 0 5.23e1 6.03
FortyGigabitEthernet88/0/0-tx active 129792 782000 0 9.06e1 6.03
dpdk-crypto-input polling 18897407 782000 0 2.19e3 .04
dpdk-esp4-encrypt active 22972 782000 0 2.49e2 34.04
dpdk-input polling 18897407 782000 0 2.57e3 .04
ethernet-input active 22972 782000 0 3.48e1 34.04
interface-output active 129792 782000 0 4.21e1 6.03
ip4-input-no-checksum active 22972 782000 0 4.54e1 34.04
ip4-lookup active 152764 1564000 0 6.53e1 10.24
ip4-rewrite active 152764 1564000 0 6.95e1 10.24
ipsec4-output-feature active 152764 1564000 0 2.15e3 10.24
unix-epoll-input polling 18437 0 0 1.10e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 23)
Time 3.9, average vectors/node 10.29, last 128 main loops 0.00 per node 0.00
vector rates in 3.9241e5, out 3.9241e5, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 129170 781999 0 5.29e1 6.05
FortyGigabitEthernet88/0/0-tx active 129170 781999 0 9.17e1 6.05
dpdk-crypto-input polling 18983009 781999 0 2.15e3 .04
dpdk-esp4-encrypt active 22802 781999 0 2.59e2 34.29
dpdk-input polling 18983009 781999 0 2.58e3 .04
ethernet-input active 22802 781999 0 3.62e1 34.29
interface-output active 129170 781999 0 4.29e1 6.05
ip4-input-no-checksum active 22802 781999 0 4.94e1 34.29
ip4-lookup active 151972 1563998 0 6.55e1 10.29
ip4-rewrite active 151972 1563998 0 6.96e1 10.29
ipsec4-output-feature active 151972 1563998 0 2.15e3 10.29
unix-epoll-input polling 18520 0 0 1.18e3 0.00

40ge2p1xl710-ethip4ipsectptlispgpe-ip4base-cbc-sha1-ndrpdr

IPv4 IPsec transport mode performance test suite.

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 on TG-DUTn, Eth-IPv4-IPSec-LISPGPE-IPv4 on DUT1-DUT2
  • [Cfg] DUT configuration: Each DUT is configured with LISP and IPsec in each direction. IPsec is in transport mode. DUTs get IPv4 traffic from TG, encrypt it and send to another DUT, where packets are decrypted and sent back to TG.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, number of flows per flow-group equals to number of IPSec tunnels) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces. Incrementing of IP.dst (IPv4 destination address) field is applied to both streams.
  • [Ref] Applicable standard specifications: RFC6830, RFC4303 and RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4ipsectptlispgpe-ip4base-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 47 4.19e4 0.00
dpdk-process any wait 0 0 1 2.25e4 0.00
fib-walk any wait 0 0 2 3.42e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.68e3 0.00
lisp-retry-service any wait 0 0 2 2.82e3 0.00
unix-epoll-input polling 2756 0 0 3.28e6 0.00
vpe-oam-process any wait 0 0 2 1.13e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 94.91, last 128 main loops 12.69 per node 125.00
vector rates in 5.2313e6, out 3.9235e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 51852 5165587 0 1.25e1 99.62
FortyGigabitEthernet88/0/0-tx active 51852 5165587 0 4.56e1 99.62
FortyGigabitEthernet88/0/1-out active 61282 5165392 0 1.46e1 84.29
FortyGigabitEthernet88/0/1-tx active 61282 5165392 0 4.97e1 84.29
adj-midchain-tx active 51126 5165521 0 2.16e1 101.04
dpdk-crypto-input polling 490072 10330979 0 6.12e1 21.08
dpdk-esp4-decrypt active 72807 5165586 0 1.46e2 70.95
dpdk-esp4-decrypt-post active 61282 5165392 0 1.39e2 84.29
dpdk-esp4-encrypt active 51126 5165521 0 2.11e2 101.04
dpdk-input polling 490072 10331107 0 6.39e1 21.08
ethernet-input active 123933 10331107 0 2.28e1 83.36
interface-output active 51852 5165587 0 1.69e1 99.62
ip4-input active 61282 5165392 0 4.31e1 84.29
ip4-input-no-checksum active 123597 15496499 0 3.50e1 125.38
ip4-local active 61282 5165392 0 5.42e1 84.29
ip4-lookup active 149759 15496305 0 3.81e1 103.47
ip4-midchain active 51126 5165521 0 7.56e1 101.04
ip4-rewrite active 112408 10330913 0 3.60e1 91.91
ip4-udp-lookup active 61282 5165392 0 3.30e1 84.29
ipsec4-input-feature active 98978 10330978 0 7.09e1 104.38
ipsec4-output-feature active 51126 5165521 0 6.69e1 101.04
lisp-gpe-ip4-input active 61282 5165392 0 8.43e1 84.29
unix-epoll-input polling 478 0 0 1.43e3 0.00
64b-2t2c-ethip4ipsectptlispgpe-ip4base-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 49 4.55e4 0.00
dpdk-process any wait 0 0 1 9.29e5 0.00
fib-walk any wait 0 0 2 2.08e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 2.54e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.75e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 1.85e3 0.00
lisp-retry-service any wait 0 0 2 1.81e3 0.00
statseg-collector-process time wait 0 0 1 2.76e3 0.00
unix-epoll-input polling 5432 0 0 1.67e6 0.00
vpe-oam-process any wait 0 0 2 1.28e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 127.16, last 128 main loops 24.19 per node 172.00
vector rates in 4.6488e6, out 2.3244e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 77201 9207776 0 1.28e1 119.27
FortyGigabitEthernet88/0/1-tx active 77201 9207776 0 4.77e1 119.27
dpdk-crypto-input polling 99760 9207776 0 5.57e1 92.29
dpdk-esp4-decrypt active 78210 9207895 0 1.43e2 117.73
dpdk-esp4-decrypt-post active 77201 9207776 0 1.38e2 119.27
dpdk-input polling 99760 9207895 0 5.33e1 92.30
ethernet-input active 78210 9207895 0 2.22e1 117.73
ip4-input active 77201 9207776 0 3.89e1 119.27
ip4-input-no-checksum active 117455 18415671 0 3.57e1 156.79
ip4-local active 77201 9207776 0 5.05e1 119.27
ip4-lookup active 154402 18415552 0 3.73e1 119.27
ip4-rewrite active 77201 9207776 0 2.89e1 119.27
ip4-udp-lookup active 77201 9207776 0 3.05e1 119.27
ipsec4-input-feature active 117455 18415671 0 6.82e1 156.79
lisp-gpe-ip4-input active 77201 9207776 0 8.05e1 119.27
unix-epoll-input polling 97 0 0 1.43e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 33.01, last 128 main loops 0.00 per node 0.00
vector rates in 4.6487e6, out 4.6487e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 697460 9207709 0 2.83e1 13.20
FortyGigabitEthernet88/0/0-tx active 697460 9207709 0 5.75e1 13.20
adj-midchain-tx active 159395 9207692 0 2.08e1 57.77
dpdk-crypto-input polling 8142715 9207709 0 1.34e2 1.13
dpdk-esp4-encrypt active 159395 9207692 0 2.11e2 57.77
dpdk-input polling 8142715 9207692 0 1.50e2 1.13
ethernet-input active 159395 9207692 0 2.21e1 57.77
interface-output active 697460 9207709 0 3.03e1 13.20
ip4-input-no-checksum active 159395 9207692 0 2.82e1 57.77
ip4-lookup active 159395 9207692 0 4.64e1 57.77
ip4-midchain active 159395 9207692 0 7.59e1 57.77
ip4-rewrite active 159395 9207692 0 4.13e1 57.77
ipsec4-output-feature active 159395 9207692 0 7.19e1 57.77
unix-epoll-input polling 7944 0 0 1.41e3 0.00
64b-4t4c-ethip4ipsectptlispgpe-ip4base-cbc-sha1-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 19)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 5.05e4 0.00
dpdk-process any wait 0 0 2 4.95e5 0.00
fib-walk any wait 0 0 2 3.43e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 2.07e3 0.00
lisp-retry-service any wait 0 0 2 3.06e3 0.00
unix-epoll-input polling 3720 0 0 2.43e6 0.00
vpe-oam-process any wait 0 0 2 8.86e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 20)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-crypto-input polling 40955749 0 0 4.73e1 0.00
dpdk-input polling 40955749 0 0 1.02e2 0.00
unix-epoll-input polling 39957 0 0 9.01e2 0.00
—————
Thread 2 vpp_wk_1 (lcore 21)
Time 3.9, average vectors/node 172.88, last 128 main loops 29.09 per node 206.83
vector rates in 4.6577e6, out 2.3288e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/1-out active 54221 9202141 0 1.15e1 169.72
FortyGigabitEthernet88/0/1-tx active 54221 9202141 0 4.81e1 169.72
dpdk-crypto-input polling 56551 9202141 0 5.99e1 162.72
dpdk-esp4-decrypt active 54520 9202206 0 1.44e2 168.79
dpdk-esp4-decrypt-post active 54221 9202141 0 1.43e2 169.72
dpdk-input polling 56551 9202206 0 5.13e1 162.72
ethernet-input active 54520 9202206 0 2.14e1 168.79
ip4-input active 54221 9202141 0 3.63e1 169.72
ip4-input-no-checksum active 100702 18404347 0 3.59e1 182.76
ip4-local active 54221 9202141 0 4.81e1 169.72
ip4-lookup active 108442 18404282 0 3.53e1 169.72
ip4-rewrite active 54221 9202141 0 2.72e1 169.72
ip4-udp-lookup active 54221 9202141 0 3.01e1 169.72
ipsec4-input-feature active 100702 18404347 0 7.01e1 182.76
lisp-gpe-ip4-input active 54221 9202141 0 7.95e1 169.72
unix-epoll-input polling 55 0 0 1.55e3 0.00
—————
Thread 3 vpp_wk_2 (lcore 22)
Time 3.9, average vectors/node 15.57, last 128 main loops 0.00 per node 0.00
vector rates in 2.3196e6, out 2.3196e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 702729 4582912 0 4.64e1 6.52
FortyGigabitEthernet88/0/0-tx active 702729 4582912 0 7.11e1 6.52
adj-midchain-tx active 177560 4582917 0 2.47e1 25.81
dpdk-crypto-input polling 19297767 4582912 0 3.57e2 .24
dpdk-esp4-encrypt active 177560 4582917 0 3.03e2 25.81
dpdk-input polling 19297767 4582917 0 4.99e2 .24
ethernet-input active 177560 4582917 0 3.01e1 25.81
interface-output active 702729 4582912 0 4.54e1 6.52
ip4-input-no-checksum active 177560 4582917 0 3.73e1 25.81
ip4-lookup active 177560 4582917 0 4.06e1 25.81
ip4-midchain active 177560 4582917 0 8.52e1 25.81
ip4-rewrite active 177560 4582917 0 4.82e1 25.81
ipsec4-output-feature active 177560 4582917 0 7.30e1 25.81
unix-epoll-input polling 18827 0 0 1.31e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 23)
Time 3.9, average vectors/node 15.58, last 128 main loops 0.00 per node 0.00
vector rates in 2.3380e6, out 2.3380e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
FortyGigabitEthernet88/0/0-out active 724562 4619267 0 4.82e1 6.38
FortyGigabitEthernet88/0/0-tx active 724562 4619267 0 7.35e1 6.38
adj-midchain-tx active 174212 4619290 0 2.45e1 26.52
dpdk-crypto-input polling 18626660 4619267 0 3.46e2 .25
dpdk-esp4-encrypt active 174212 4619290 0 3.04e2 26.52
dpdk-input polling 18626660 4619290 0 4.96e2 .25
ethernet-input active 174212 4619290 0 3.04e1 26.52
interface-output active 724562 4619267 0 4.55e1 6.38
ip4-input-no-checksum active 174212 4619290 0 3.91e1 26.52
ip4-lookup active 174212 4619290 0 4.04e1 26.52
ip4-midchain active 174212 4619290 0 8.55e1 26.52
ip4-rewrite active 174212 4619290 0 4.79e1 26.52
ipsec4-output-feature active 174212 4619290 0 7.29e1 26.52
unix-epoll-input polling 18172 0 0 1.43e3 0.00

ip4

10ge2p1x520-ethip4udp-ip4base-oacl1sf-10kflows-ndrpdr

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4 routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 10k flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4udp-ip4base-oacl1sf-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 16 1.53e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 9.79e2 0.00
api-rx-from-ring active 0 0 49 6.06e4 0.00
dpdk-process any wait 0 0 1 3.51e4 0.00
fib-walk any wait 0 0 2 1.49e4 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 4.63e3 0.00
lisp-retry-service any wait 0 0 2 6.26e3 0.00
unix-epoll-input polling 5813 0 0 1.55e6 0.00
vpe-oam-process any wait 0 0 2 8.94e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 252.09, last 128 main loops 36.00 per node 271.06
vector rates in 7.2653e6, out 7.2653e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 56764 14308257 0 9.43e0 252.07
TenGigabitEtherneta/0/0-tx active 56764 14308257 0 4.31e1 252.07
TenGigabitEtherneta/0/1-output active 56760 14308352 0 9.86e0 252.09
TenGigabitEtherneta/0/1-tx active 56760 14308352 0 4.33e1 252.09
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.80e3 0.00
acl-plugin-out-ip4-fa active 113511 28616609 0 1.04e2 252.10
dpdk-input polling 56765 28616609 0 4.63e1 504.12
ethernet-input active 113524 28616609 0 1.52e1 252.08
interface-output active 113511 28616609 0 1.19e1 252.10
ip4-input-no-checksum active 113511 28616609 0 1.97e1 252.10
ip4-lookup active 113511 28616609 0 2.94e1 252.10
ip4-rewrite active 113511 28616609 0 3.54e1 252.10
unix-epoll-input polling 55 0 0 2.49e3 0.00
64b-2t2c-ethip4udp-ip4base-oacl1sf-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 16 4.78e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.07e3 0.00
api-rx-from-ring active 0 0 52 3.65e4 0.00
dpdk-process any wait 0 0 2 3.49e4 0.00
fib-walk any wait 0 0 2 1.20e4 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 5.27e3 0.00
lisp-retry-service any wait 0 0 2 5.82e3 0.00
unix-epoll-input polling 9234 0 0 9.83e5 0.00
vpe-oam-process any wait 0 0 2 1.28e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 219.97, last 128 main loops 16.73 per node 238.00
vector rates in 7.1563e6, out 7.1563e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 129215 28423666 0 9.79e0 219.97
TenGigabitEtherneta/0/1-tx active 129215 28423666 0 4.14e1 219.97
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.64e3 0.00
acl-plugin-out-ip4-fa active 129215 28423666 0 1.04e2 219.97
dpdk-input polling 131050 28423666 0 4.72e1 216.89
ethernet-input active 129215 28423666 0 1.58e1 219.97
interface-output active 129215 28423666 0 1.07e1 219.97
ip4-input-no-checksum active 129215 28423666 0 2.12e1 219.97
ip4-lookup active 129215 28423666 0 3.23e1 219.97
ip4-rewrite active 129215 28423666 0 3.69e1 219.97
unix-epoll-input polling 128 0 0 2.40e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 256.00, last 128 main loops 18.00 per node 256.00
vector rates in 7.1559e6, out 7.1559e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 111024 28422144 0 9.72e0 256.00
TenGigabitEtherneta/0/0-tx active 111024 28422144 0 4.11e1 256.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.95e3 0.00
acl-plugin-out-ip4-fa active 111024 28422144 0 1.07e2 256.00
dpdk-input polling 111024 28422144 0 4.47e1 256.00
ethernet-input active 111024 28422144 0 1.53e1 256.00
interface-output active 111024 28422144 0 1.09e1 256.00
ip4-input-no-checksum active 111024 28422144 0 2.01e1 256.00
ip4-lookup active 111024 28422144 0 3.31e1 256.00
ip4-rewrite active 111024 28422144 0 3.78e1 256.00
unix-epoll-input polling 109 0 0 2.51e3 0.00
64b-4t4c-ethip4udp-ip4base-oacl1sf-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 16 3.08e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 9.02e2 0.00
api-rx-from-ring active 0 0 36 3.46e4 0.00
dpdk-process any wait 0 0 1 3.19e4 0.00
fib-walk any wait 0 0 2 1.40e4 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 6.94e3 0.00
lisp-retry-service any wait 0 0 2 3.04e3 0.00
unix-epoll-input polling 6484 0 0 1.39e6 0.00
vpe-oam-process any wait 0 0 2 1.11e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 35.03, last 128 main loops 2.25 per node 32.00
vector rates in 5.8508e6, out 5.8508e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 660558 23138896 0 1.66e1 35.03
TenGigabitEtherneta/0/1-tx active 660558 23138896 0 4.28e1 35.03
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.51e3 0.00
acl-plugin-out-ip4-fa active 660558 23138896 0 1.20e2 35.03
dpdk-input polling 665777 23138896 0 5.95e1 34.75
ethernet-input active 660558 23138896 0 2.26e1 35.03
interface-output active 660558 23138896 0 1.61e1 35.03
ip4-input-no-checksum active 660558 23138896 0 2.99e1 35.03
ip4-lookup active 660558 23138896 0 3.95e1 35.03
ip4-rewrite active 660558 23138896 0 4.21e1 35.03
unix-epoll-input polling 650 0 0 2.39e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 34.11, last 128 main loops 312.47 per node 34.72
vector rates in 5.8508e6, out 5.8508e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 678423 23138904 0 1.69e1 34.11
TenGigabitEtherneta/0/1-tx active 678423 23138904 0 4.34e1 34.11
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.67e3 0.00
acl-plugin-out-ip4-fa active 678423 23138904 0 1.18e2 34.11
dpdk-input polling 684559 23138904 0 5.94e1 33.80
ethernet-input active 678423 23138904 0 2.33e1 34.11
interface-output active 678423 23138904 0 1.61e1 34.11
ip4-input-no-checksum active 678423 23138904 0 3.01e1 34.11
ip4-lookup active 678423 23138904 0 4.01e1 34.11
ip4-rewrite active 678423 23138904 0 4.20e1 34.11
unix-epoll-input polling 668 0 0 2.48e3 0.00
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 3.9, average vectors/node 30.68, last 128 main loops 2.04 per node 29.00
vector rates in 5.8508e6, out 5.8508e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 754083 23138884 0 1.74e1 30.68
TenGigabitEtherneta/0/0-tx active 754083 23138884 0 4.34e1 30.68
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.79e3 0.00
acl-plugin-out-ip4-fa active 754083 23138884 0 1.16e2 30.68
dpdk-input polling 756231 23138884 0 6.08e1 30.59
ethernet-input active 754083 23138884 0 2.38e1 30.68
interface-output active 754083 23138884 0 1.69e1 30.68
ip4-input-no-checksum active 754083 23138884 0 3.09e1 30.68
ip4-lookup active 754083 23138884 0 3.73e1 30.68
ip4-rewrite active 754083 23138884 0 4.24e1 30.68
unix-epoll-input polling 738 0 0 2.34e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 3.9, average vectors/node 33.89, last 128 main loops 2.81 per node 40.00
vector rates in 5.8508e6, out 5.8508e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 682759 23138881 0 1.71e1 33.89
TenGigabitEtherneta/0/0-tx active 682759 23138881 0 4.35e1 33.89
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.61e3 0.00
acl-plugin-out-ip4-fa active 682759 23138881 0 1.17e2 33.89
dpdk-input polling 684353 23138881 0 6.46e1 33.81
ethernet-input active 682759 23138881 0 2.27e1 33.89
interface-output active 682759 23138881 0 1.60e1 33.89
ip4-input-no-checksum active 682759 23138881 0 3.02e1 33.89
ip4-lookup active 682759 23138881 0 3.63e1 33.89
ip4-rewrite active 682759 23138881 0 4.17e1 33.89
unix-epoll-input polling 667 0 0 2.55e3 0.00

10ge2p1x520-ethip4udp-ip4base-oacl1sl-10kflows-ndrpdr

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4 routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 10k flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4udp-ip4base-oacl1sl-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 16 4.95e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 9.97e2 0.00
api-rx-from-ring active 0 0 52 4.93e4 0.00
dpdk-process any wait 0 0 1 1.61e6 0.00
fib-walk any wait 0 0 2 1.08e4 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 5.23e3 0.00
lisp-retry-service any wait 0 0 2 3.95e3 0.00
unix-epoll-input polling 7700 0 0 1.17e6 0.00
vpe-oam-process any wait 0 0 2 1.18e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 247.12, last 128 main loops 36.00 per node 271.06
vector rates in 5.8924e6, out 5.8924e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 47042 11622674 0 9.33e0 247.07
TenGigabitEtherneta/0/0-tx active 47042 11622674 0 4.28e1 247.07
TenGigabitEtherneta/0/1-output active 47042 11622688 0 9.72e0 247.07
TenGigabitEtherneta/0/1-tx active 47042 11622688 0 4.22e1 247.07
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.55e3 0.00
acl-plugin-out-ip4-fa active 94060 23245362 0 1.77e2 247.13
dpdk-input polling 47042 23245362 0 4.64e1 494.14
ethernet-input active 94084 23245362 0 1.52e1 247.07
interface-output active 94060 23245362 0 1.13e1 247.13
ip4-input-no-checksum active 94060 23245362 0 1.97e1 247.13
ip4-lookup active 94060 23245362 0 3.18e1 247.13
ip4-rewrite active 94060 23245362 0 3.54e1 247.13
unix-epoll-input polling 46 0 0 1.56e3 0.00
64b-2t2c-ethip4udp-ip4base-oacl1sl-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 16 3.19e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.02e3 0.00
api-rx-from-ring active 0 0 52 5.17e4 0.00
dhcp-client-process any wait 0 0 1 1.65e4 0.00
dpdk-process any wait 0 0 1 1.78e6 0.00
fib-walk any wait 0 0 2 1.03e4 0.00
ip-route-resolver-process any wait 0 0 1 2.64e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 1.77e4 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 5.06e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 5.57e3 0.00
lisp-retry-service any wait 0 0 2 3.83e3 0.00
statseg-collector-process time wait 0 0 1 8.59e3 0.00
unix-epoll-input polling 7570 0 0 1.19e6 0.00
vpe-oam-process any wait 0 0 2 1.21e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 230.51, last 128 main loops 1.13 per node 16.00
vector rates in 5.9335e6, out 5.9335e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 102180 23553024 0 9.50e0 230.51
TenGigabitEtherneta/0/1-tx active 102180 23553024 0 3.97e1 230.51
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.44e3 0.00
acl-plugin-out-ip4-fa active 102180 23553024 0 1.76e2 230.51
dpdk-input polling 103569 23553024 0 4.68e1 227.41
ethernet-input active 102180 23553024 0 1.47e1 230.51
interface-output active 102180 23553024 0 1.07e1 230.51
ip4-input-no-checksum active 102180 23553024 0 2.01e1 230.51
ip4-lookup active 102180 23553024 0 3.17e1 230.51
ip4-rewrite active 102180 23553024 0 3.65e1 230.51
unix-epoll-input polling 101 0 0 1.47e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 241.38, last 128 main loops 18.00 per node 256.00
vector rates in 5.9334e6, out 5.9334e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 97575 23552747 0 9.53e0 241.38
TenGigabitEtherneta/0/0-tx active 97575 23552747 0 3.99e1 241.38
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.31e3 0.00
acl-plugin-out-ip4-fa active 97575 23552747 0 1.77e2 241.38
dpdk-input polling 97575 23552747 0 4.48e1 241.38
ethernet-input active 97575 23552747 0 1.45e1 241.38
interface-output active 97575 23552747 0 1.06e1 241.38
ip4-input-no-checksum active 97575 23552747 0 2.02e1 241.38
ip4-lookup active 97575 23552747 0 3.31e1 241.38
ip4-rewrite active 97575 23552747 0 3.59e1 241.38
unix-epoll-input polling 95 0 0 1.46e3 0.00
64b-4t4c-ethip4udp-ip4base-oacl1sl-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 16 3.00e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.05e3 0.00
api-rx-from-ring active 0 0 51 4.56e4 0.00
dpdk-process any wait 0 0 1 3.53e4 0.00
fib-walk any wait 0 0 2 2.82e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 2.14e3 0.00
lisp-retry-service any wait 0 0 2 9.79e3 0.00
unix-epoll-input polling 7831 0 0 1.15e6 0.00
vpe-oam-process any wait 0 0 2 9.16e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 84.78, last 128 main loops 3.73 per node 53.00
vector rates in 4.7434e6, out 4.7434e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 221266 18758197 0 1.22e1 84.78
TenGigabitEtherneta/0/1-tx active 221266 18758197 0 4.02e1 84.78
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.34e3 0.00
acl-plugin-out-ip4-fa active 221266 18758197 0 2.49e2 84.78
dpdk-input polling 224812 18758197 0 5.07e1 83.44
ethernet-input active 221266 18758197 0 1.85e1 84.78
interface-output active 221266 18758197 0 1.27e1 84.78
ip4-input-no-checksum active 221266 18758197 0 2.49e1 84.78
ip4-lookup active 221266 18758197 0 3.39e1 84.78
ip4-rewrite active 221266 18758197 0 3.88e1 84.78
unix-epoll-input polling 220 0 0 1.35e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 86.97, last 128 main loops 7.88 per node 112.00
vector rates in 4.7435e6, out 4.7435e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 215676 18758308 0 1.42e1 86.97
TenGigabitEtherneta/0/1-tx active 215676 18758308 0 4.07e1 86.97
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.43e3 0.00
acl-plugin-out-ip4-fa active 215676 18758308 0 2.48e2 86.97
dpdk-input polling 219819 18758308 0 4.97e1 85.34
ethernet-input active 215676 18758308 0 1.87e1 86.97
interface-output active 215676 18758308 0 1.25e1 86.97
ip4-input-no-checksum active 215676 18758308 0 2.48e1 86.97
ip4-lookup active 215676 18758308 0 3.45e1 86.97
ip4-rewrite active 215676 18758308 0 3.88e1 86.97
unix-epoll-input polling 214 0 0 1.41e3 0.00
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 3.9, average vectors/node 119.17, last 128 main loops 12.73 per node 181.00
vector rates in 4.7436e6, out 4.7436e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 157413 18758824 0 1.11e1 119.17
TenGigabitEtherneta/0/0-tx active 157413 18758824 0 3.95e1 119.17
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.54e3 0.00
acl-plugin-out-ip4-fa active 157413 18758824 0 2.64e2 119.17
dpdk-input polling 157443 18758824 0 4.69e1 119.15
ethernet-input active 157413 18758824 0 1.68e1 119.17
interface-output active 157413 18758824 0 1.22e1 119.17
ip4-input-no-checksum active 157413 18758824 0 2.31e1 119.17
ip4-lookup active 157413 18758824 0 3.09e1 119.17
ip4-rewrite active 157413 18758824 0 3.73e1 119.17
unix-epoll-input polling 154 0 0 1.33e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 3.9, average vectors/node 143.64, last 128 main loops 1296.98 per node 144.11
vector rates in 4.7436e6, out 4.7436e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 130593 18758820 0 1.07e1 143.64
TenGigabitEtherneta/0/0-tx active 130593 18758820 0 4.12e1 143.64
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.61e3 0.00
acl-plugin-out-ip4-fa active 130593 18758820 0 2.64e2 143.64
dpdk-input polling 130615 18758820 0 5.06e1 143.62
ethernet-input active 130593 18758820 0 1.66e1 143.64
interface-output active 130593 18758820 0 1.15e1 143.64
ip4-input-no-checksum active 130593 18758820 0 2.23e1 143.64
ip4-lookup active 130593 18758820 0 2.92e1 143.64
ip4-rewrite active 130593 18758820 0 3.66e1 143.64
unix-epoll-input polling 127 0 0 1.41e3 0.00

10ge2p1x520-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4 routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 10k flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 16 2.33e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.14e3 0.00
api-rx-from-ring active 0 0 50 5.82e4 0.00
dpdk-process any wait 0 0 1 1.65e6 0.00
fib-walk any wait 0 0 2 3.37e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 3.81e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 6.67e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 5.16e3 0.00
lisp-retry-service any wait 0 0 2 1.40e4 0.00
statseg-collector-process time wait 0 0 1 2.90e4 0.00
unix-epoll-input polling 6337 0 0 1.43e6 0.00
vpe-oam-process any wait 0 0 2 7.77e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 251.08, last 128 main loops 36.00 per node 271.06
vector rates in 7.2349e6, out 7.2349e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 56962 14296576 0 9.44e0 250.98
TenGigabitEtherneta/0/0-tx active 56962 14296576 0 4.35e1 250.98
TenGigabitEtherneta/0/1-output active 56961 14296576 0 9.96e0 250.99
TenGigabitEtherneta/0/1-tx active 56961 14296576 0 4.32e1 250.99
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.89e3 0.00
acl-plugin-out-ip4-fa active 113866 28593152 0 1.05e2 251.11
dpdk-input polling 56962 28593152 0 4.63e1 501.97
ethernet-input active 113923 28593152 0 1.53e1 250.99
interface-output active 113866 28593152 0 1.19e1 251.11
ip4-input-no-checksum active 113866 28593152 0 1.98e1 251.11
ip4-lookup active 113866 28593152 0 2.96e1 251.11
ip4-rewrite active 113866 28593152 0 3.55e1 251.11
unix-epoll-input polling 56 0 0 2.73e3 0.00
64b-2t2c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 16 3.04e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.17e3 0.00
api-rx-from-ring active 0 0 50 3.68e4 0.00
dpdk-process any wait 0 0 2 1.68e4 0.00
fib-walk any wait 0 0 2 1.94e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 4.39e3 0.00
lisp-retry-service any wait 0 0 2 1.08e4 0.00
unix-epoll-input polling 5373 0 0 1.68e6 0.00
vpe-oam-process any wait 0 0 2 1.14e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 230.03, last 128 main loops 18.00 per node 256.00
vector rates in 7.2104e6, out 7.2104e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 123975 28517716 0 9.64e0 230.03
TenGigabitEtherneta/0/1-tx active 123975 28517716 0 4.09e1 230.03
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.88e3 0.00
acl-plugin-out-ip4-fa active 123975 28517716 0 1.04e2 230.03
dpdk-input polling 125771 28517716 0 4.71e1 226.74
ethernet-input active 123975 28517716 0 1.51e1 230.03
interface-output active 123975 28517716 0 1.07e1 230.03
ip4-input-no-checksum active 123975 28517716 0 2.10e1 230.03
ip4-lookup active 123975 28517716 0 3.22e1 230.03
ip4-rewrite active 123975 28517716 0 3.67e1 230.03
unix-epoll-input polling 123 0 0 2.49e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 255.61, last 128 main loops 18.00 per node 256.00
vector rates in 7.2103e6, out 7.2103e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 111565 28517376 0 9.99e0 255.61
TenGigabitEtherneta/0/0-tx active 111565 28517376 0 4.13e1 255.61
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.67e3 0.00
acl-plugin-out-ip4-fa active 111565 28517376 0 1.07e2 255.61
dpdk-input polling 111565 28517376 0 4.45e1 255.61
ethernet-input active 111565 28517376 0 1.49e1 255.61
interface-output active 111565 28517376 0 1.06e1 255.61
ip4-input-no-checksum active 111565 28517376 0 1.99e1 255.61
ip4-lookup active 111565 28517376 0 3.25e1 255.61
ip4-rewrite active 111565 28517376 0 3.60e1 255.61
unix-epoll-input polling 109 0 0 2.31e3 0.00
64b-4t4c-ethip4udp-ip4base-oacl50sf-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 16 6.20e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.11e3 0.00
api-rx-from-ring active 0 0 42 2.92e4 0.00
dhcp-client-process any wait 0 0 1 3.62e3 0.00
dpdk-process any wait 0 0 2 1.06e6 0.00
fib-walk any wait 0 0 2 7.22e3 0.00
ip-route-resolver-process any wait 0 0 1 2.49e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 1.98e4 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 5.34e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 6.50e3 0.00
lisp-retry-service any wait 0 0 2 1.39e4 0.00
statseg-collector-process time wait 0 0 1 7.44e3 0.00
unix-epoll-input polling 5785 0 0 1.57e6 0.00
vpe-oam-process any wait 0 0 2 9.05e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 34.84, last 128 main loops 2.67 per node 38.00
vector rates in 5.8490e6, out 5.8490e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 667288 23249762 0 1.66e1 34.84
TenGigabitEtherneta/0/1-tx active 667288 23249762 0 4.28e1 34.84
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.63e3 0.00
acl-plugin-out-ip4-fa active 667288 23249762 0 1.19e2 34.84
dpdk-input polling 672201 23249762 0 6.01e1 34.59
ethernet-input active 667288 23249762 0 2.25e1 34.84
interface-output active 667288 23249762 0 1.62e1 34.84
ip4-input-no-checksum active 667288 23249762 0 2.98e1 34.84
ip4-lookup active 667288 23249762 0 3.95e1 34.84
ip4-rewrite active 667288 23249762 0 4.22e1 34.84
unix-epoll-input polling 655 0 0 2.46e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 34.48, last 128 main loops 2.25 per node 32.00
vector rates in 5.8490e6, out 5.8490e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 674292 23249764 0 1.69e1 34.48
TenGigabitEtherneta/0/1-tx active 674292 23249764 0 4.32e1 34.48
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 2.26e3 0.00
acl-plugin-out-ip4-fa active 674292 23249764 0 1.17e2 34.48
dpdk-input polling 680043 23249764 0 5.95e1 34.19
ethernet-input active 674292 23249764 0 2.36e1 34.48
interface-output active 674292 23249764 0 1.65e1 34.48
ip4-input-no-checksum active 674292 23249764 0 3.05e1 34.48
ip4-lookup active 674292 23249764 0 3.97e1 34.48
ip4-rewrite active 674292 23249764 0 4.25e1 34.48
unix-epoll-input polling 664 0 0 2.53e3 0.00
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 3.9, average vectors/node 32.09, last 128 main loops 2.53 per node 36.00
vector rates in 5.8490e6, out 5.8490e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 724361 23249764 0 1.74e1 32.09
TenGigabitEtherneta/0/0-tx active 724361 23249764 0 4.29e1 32.09
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 2.62e3 0.00
acl-plugin-out-ip4-fa active 724361 23249764 0 1.16e2 32.09
dpdk-input polling 724528 23249764 0 5.94e1 32.09
ethernet-input active 724361 23249764 0 2.63e1 32.09
interface-output active 724361 23249764 0 1.65e1 32.09
ip4-input-no-checksum active 724361 23249764 0 3.09e1 32.09
ip4-lookup active 724361 23249764 0 3.67e1 32.09
ip4-rewrite active 724361 23249764 0 4.28e1 32.09
unix-epoll-input polling 706 0 0 2.29e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 3.9, average vectors/node 34.05, last 128 main loops 1.97 per node 28.00
vector rates in 5.8490e6, out 5.8490e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 682830 23249776 0 1.70e1 34.05
TenGigabitEtherneta/0/0-tx active 682830 23249776 0 4.36e1 34.05
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 2.21e3 0.00
acl-plugin-out-ip4-fa active 682830 23249776 0 1.17e2 34.05
dpdk-input polling 682919 23249776 0 6.49e1 34.04
ethernet-input active 682830 23249776 0 2.27e1 34.05
interface-output active 682830 23249776 0 1.63e1 34.05
ip4-input-no-checksum active 682830 23249776 0 2.98e1 34.05
ip4-lookup active 682830 23249776 0 3.60e1 34.05
ip4-rewrite active 682830 23249776 0 4.20e1 34.05
unix-epoll-input polling 666 0 0 2.39e3 0.00

10ge2p1x520-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr

RFC2544: Packet throughput IPv4 test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for IPv4 routing.
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv4 routing and one static IPv4 /24 route entries. Required ACL rules are applied to output paths of both DUT1 intefaces. DUT1 and DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 10k flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 16 2.66e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 9.14e2 0.00
api-rx-from-ring active 0 0 51 7.44e4 0.00
dpdk-process any wait 0 0 1 2.21e4 0.00
fib-walk any wait 0 0 2 3.40e3 0.00
ip-neighbor-scan-process any wait 0 0 1 1.55e4 0.00
ip4-reassembly-expire-walk any wait 0 0 1 4.19e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 3.86e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 4.05e3 0.00
lisp-retry-service any wait 0 0 2 1.98e4 0.00
statseg-collector-process time wait 0 0 1 2.69e4 0.00
unix-epoll-input polling 6122 0 0 1.48e6 0.00
vpe-oam-process any wait 0 0 2 7.06e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 248.33, last 128 main loops 36.00 per node 271.06
vector rates in 5.8670e6, out 5.8670e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 46860 11636239 0 9.34e0 248.32
TenGigabitEtherneta/0/0-tx active 46860 11636239 0 4.26e1 248.32
TenGigabitEtherneta/0/1-output active 46859 11636480 0 9.78e0 248.33
TenGigabitEtherneta/0/1-tx active 46859 11636480 0 4.23e1 248.33
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.52e3 0.00
acl-plugin-out-ip4-fa active 93718 23272719 0 1.81e2 248.33
dpdk-input polling 46860 23272719 0 4.64e1 496.64
ethernet-input active 93719 23272719 0 1.52e1 248.32
interface-output active 93718 23272719 0 1.13e1 248.33
ip4-input-no-checksum active 93718 23272719 0 1.97e1 248.33
ip4-lookup active 93718 23272719 0 2.94e1 248.33
ip4-rewrite active 93718 23272719 0 3.55e1 248.33
unix-epoll-input polling 45 0 0 1.52e3 0.00
64b-2t2c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 16 2.62e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.08e3 0.00
api-rx-from-ring active 0 0 52 3.60e4 0.00
dpdk-process any wait 0 0 1 1.79e6 0.00
fib-walk any wait 0 0 2 1.12e4 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 2.64e3 0.00
lisp-retry-service any wait 0 0 2 3.47e3 0.00
unix-epoll-input polling 6358 0 0 1.41e6 0.00
vpe-oam-process any wait 0 0 2 1.72e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 236.54, last 128 main loops 17.51 per node 249.00
vector rates in 5.8656e6, out 5.8656e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 97576 23080192 0 9.54e0 236.54
TenGigabitEtherneta/0/1-tx active 97576 23080192 0 3.95e1 236.54
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.42e3 0.00
acl-plugin-out-ip4-fa active 97576 23080192 0 1.81e2 236.54
dpdk-input polling 99299 23080192 0 4.64e1 232.43
ethernet-input active 97576 23080192 0 1.44e1 236.54
interface-output active 97576 23080192 0 1.05e1 236.54
ip4-input-no-checksum active 97576 23080192 0 2.00e1 236.54
ip4-lookup active 97576 23080192 0 3.19e1 236.54
ip4-rewrite active 97576 23080192 0 3.64e1 236.54
unix-epoll-input polling 97 0 0 1.45e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 236.53, last 128 main loops 18.00 per node 256.00
vector rates in 5.8656e6, out 5.8656e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 97578 23080192 0 9.49e0 236.53
TenGigabitEtherneta/0/0-tx active 97578 23080192 0 3.98e1 236.53
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.35e3 0.00
acl-plugin-out-ip4-fa active 97578 23080192 0 1.81e2 236.53
dpdk-input polling 97578 23080192 0 4.50e1 236.53
ethernet-input active 97578 23080192 0 1.49e1 236.53
interface-output active 97578 23080192 0 1.06e1 236.53
ip4-input-no-checksum active 97578 23080192 0 2.02e1 236.53
ip4-lookup active 97578 23080192 0 3.27e1 236.53
ip4-rewrite active 97578 23080192 0 3.60e1 236.53
unix-epoll-input polling 96 0 0 1.35e3 0.00
64b-4t4c-ethip4udp-ip4base-oacl50sl-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 16 4.46e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 9.49e2 0.00
api-rx-from-ring active 0 0 52 4.33e4 0.00
dpdk-process any wait 0 0 1 1.96e6 0.00
fib-walk any wait 0 0 2 3.46e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 3.30e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 8.14e2 0.00
ip6-reassembly-expire-walk any wait 0 0 1 1.16e4 0.00
lisp-retry-service any wait 0 0 2 9.11e3 0.00
statseg-collector-process time wait 0 0 1 1.62e4 0.00
unix-epoll-input polling 5556 0 0 1.63e6 0.00
vpe-oam-process any wait 0 0 2 1.14e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 58.48, last 128 main loops 5.34 per node 76.00
vector rates in 4.5795e6, out 4.5795e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 309658 18109251 0 1.38e1 58.48
TenGigabitEtherneta/0/1-tx active 309658 18109251 0 4.13e1 58.48
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 2.50e3 0.00
acl-plugin-out-ip4-fa active 309658 18109251 0 2.51e2 58.48
dpdk-input polling 314432 18109251 0 5.37e1 57.59
ethernet-input active 309658 18109251 0 2.04e1 58.48
interface-output active 309658 18109251 0 1.41e1 58.48
ip4-input-no-checksum active 309658 18109251 0 2.76e1 58.48
ip4-lookup active 309658 18109251 0 3.59e1 58.48
ip4-rewrite active 309658 18109251 0 4.13e1 58.48
unix-epoll-input polling 306 0 0 1.34e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 57.69, last 128 main loops 4.64 per node 66.00
vector rates in 4.5795e6, out 4.5795e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 313859 18109224 0 1.40e1 57.69
TenGigabitEtherneta/0/1-tx active 313859 18109224 0 4.16e1 57.69
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.38e3 0.00
acl-plugin-out-ip4-fa active 313859 18109224 0 2.49e2 57.69
dpdk-input polling 317698 18109224 0 5.36e1 57.00
ethernet-input active 313859 18109224 0 2.09e1 57.69
interface-output active 313859 18109224 0 1.41e1 57.69
ip4-input-no-checksum active 313859 18109224 0 2.77e1 57.69
ip4-lookup active 313859 18109224 0 3.64e1 57.69
ip4-rewrite active 313859 18109224 0 4.15e1 57.69
unix-epoll-input polling 310 0 0 1.33e3 0.00
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 3.9, average vectors/node 127.88, last 128 main loops 14.27 per node 203.00
vector rates in 4.5795e6, out 4.5795e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 141615 18109204 0 1.12e1 127.88
TenGigabitEtherneta/0/0-tx active 141615 18109204 0 3.94e1 127.88
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.77e3 0.00
acl-plugin-out-ip4-fa active 141615 18109204 0 2.83e2 127.88
dpdk-input polling 141618 18109204 0 4.70e1 127.87
ethernet-input active 141615 18109204 0 1.66e1 127.88
interface-output active 141615 18109204 0 1.16e1 127.88
ip4-input-no-checksum active 141615 18109204 0 2.24e1 127.88
ip4-lookup active 141615 18109204 0 3.05e1 127.88
ip4-rewrite active 141615 18109204 0 3.75e1 127.88
unix-epoll-input polling 138 0 0 1.29e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 3.9, average vectors/node 157.47, last 128 main loops 6.61 per node 94.00
vector rates in 4.5795e6, out 4.5795e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 115001 18109204 0 1.07e1 157.47
TenGigabitEtherneta/0/0-tx active 115001 18109204 0 4.10e1 157.47
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.35e3 0.00
acl-plugin-out-ip4-fa active 115001 18109204 0 2.82e2 157.47
dpdk-input polling 115001 18109204 0 5.03e1 157.47
ethernet-input active 115001 18109204 0 1.61e1 157.47
interface-output active 115001 18109204 0 1.14e1 157.47
ip4-input-no-checksum active 115001 18109204 0 2.18e1 157.47
ip4-lookup active 115001 18109204 0 2.90e1 157.47
ip4-rewrite active 115001 18109204 0 3.67e1 157.47
unix-epoll-input polling 113 0 0 1.50e3 0.00

l2

10ge2p1x520-eth-l2bdbasemaclrn-macip-iacl1sl-10kflows-ndrpdr

RFC2544: Packet throughput L2BD test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 for L2 switching of IPv4.
  • [Cfg] DUT configuration: DUT1 is configured with L2 bridge domain and MAC learning enabled. DUT2 is configured with L2 cross-connects. Required MACIP ACL rules are applied to input paths of both DUT1 interfaces. DUT1 and DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 10k flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-eth-l2bdbasemaclrn-macip-iacl1sl-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 51 7.13e4 0.00
dpdk-process any wait 0 0 1 1.13e4 0.00
fib-walk any wait 0 0 2 6.11e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 1.45e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.36e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 9.48e3 0.00
lisp-retry-service any wait 0 0 2 1.76e3 0.00
statseg-collector-process time wait 0 0 1 3.34e3 0.00
unix-epoll-input polling 3247 0 0 3.12e6 0.00
vpe-oam-process any wait 0 0 2 1.10e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 243.25, last 128 main loops 40.00 per node 269.47
vector rates in 5.3459e6, out 5.3459e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 48671 11835138 0 9.52e0 243.17
TenGigabitEtherneta/0/0-tx active 48671 11835138 0 4.21e1 243.17
TenGigabitEtherneta/0/1-output active 48671 11835169 0 9.96e0 243.17
TenGigabitEtherneta/0/1-tx active 48671 11835169 0 4.19e1 243.17
dpdk-input polling 48671 23670307 0 4.66e1 486.33
ethernet-input active 97342 23670307 0 1.85e1 243.17
l2-flood active 97295 23670307 0 9.67e1 243.28
l2-fwd active 97295 23670307 0 1.45e1 243.28
l2-input active 97295 23670307 0 2.94e1 243.28
l2-input-acl active 97295 23670307 0 1.06e2 243.28
l2-learn active 97295 23670307 0 5.65e1 243.28
l2-output active 97295 23670307 0 7.95e0 243.28
unix-epoll-input polling 48 0 0 1.79e3 0.00
64b-2t2c-eth-l2bdbasemaclrn-macip-iacl1sl-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 49 3.48e4 0.00
dpdk-process any wait 0 0 2 1.74e4 0.00
fib-walk any wait 0 0 2 1.04e4 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 5 2.29e3 0.00
lisp-retry-service any wait 0 0 2 3.50e3 0.00
unix-epoll-input polling 4391 0 0 2.32e6 0.00
vpe-oam-process any wait 0 0 2 1.69e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 85.30, last 128 main loops 20.00 per node 256.00
vector rates in 4.9798e6, out 4.9798e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 259607 22145764 0 1.25e1 85.30
TenGigabitEtherneta/0/1-tx active 259607 22145764 0 4.00e1 85.30
dpdk-input polling 280091 22145764 0 5.05e1 79.07
ethernet-input active 259607 22145764 0 2.09e1 85.30
l2-flood active 259607 22145764 0 1.12e2 85.30
l2-fwd active 259607 22145764 0 1.85e1 85.30
l2-input active 259607 22145764 0 3.02e1 85.30
l2-input-acl active 259607 22145764 0 1.01e2 85.30
l2-learn active 259607 22145764 0 6.14e1 85.30
l2-output active 259607 22145764 0 1.11e1 85.30
unix-epoll-input polling 274 0 0 1.42e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 4.4, average vectors/node 83.82, last 128 main loops 20.00 per node 256.00
vector rates in 4.9799e6, out 4.9799e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 264219 22146101 0 1.27e1 83.82
TenGigabitEtherneta/0/0-tx active 264219 22146101 0 3.98e1 83.82
dpdk-input polling 387423 22146101 0 4.97e1 57.16
ethernet-input active 264219 22146101 0 2.07e1 83.82
l2-flood active 264219 22146101 0 1.13e2 83.82
l2-fwd active 264219 22146101 0 1.89e1 83.82
l2-input active 264219 22146101 0 3.04e1 83.82
l2-input-acl active 264219 22146101 0 1.00e2 83.82
l2-learn active 264219 22146101 0 6.16e1 83.82
l2-output active 264219 22146101 0 1.08e1 83.82
unix-epoll-input polling 378 0 0 1.41e3 0.00
64b-4t4c-eth-l2bdbasemaclrn-macip-iacl1sl-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 3.84e4 0.00
dpdk-process any wait 0 0 2 1.58e4 0.00
fib-walk any wait 0 0 2 6.99e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 5 4.09e3 0.00
lisp-retry-service any wait 0 0 2 2.12e3 0.00
unix-epoll-input polling 6089 0 0 1.66e6 0.00
vpe-oam-process any wait 0 0 2 1.06e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 49.09, last 128 main loops 2.89 per node 37.00
vector rates in 3.7911e6, out 3.7911e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 340961 16738886 0 1.53e1 49.09
TenGigabitEtherneta/0/1-tx active 340961 16738886 0 4.23e1 49.09
dpdk-input polling 365439 16738886 0 5.61e1 45.80
ethernet-input active 340961 16738886 0 2.55e1 49.09
l2-flood active 340961 16738886 0 2.14e2 49.09
l2-fwd active 340961 16738886 0 2.27e1 49.09
l2-input active 340961 16738886 0 3.19e1 49.09
l2-input-acl active 340961 16738886 0 1.15e2 49.09
l2-learn active 340961 16738886 0 6.62e1 49.09
l2-output active 340961 16738886 0 1.42e1 49.09
unix-epoll-input polling 356 0 0 1.45e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 4.4, average vectors/node 60.18, last 128 main loops 2.50 per node 32.00
vector rates in 3.7911e6, out 3.7911e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 278163 16738907 0 1.43e1 60.18
TenGigabitEtherneta/0/1-tx active 278163 16738907 0 4.13e1 60.18
dpdk-input polling 288582 16738907 0 5.29e1 58.00
ethernet-input active 278163 16738907 0 2.42e1 60.18
l2-flood active 278163 16738907 0 2.16e2 60.18
l2-fwd active 278163 16738907 0 2.13e1 60.18
l2-input active 278163 16738907 0 3.11e1 60.18
l2-input-acl active 278163 16738907 0 1.24e2 60.18
l2-learn active 278163 16738907 0 6.47e1 60.18
l2-output active 278163 16738907 0 1.32e1 60.18
unix-epoll-input polling 282 0 0 1.35e3 0.00
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 4.4, average vectors/node 46.67, last 128 main loops 2.03 per node 26.00
vector rates in 3.7911e6, out 3.7911e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 358634 16738868 0 1.55e1 46.67
TenGigabitEtherneta/0/0-tx active 358634 16738868 0 4.24e1 46.67
dpdk-input polling 460928 16738868 0 5.56e1 36.32
ethernet-input active 358634 16738868 0 2.56e1 46.67
l2-flood active 358634 16738868 0 2.05e2 46.67
l2-fwd active 358634 16738868 0 2.29e1 46.67
l2-input active 358634 16738868 0 3.31e1 46.67
l2-input-acl active 358634 16738868 0 1.19e2 46.67
l2-learn active 358634 16738868 0 6.62e1 46.67
l2-output active 358634 16738868 0 1.53e1 46.67
unix-epoll-input polling 450 0 0 1.38e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 4.4, average vectors/node 162.11, last 128 main loops 7.34 per node 94.00
vector rates in 3.7911e6, out 3.7911e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 103257 16738886 0 1.08e1 162.11
TenGigabitEtherneta/0/0-tx active 103257 16738886 0 4.16e1 162.11
dpdk-input polling 103699 16738886 0 4.99e1 161.42
ethernet-input active 103257 16738886 0 1.91e1 162.11
l2-flood active 103257 16738886 0 2.45e2 162.11
l2-fwd active 103257 16738886 0 1.59e1 162.11
l2-input active 103257 16738886 0 3.06e1 162.11
l2-input-acl active 103257 16738886 0 1.19e2 162.11
l2-learn active 103257 16738886 0 6.27e1 162.11
l2-output active 103257 16738886 0 9.04e0 162.11
unix-epoll-input polling 101 0 0 1.57e3 0.00

10ge2p1x520-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows-ndrpdr

RFC2544: Packet throughput L2BD test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 for L2 switching of IPv4.
  • [Cfg] DUT configuration: DUT1 is configured with L2 bridge domain and MAC learning enabled. DUT2 is configured with L2 cross-connects. Required MACIP ACL rules are applied to input paths of both DUT1 interfaces. DUT1 and DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 10k flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 9.65e4 0.00
dpdk-process any wait 0 0 2 7.75e5 0.00
fib-walk any wait 0 0 3 3.97e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 5 1.46e3 0.00
lisp-retry-service any wait 0 0 3 2.85e3 0.00
unix-epoll-input polling 4093 0 0 2.47e6 0.00
vpe-oam-process any wait 0 0 2 2.40e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 232.27, last 128 main loops 40.00 per node 269.47
vector rates in 3.4084e6, out 3.4084e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 32502 7544064 0 9.59e0 232.11
TenGigabitEtherneta/0/0-tx active 32502 7544064 0 4.24e1 232.11
TenGigabitEtherneta/0/1-output active 32500 7544238 0 1.03e1 232.13
TenGigabitEtherneta/0/1-tx active 32500 7544238 0 4.24e1 232.13
dpdk-input polling 32504 15088302 0 4.67e1 464.19
ethernet-input active 65002 15088302 0 1.88e1 232.12
l2-flood active 64947 15088302 0 8.83e1 232.32
l2-fwd active 64947 15088302 0 1.47e1 232.32
l2-input active 64947 15088302 0 2.96e1 232.32
l2-input-acl active 64947 15088302 0 3.56e2 232.32
l2-learn active 64947 15088302 0 5.71e1 232.32
l2-output active 64947 15088302 0 8.22e0 232.32
unix-epoll-input polling 32 0 0 1.55e3 0.00
64b-2t2c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 51 4.08e4 0.00
dpdk-process any wait 0 0 1 2.12e4 0.00
fib-walk any wait 0 0 2 5.80e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 5 1.47e3 0.00
lisp-retry-service any wait 0 0 2 7.75e3 0.00
unix-epoll-input polling 3495 0 0 2.88e6 0.00
vpe-oam-process any wait 0 0 2 6.07e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 65.50, last 128 main loops 0.00 per node 0.00
vector rates in 3.2859e6, out 3.2859e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 220984 14475019 0 1.35e1 65.50
TenGigabitEtherneta/0/1-tx active 220984 14475019 0 4.12e1 65.50
dpdk-input polling 362018 14475019 0 5.47e1 39.98
ethernet-input active 220984 14475019 0 2.32e1 65.50
l2-flood active 220984 14475019 0 1.01e2 65.50
l2-fwd active 220984 14475019 0 2.02e1 65.50
l2-input active 220984 14475019 0 3.08e1 65.50
l2-input-acl active 220984 14475019 0 3.32e2 65.50
l2-learn active 220984 14475019 0 6.58e1 65.50
l2-output active 220984 14475019 0 1.26e1 65.50
unix-epoll-input polling 353 0 0 1.42e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 4.4, average vectors/node 70.32, last 128 main loops 0.00 per node 0.00
vector rates in 3.2859e6, out 3.2859e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 205851 14475116 0 1.35e1 70.32
TenGigabitEtherneta/0/0-tx active 205851 14475116 0 4.11e1 70.32
dpdk-input polling 678209 14475116 0 5.47e1 21.34
ethernet-input active 205851 14475116 0 2.23e1 70.32
l2-flood active 205851 14475116 0 1.02e2 70.32
l2-fwd active 205851 14475116 0 1.97e1 70.32
l2-input active 205851 14475116 0 3.08e1 70.32
l2-input-acl active 205851 14475116 0 3.31e2 70.32
l2-learn active 205851 14475116 0 6.61e1 70.32
l2-output active 205851 14475116 0 1.21e1 70.32
unix-epoll-input polling 662 0 0 1.44e3 0.00
64b-4t4c-eth-l2bdbasemaclrn-macip-iacl50sl-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 4.26e4 0.00
dpdk-process any wait 0 0 2 2.15e4 0.00
fib-walk any wait 0 0 2 8.44e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 3.51e3 0.00
lisp-retry-service any wait 0 0 2 7.16e3 0.00
unix-epoll-input polling 4927 0 0 2.05e6 0.00
vpe-oam-process any wait 0 0 2 6.41e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 79.32, last 128 main loops 4.06 per node 52.00
vector rates in 2.7851e6, out 2.7851e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 155105 12303308 0 1.29e1 79.32
TenGigabitEtherneta/0/1-tx active 155105 12303308 0 4.05e1 79.32
dpdk-input polling 158731 12303308 0 5.16e1 77.51
ethernet-input active 155105 12303308 0 2.17e1 79.32
l2-flood active 155105 12303308 0 1.69e2 79.32
l2-fwd active 155105 12303308 0 1.93e1 79.32
l2-input active 155105 12303308 0 3.07e1 79.32
l2-input-acl active 155105 12303308 0 3.99e2 79.32
l2-learn active 155105 12303308 0 6.42e1 79.32
l2-output active 155105 12303308 0 1.13e1 79.32
unix-epoll-input polling 155 0 0 1.39e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 4.4, average vectors/node 80.75, last 128 main loops 9.77 per node 125.00
vector rates in 2.7851e6, out 2.7851e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 152356 12303292 0 1.28e1 80.75
TenGigabitEtherneta/0/1-tx active 152356 12303292 0 4.07e1 80.75
dpdk-input polling 156476 12303292 0 5.05e1 78.63
ethernet-input active 152356 12303292 0 2.18e1 80.75
l2-flood active 152356 12303292 0 1.71e2 80.75
l2-fwd active 152356 12303292 0 1.93e1 80.75
l2-input active 152356 12303292 0 3.05e1 80.75
l2-input-acl active 152356 12303292 0 3.99e2 80.75
l2-learn active 152356 12303292 0 6.42e1 80.75
l2-output active 152356 12303292 0 1.14e1 80.75
unix-epoll-input polling 152 0 0 1.49e3 0.00
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 4.4, average vectors/node 29.07, last 128 main loops 0.00 per node 0.00
vector rates in 2.7851e6, out 2.7851e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 423295 12303273 0 1.97e1 29.07
TenGigabitEtherneta/0/0-tx active 423295 12303273 0 4.66e1 29.07
dpdk-input polling 2372059 12303273 0 7.89e1 5.19
ethernet-input active 423295 12303273 0 3.12e1 29.07
l2-flood active 423295 12303273 0 1.65e2 29.07
l2-fwd active 423295 12303273 0 2.71e1 29.07
l2-input active 423295 12303273 0 3.48e1 29.07
l2-input-acl active 423295 12303273 0 3.13e2 29.07
l2-learn active 423295 12303273 0 7.24e1 29.07
l2-output active 423295 12303273 0 1.84e1 29.07
unix-epoll-input polling 2314 0 0 1.32e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 4.4, average vectors/node 37.48, last 128 main loops 0.00 per node 0.00
vector rates in 2.7851e6, out 2.7851e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 328267 12303270 0 1.76e1 37.48
TenGigabitEtherneta/0/0-tx active 328267 12303270 0 4.55e1 37.48
dpdk-input polling 1117553 12303270 0 7.08e1 11.01
ethernet-input active 328267 12303270 0 2.87e1 37.48
l2-flood active 328267 12303270 0 1.92e2 37.48
l2-fwd active 328267 12303270 0 2.48e1 37.48
l2-input active 328267 12303270 0 3.38e1 37.48
l2-input-acl active 328267 12303270 0 3.13e2 37.48
l2-learn active 328267 12303270 0 7.24e1 37.48
l2-output active 328267 12303270 0 1.70e1 37.48
unix-epoll-input polling 1090 0 0 1.40e3 0.00

10ge2p1x520-eth-l2bdbasemaclrn-oacl1sf-10kflows-ndrpdr

RFC2544: Packet throughput L2BD test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for L2 switching of IPv4.
  • [Cfg] DUT configuration: DUT1 is configured with L2 bridge domain and MAC learning enabled. DUT2 is configured with L2 cross-connects. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 10k flows per flow-group) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-eth-l2bdbasemaclrn-oacl1sf-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 18 2.33e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 8.58e2 0.00
api-rx-from-ring active 0 0 51 4.87e4 0.00
dpdk-process any wait 0 0 2 8.25e5 0.00
fib-walk any wait 0 0 2 6.91e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 2.02e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.71e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 9.23e3 0.00
lisp-retry-service any wait 0 0 2 1.09e4 0.00
statseg-collector-process time wait 0 0 1 5.61e3 0.00
unix-epoll-input polling 7138 0 0 1.40e6 0.00
vpe-oam-process any wait 0 0 3 4.45e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 246.82, last 128 main loops 48.00 per node 267.13
vector rates in 6.4956e6, out 6.4956e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 57557 14206208 0 9.64e0 246.82
TenGigabitEtherneta/0/0-tx active 57557 14206208 0 4.37e1 246.82
TenGigabitEtherneta/0/1-output active 57556 14206188 0 9.82e0 246.82
TenGigabitEtherneta/0/1-tx active 57556 14206188 0 4.33e1 246.82
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.84e3 0.00
acl-plugin-out-ip4-l2 active 115113 28412396 0 1.05e2 246.82
dpdk-input polling 57557 28412396 0 4.65e1 493.64
ethernet-input active 115113 28412396 0 1.88e1 246.82
interface-output active 115113 28412396 0 1.09e1 246.82
l2-fwd active 115113 28412396 0 2.99e1 246.82
l2-input active 115113 28412396 0 2.95e1 246.82
l2-learn active 115113 28412396 0 2.00e1 246.82
l2-output active 115113 28412396 0 1.07e1 246.82
l2-output-feat-arc active 115113 28412396 0 1.92e1 246.82
l2-output-feat-arc-end active 115113 28412396 0 8.68e0 246.82
unix-epoll-input polling 56 0 0 2.57e3 0.00
64b-2t2c-eth-l2bdbasemaclrn-oacl1sf-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 18 1.65e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.01e3 0.00
api-rx-from-ring active 0 0 52 4.74e4 0.00
dpdk-process any wait 0 0 2 9.17e5 0.00
fib-walk any wait 0 0 2 7.59e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 3.70e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 5 1.07e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 6.26e3 0.00
lisp-retry-service any wait 0 0 2 2.26e3 0.00
statseg-collector-process time wait 0 0 1 5.37e3 0.00
unix-epoll-input polling 4944 0 0 2.03e6 0.00
vpe-oam-process any wait 0 0 2 9.68e2 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 248.17, last 128 main loops 24.00 per node 256.00
vector rates in 6.5648e6, out 6.5648e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 116170 28829700 0 9.46e0 248.17
TenGigabitEtherneta/0/1-tx active 116170 28829700 0 4.16e1 248.17
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.87e3 0.00
acl-plugin-out-ip4-l2 active 116170 28829700 0 1.05e2 248.17
dpdk-input polling 117709 28829700 0 4.61e1 244.92
ethernet-input active 116170 28829700 0 1.89e1 248.17
interface-output active 116170 28829700 0 1.05e1 248.17
l2-fwd active 116170 28829700 0 2.99e1 248.17
l2-input active 116170 28829700 0 2.92e1 248.17
l2-learn active 116170 28829700 0 2.14e1 248.17
l2-output active 116170 28829700 0 8.81e0 248.17
l2-output-feat-arc active 116170 28829700 0 1.92e1 248.17
l2-output-feat-arc-end active 116170 28829700 0 8.52e0 248.17
unix-epoll-input polling 115 0 0 2.41e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 4.4, average vectors/node 256.00, last 128 main loops 24.00 per node 256.00
vector rates in 6.5632e6, out 6.5632e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 112588 28822528 0 9.30e0 256.00
TenGigabitEtherneta/0/0-tx active 112588 28822528 0 4.17e1 256.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.50e3 0.00
acl-plugin-out-ip4-l2 active 112588 28822528 0 1.06e2 256.00
dpdk-input polling 112588 28822528 0 4.45e1 256.00
ethernet-input active 112588 28822528 0 1.98e1 256.00
interface-output active 112588 28822528 0 1.04e1 256.00
l2-fwd active 112588 28822528 0 2.98e1 256.00
l2-input active 112588 28822528 0 2.89e1 256.00
l2-learn active 112588 28822528 0 2.11e1 256.00
l2-output active 112588 28822528 0 8.93e0 256.00
l2-output-feat-arc active 112588 28822528 0 1.88e1 256.00
l2-output-feat-arc-end active 112588 28822528 0 9.21e0 256.00
unix-epoll-input polling 110 0 0 2.39e3 0.00
64b-4t4c-eth-l2bdbasemaclrn-oacl1sf-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 18 2.34e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 7.79e2 0.00
api-rx-from-ring active 0 0 51 2.91e4 0.00
dpdk-process any wait 0 0 1 2.39e4 0.00
fib-walk any wait 0 0 2 1.11e4 0.00
ip4-reassembly-expire-walk any wait 0 0 1 5.83e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 3.33e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 6.80e3 0.00
lisp-retry-service any wait 0 0 2 2.10e3 0.00
statseg-collector-process time wait 0 0 1 6.38e3 0.00
unix-epoll-input polling 6878 0 0 1.47e6 0.00
vpe-oam-process any wait 0 0 2 1.32e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 59.44, last 128 main loops 5.25 per node 56.00
vector rates in 5.8366e6, out 5.8366e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 432948 25732504 0 1.34e1 59.44
TenGigabitEtherneta/0/1-tx active 432948 25732504 0 3.98e1 59.44
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.63e3 0.00
acl-plugin-out-ip4-l2 active 432948 25732504 0 1.14e2 59.44
dpdk-input polling 436624 25732504 0 5.23e1 58.94
ethernet-input active 432948 25732504 0 2.17e1 59.44
interface-output active 432948 25732504 0 1.29e1 59.44
l2-fwd active 432948 25732504 0 3.20e1 59.44
l2-input active 432948 25732504 0 3.07e1 59.44
l2-learn active 432948 25732504 0 2.82e1 59.44
l2-output active 432948 25732504 0 1.21e1 59.44
l2-output-feat-arc active 432948 25732504 0 2.27e1 59.44
l2-output-feat-arc-end active 432948 25732504 0 1.13e1 59.44
unix-epoll-input polling 426 0 0 2.41e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 4.4, average vectors/node 56.07, last 128 main loops 5.25 per node 56.00
vector rates in 5.8366e6, out 5.8366e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 458920 25732472 0 1.37e1 56.07
TenGigabitEtherneta/0/1-tx active 458920 25732472 0 4.05e1 56.07
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.78e3 0.00
acl-plugin-out-ip4-l2 active 458920 25732472 0 1.10e2 56.07
dpdk-input polling 462505 25732472 0 5.21e1 55.64
ethernet-input active 458920 25732472 0 2.25e1 56.07
interface-output active 458920 25732472 0 1.32e1 56.07
l2-fwd active 458920 25732472 0 3.22e1 56.07
l2-input active 458920 25732472 0 3.09e1 56.07
l2-learn active 458920 25732472 0 2.87e1 56.07
l2-output active 458920 25732472 0 1.23e1 56.07
l2-output-feat-arc active 458920 25732472 0 2.34e1 56.07
l2-output-feat-arc-end active 458920 25732472 0 1.15e1 56.07
unix-epoll-input polling 451 0 0 2.43e3 0.00
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 4.4, average vectors/node 55.22, last 128 main loops 6.75 per node 72.00
vector rates in 5.8366e6, out 5.8366e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 465983 25732492 0 1.39e1 55.22
TenGigabitEtherneta/0/0-tx active 465983 25732492 0 4.02e1 55.22
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.79e3 0.00
acl-plugin-out-ip4-l2 active 465983 25732492 0 1.09e2 55.22
dpdk-input polling 465983 25732492 0 5.26e1 55.22
ethernet-input active 465983 25732492 0 2.23e1 55.22
interface-output active 465983 25732492 0 1.32e1 55.22
l2-fwd active 465983 25732492 0 3.23e1 55.22
l2-input active 465983 25732492 0 3.12e1 55.22
l2-learn active 465983 25732492 0 2.91e1 55.22
l2-output active 465983 25732492 0 1.26e1 55.22
l2-output-feat-arc active 465983 25732492 0 2.32e1 55.22
l2-output-feat-arc-end active 465983 25732492 0 1.13e1 55.22
unix-epoll-input polling 455 0 0 2.29e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 4.4, average vectors/node 62.74, last 128 main loops 5.25 per node 56.00
vector rates in 5.8366e6, out 5.8366e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 410150 25732460 0 1.36e1 62.74
TenGigabitEtherneta/0/0-tx active 410150 25732460 0 4.10e1 62.74
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.59e3 0.00
acl-plugin-out-ip4-l2 active 410150 25732460 0 1.09e2 62.74
dpdk-input polling 410150 25732460 0 5.49e1 62.74
ethernet-input active 410150 25732460 0 2.22e1 62.74
interface-output active 410150 25732460 0 1.26e1 62.74
l2-fwd active 410150 25732460 0 3.17e1 62.74
l2-input active 410150 25732460 0 3.13e1 62.74
l2-learn active 410150 25732460 0 2.83e1 62.74
l2-output active 410150 25732460 0 1.18e1 62.74
l2-output-feat-arc active 410150 25732460 0 2.32e1 62.74
l2-output-feat-arc-end active 410150 25732460 0 1.12e1 62.74
unix-epoll-input polling 400 0 0 2.54e3 0.00

10ge2p1x520-eth-l2bdbasemaclrn-oacl1sl-10kflows-ndrpdr

RFC2544: Packet throughput L2BD test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for L2 switching of IPv4.
  • [Cfg] DUT configuration: DUT1 is configured with L2 bridge domain and MAC learning enabled. DUT2 is configured with L2 cross-connects. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 10k flows per flow-group) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-eth-l2bdbasemaclrn-oacl1sl-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 18 1.69e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 8.95e2 0.00
api-rx-from-ring active 0 0 52 4.59e4 0.00
dpdk-process any wait 0 0 2 1.34e4 0.00
fib-walk any wait 0 0 2 1.93e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 3.36e3 0.00
lisp-retry-service any wait 0 0 2 1.70e3 0.00
unix-epoll-input polling 7256 0 0 1.39e6 0.00
vpe-oam-process any wait 0 0 2 1.19e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 253.46, last 128 main loops 48.00 per node 267.13
vector rates in 5.4360e6, out 5.4360e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 47299 11988224 0 9.08e0 253.46
TenGigabitEtherneta/0/0-tx active 47299 11988224 0 4.20e1 253.46
TenGigabitEtherneta/0/1-output active 47299 11988224 0 9.57e0 253.46
TenGigabitEtherneta/0/1-tx active 47299 11988224 0 4.18e1 253.46
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.41e3 0.00
acl-plugin-out-ip4-l2 active 94598 23976448 0 1.77e2 253.46
dpdk-input polling 47299 23976448 0 4.63e1 506.91
ethernet-input active 94598 23976448 0 1.83e1 253.46
interface-output active 94598 23976448 0 1.09e1 253.46
l2-fwd active 94598 23976448 0 2.99e1 253.46
l2-input active 94598 23976448 0 2.94e1 253.46
l2-learn active 94598 23976448 0 1.99e1 253.46
l2-output active 94598 23976448 0 1.03e1 253.46
l2-output-feat-arc active 94598 23976448 0 1.91e1 253.46
l2-output-feat-arc-end active 94598 23976448 0 8.18e0 253.46
unix-epoll-input polling 46 0 0 1.51e3 0.00
64b-2t2c-eth-l2bdbasemaclrn-oacl1sl-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 18 2.79e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.01e3 0.00
api-rx-from-ring active 0 0 51 5.46e4 0.00
dpdk-process any wait 0 0 2 1.98e4 0.00
fib-walk any wait 0 0 2 9.08e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 5.04e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.18e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 6.89e3 0.00
lisp-retry-service any wait 0 0 2 2.92e3 0.00
statseg-collector-process time wait 0 0 1 2.99e4 0.00
unix-epoll-input polling 6392 0 0 1.59e6 0.00
vpe-oam-process any wait 0 0 2 1.26e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 246.23, last 128 main loops 24.00 per node 256.00
vector rates in 5.4938e6, out 5.4938e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 98982 24372480 0 9.30e0 246.23
TenGigabitEtherneta/0/1-tx active 98982 24372480 0 4.06e1 246.23
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.54e3 0.00
acl-plugin-out-ip4-l2 active 98982 24372480 0 1.77e2 246.23
dpdk-input polling 100726 24372480 0 4.57e1 241.97
ethernet-input active 98982 24372480 0 1.88e1 246.23
interface-output active 98982 24372480 0 9.94e0 246.23
l2-fwd active 98982 24372480 0 2.98e1 246.23
l2-input active 98982 24372480 0 2.89e1 246.23
l2-learn active 98982 24372480 0 2.07e1 246.23
l2-output active 98982 24372480 0 8.75e0 246.23
l2-output-feat-arc active 98982 24372480 0 1.86e1 246.23
l2-output-feat-arc-end active 98982 24372480 0 8.23e0 246.23
unix-epoll-input polling 98 0 0 1.43e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 4.4, average vectors/node 249.89, last 128 main loops 24.00 per node 256.00
vector rates in 5.4937e6, out 5.4937e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 97531 24371968 0 9.25e0 249.89
TenGigabitEtherneta/0/0-tx active 97531 24371968 0 4.09e1 249.89
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.52e3 0.00
acl-plugin-out-ip4-l2 active 97531 24371968 0 1.78e2 249.89
dpdk-input polling 97531 24371968 0 4.42e1 249.89
ethernet-input active 97531 24371968 0 1.91e1 249.89
interface-output active 97531 24371968 0 1.01e1 249.89
l2-fwd active 97531 24371968 0 2.98e1 249.89
l2-input active 97531 24371968 0 2.87e1 249.89
l2-learn active 97531 24371968 0 2.10e1 249.89
l2-output active 97531 24371968 0 8.77e0 249.89
l2-output-feat-arc active 97531 24371968 0 1.87e1 249.89
l2-output-feat-arc-end active 97531 24371968 0 8.13e0 249.89
unix-epoll-input polling 95 0 0 1.43e3 0.00
64b-4t4c-eth-l2bdbasemaclrn-oacl1sl-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 16 2.28e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 8.06e2 0.00
api-rx-from-ring active 0 0 51 4.01e4 0.00
dpdk-process any wait 0 0 1 3.07e4 0.00
fib-walk any wait 0 0 2 5.08e3 0.00
ip-neighbor-scan-process any wait 0 0 1 1.66e4 0.00
ip4-reassembly-expire-walk any wait 0 0 1 3.23e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 3.39e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 3.70e3 0.00
lisp-retry-service any wait 0 0 2 7.81e3 0.00
statseg-collector-process time wait 0 0 1 1.73e4 0.00
unix-epoll-input polling 6344 0 0 1.59e6 0.00
vpe-oam-process any wait 0 0 2 1.15e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 60.61, last 128 main loops 5.44 per node 58.00
vector rates in 4.0592e6, out 4.0592e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 295315 17899752 0 1.37e1 60.61
TenGigabitEtherneta/0/1-tx active 295315 17899752 0 4.19e1 60.61
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.38e3 0.00
acl-plugin-out-ip4-l2 active 295315 17899752 0 2.71e2 60.61
dpdk-input polling 300304 17899752 0 5.35e1 59.61
ethernet-input active 295315 17899752 0 2.40e1 60.61
interface-output active 295315 17899752 0 1.30e1 60.61
l2-fwd active 295315 17899752 0 3.34e1 60.61
l2-input active 295315 17899752 0 3.11e1 60.61
l2-learn active 295315 17899752 0 2.89e1 60.61
l2-output active 295315 17899752 0 1.53e1 60.61
l2-output-feat-arc active 295315 17899752 0 2.41e1 60.61
l2-output-feat-arc-end active 295315 17899752 0 1.28e1 60.61
unix-epoll-input polling 293 0 0 1.38e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 4.4, average vectors/node 63.28, last 128 main loops .75 per node 8.00
vector rates in 4.0592e6, out 4.0592e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 282863 17899749 0 1.35e1 63.28
TenGigabitEtherneta/0/1-tx active 282863 17899749 0 4.22e1 63.28
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.59e3 0.00
acl-plugin-out-ip4-l2 active 282863 17899749 0 2.71e2 63.28
dpdk-input polling 288263 17899749 0 5.28e1 62.09
ethernet-input active 282863 17899749 0 2.43e1 63.28
interface-output active 282863 17899749 0 1.28e1 63.28
l2-fwd active 282863 17899749 0 3.34e1 63.28
l2-input active 282863 17899749 0 3.13e1 63.28
l2-learn active 282863 17899749 0 2.89e1 63.28
l2-output active 282863 17899749 0 1.52e1 63.28
l2-output-feat-arc active 282863 17899749 0 2.46e1 63.28
l2-output-feat-arc-end active 282863 17899749 0 1.28e1 63.28
unix-epoll-input polling 281 0 0 1.42e3 0.00
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 4.4, average vectors/node 84.98, last 128 main loops 6.38 per node 68.00
vector rates in 4.0592e6, out 4.0592e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 210623 17899747 0 1.28e1 84.98
TenGigabitEtherneta/0/0-tx active 210623 17899747 0 4.12e1 84.98
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.48e3 0.00
acl-plugin-out-ip4-l2 active 210623 17899747 0 2.89e2 84.98
dpdk-input polling 212568 17899747 0 4.95e1 84.21
ethernet-input active 210623 17899747 0 2.21e1 84.98
interface-output active 210623 17899747 0 1.18e1 84.98
l2-fwd active 210623 17899747 0 3.24e1 84.98
l2-input active 210623 17899747 0 3.06e1 84.98
l2-learn active 210623 17899747 0 2.61e1 84.98
l2-output active 210623 17899747 0 1.37e1 84.98
l2-output-feat-arc active 210623 17899747 0 2.25e1 84.98
l2-output-feat-arc-end active 210623 17899747 0 1.15e1 84.98
unix-epoll-input polling 208 0 0 1.35e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 4.4, average vectors/node 95.44, last 128 main loops 3.00 per node 32.00
vector rates in 4.0592e6, out 4.0592e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 187558 17899757 0 1.20e1 95.44
TenGigabitEtherneta/0/0-tx active 187558 17899757 0 4.23e1 95.44
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.53e3 0.00
acl-plugin-out-ip4-l2 active 187558 17899757 0 2.88e2 95.44
dpdk-input polling 188492 17899757 0 5.31e1 94.96
ethernet-input active 187558 17899757 0 2.18e1 95.44
interface-output active 187558 17899757 0 1.17e1 95.44
l2-fwd active 187558 17899757 0 3.18e1 95.44
l2-input active 187558 17899757 0 3.04e1 95.44
l2-learn active 187558 17899757 0 2.54e1 95.44
l2-output active 187558 17899757 0 1.35e1 95.44
l2-output-feat-arc active 187558 17899757 0 2.21e1 95.44
l2-output-feat-arc-end active 187558 17899757 0 1.14e1 95.44
unix-epoll-input polling 184 0 0 1.45e3 0.00

10ge2p1x520-eth-l2bdbasemaclrn-oacl50sf-10kflows-ndrpdr

RFC2544: Packet throughput L2BD test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for L2 switching of IPv4.
  • [Cfg] DUT configuration: DUT1 is configured with L2 bridge domain and MAC learning enabled. DUT2 is configured with L2 cross-connects. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 10k flows per flow-group) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-eth-l2bdbasemaclrn-oacl50sf-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 18 2.19e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.00e3 0.00
api-rx-from-ring active 0 0 52 5.99e4 0.00
dpdk-process any wait 0 0 1 1.65e6 0.00
fib-walk any wait 0 0 2 2.36e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 5 6.09e3 0.00
lisp-retry-service any wait 0 0 2 1.48e4 0.00
unix-epoll-input polling 5644 0 0 1.79e6 0.00
vpe-oam-process any wait 0 0 2 7.99e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 248.51, last 128 main loops 48.00 per node 267.13
vector rates in 6.5078e6, out 6.5078e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 57946 14400256 0 9.37e0 248.51
TenGigabitEtherneta/0/0-tx active 57946 14400256 0 4.31e1 248.51
TenGigabitEtherneta/0/1-output active 57946 14400256 0 9.77e0 248.51
TenGigabitEtherneta/0/1-tx active 57946 14400256 0 4.29e1 248.51
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.86e3 0.00
acl-plugin-out-ip4-l2 active 115892 28800512 0 1.05e2 248.51
dpdk-input polling 57946 28800512 0 4.64e1 497.02
ethernet-input active 115892 28800512 0 1.87e1 248.51
interface-output active 115892 28800512 0 1.10e1 248.51
l2-fwd active 115892 28800512 0 2.99e1 248.51
l2-input active 115892 28800512 0 2.93e1 248.51
l2-learn active 115892 28800512 0 2.01e1 248.51
l2-output active 115892 28800512 0 1.06e1 248.51
l2-output-feat-arc active 115892 28800512 0 1.92e1 248.51
l2-output-feat-arc-end active 115892 28800512 0 8.65e0 248.51
unix-epoll-input polling 56 0 0 2.51e3 0.00
64b-2t2c-eth-l2bdbasemaclrn-oacl50sf-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 18 2.16e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.09e3 0.00
api-rx-from-ring active 0 0 52 4.01e4 0.00
dpdk-process any wait 0 0 2 9.32e5 0.00
fib-walk any wait 0 0 2 9.18e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 6.63e3 0.00
lisp-retry-service any wait 0 0 2 3.45e3 0.00
unix-epoll-input polling 5413 0 0 1.85e6 0.00
vpe-oam-process any wait 0 0 2 1.25e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 252.28, last 128 main loops 24.00 per node 256.00
vector rates in 6.5778e6, out 6.5778e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 114216 28814080 0 9.34e0 252.28
TenGigabitEtherneta/0/1-tx active 114216 28814080 0 4.16e1 252.28
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.84e3 0.00
acl-plugin-out-ip4-l2 active 114216 28814080 0 1.04e2 252.28
dpdk-input polling 115792 28814080 0 4.62e1 248.84
ethernet-input active 114216 28814080 0 1.99e1 252.28
interface-output active 114216 28814080 0 1.01e1 252.28
l2-fwd active 114216 28814080 0 2.99e1 252.28
l2-input active 114216 28814080 0 2.89e1 252.28
l2-learn active 114216 28814080 0 2.13e1 252.28
l2-output active 114216 28814080 0 8.75e0 252.28
l2-output-feat-arc active 114216 28814080 0 1.96e1 252.28
l2-output-feat-arc-end active 114216 28814080 0 8.34e0 252.28
unix-epoll-input polling 113 0 0 2.86e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 4.4, average vectors/node 256.00, last 128 main loops 24.00 per node 256.00
vector rates in 6.5774e6, out 6.5774e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 112548 28812288 0 9.52e0 256.00
TenGigabitEtherneta/0/0-tx active 112548 28812288 0 4.18e1 256.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.42e3 0.00
acl-plugin-out-ip4-l2 active 112548 28812288 0 1.06e2 256.00
dpdk-input polling 112548 28812288 0 4.47e1 256.00
ethernet-input active 112548 28812288 0 1.93e1 256.00
interface-output active 112548 28812288 0 1.03e1 256.00
l2-fwd active 112548 28812288 0 2.97e1 256.00
l2-input active 112548 28812288 0 2.89e1 256.00
l2-learn active 112548 28812288 0 2.10e1 256.00
l2-output active 112548 28812288 0 8.92e0 256.00
l2-output-feat-arc active 112548 28812288 0 1.95e1 256.00
l2-output-feat-arc-end active 112548 28812288 0 8.22e0 256.00
unix-epoll-input polling 110 0 0 2.48e3 0.00
64b-4t4c-eth-l2bdbasemaclrn-oacl50sf-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 16 3.76e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 8.76e2 0.00
api-rx-from-ring active 0 0 52 3.09e4 0.00
dpdk-process any wait 0 0 1 3.61e4 0.00
fib-walk any wait 0 0 2 1.08e4 0.00
ip4-reassembly-expire-walk any wait 0 0 1 8.16e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 5 1.81e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 6.13e3 0.00
lisp-retry-service any wait 0 0 2 5.28e3 0.00
statseg-collector-process time wait 0 0 1 1.03e4 0.00
unix-epoll-input polling 8246 0 0 1.23e6 0.00
vpe-oam-process any wait 0 0 2 1.21e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 61.47, last 128 main loops 5.63 per node 60.00
vector rates in 5.8388e6, out 5.8388e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 421035 25880660 0 1.34e1 61.47
TenGigabitEtherneta/0/1-tx active 421035 25880660 0 3.97e1 61.47
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.58e3 0.00
acl-plugin-out-ip4-l2 active 421035 25880660 0 1.14e2 61.47
dpdk-input polling 425327 25880660 0 5.17e1 60.85
ethernet-input active 421035 25880660 0 2.31e1 61.47
interface-output active 421035 25880660 0 1.31e1 61.47
l2-fwd active 421035 25880660 0 3.21e1 61.47
l2-input active 421035 25880660 0 3.09e1 61.47
l2-learn active 421035 25880660 0 2.78e1 61.47
l2-output active 421035 25880660 0 1.20e1 61.47
l2-output-feat-arc active 421035 25880660 0 2.25e1 61.47
l2-output-feat-arc-end active 421035 25880660 0 1.11e1 61.47
unix-epoll-input polling 415 0 0 2.36e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 4.4, average vectors/node 62.95, last 128 main loops 7.13 per node 76.00
vector rates in 5.8389e6, out 5.8389e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 411138 25880684 0 1.37e1 62.95
TenGigabitEtherneta/0/1-tx active 411138 25880684 0 4.08e1 62.95
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.64e3 0.00
acl-plugin-out-ip4-l2 active 411138 25880684 0 1.11e2 62.95
dpdk-input polling 414294 25880684 0 5.12e1 62.47
ethernet-input active 411138 25880684 0 2.23e1 62.95
interface-output active 411138 25880684 0 1.28e1 62.95
l2-fwd active 411138 25880684 0 3.19e1 62.95
l2-input active 411138 25880684 0 3.19e1 62.95
l2-learn active 411138 25880684 0 2.81e1 62.95
l2-output active 411138 25880684 0 1.19e1 62.95
l2-output-feat-arc active 411138 25880684 0 2.34e1 62.95
l2-output-feat-arc-end active 411138 25880684 0 1.24e1 62.95
unix-epoll-input polling 405 0 0 2.47e3 0.00
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 4.4, average vectors/node 54.67, last 128 main loops 7.50 per node 80.00
vector rates in 5.8388e6, out 5.8388e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 473429 25880640 0 1.39e1 54.67
TenGigabitEtherneta/0/0-tx active 473429 25880640 0 4.04e1 54.67
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.73e3 0.00
acl-plugin-out-ip4-l2 active 473429 25880640 0 1.09e2 54.67
dpdk-input polling 473429 25880640 0 5.15e1 54.67
ethernet-input active 473429 25880640 0 2.18e1 54.67
interface-output active 473429 25880640 0 1.33e1 54.67
l2-fwd active 473429 25880640 0 3.23e1 54.67
l2-input active 473429 25880640 0 3.09e1 54.67
l2-learn active 473429 25880640 0 2.94e1 54.67
l2-output active 473429 25880640 0 1.19e1 54.67
l2-output-feat-arc active 473429 25880640 0 2.37e1 54.67
l2-output-feat-arc-end active 473429 25880640 0 1.18e1 54.67
unix-epoll-input polling 462 0 0 2.36e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 4.4, average vectors/node 62.65, last 128 main loops 7.50 per node 80.00
vector rates in 5.8388e6, out 5.8388e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 413086 25880668 0 1.35e1 62.65
TenGigabitEtherneta/0/0-tx active 413086 25880668 0 4.07e1 62.65
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.77e3 0.00
acl-plugin-out-ip4-l2 active 413086 25880668 0 1.09e2 62.65
dpdk-input polling 413086 25880668 0 5.54e1 62.65
ethernet-input active 413086 25880668 0 2.16e1 62.65
interface-output active 413086 25880668 0 1.27e1 62.65
l2-fwd active 413086 25880668 0 3.22e1 62.65
l2-input active 413086 25880668 0 3.12e1 62.65
l2-learn active 413086 25880668 0 2.83e1 62.65
l2-output active 413086 25880668 0 1.18e1 62.65
l2-output-feat-arc active 413086 25880668 0 2.30e1 62.65
l2-output-feat-arc-end active 413086 25880668 0 1.11e1 62.65
unix-epoll-input polling 403 0 0 2.59e3 0.00

10ge2p1x520-eth-l2bdbasemaclrn-oacl50sl-10kflows-ndrpdr

RFC2544: Packet throughput L2BD test cases with ACL

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4-UDP for L2 switching of IPv4.
  • [Cfg] DUT configuration: DUT1 is configured with L2 bridge domain and MAC learning enabled. DUT2 is configured with L2 cross-connects. Required ACL rules are applied to input paths of both DUT1 intefaces. DUT1 and DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 10k flows per flow-group) with all packets containing Ethernet header, IPv4 header with UDP header and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: RFC2544.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
64b-1t1c-eth-l2bdbasemaclrn-oacl50sl-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 18 1.69e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.46e3 0.00
api-rx-from-ring active 0 0 52 4.34e4 0.00
dpdk-process any wait 0 0 2 7.99e5 0.00
fib-walk any wait 0 0 2 8.18e3 0.00
ip-neighbor-scan-process any wait 0 0 1 1.94e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 3.87e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 9.74e2 0.00
ip6-reassembly-expire-walk any wait 0 0 1 2.09e3 0.00
lisp-retry-service any wait 0 0 2 2.33e3 0.00
statseg-collector-process time wait 0 0 1 4.63e3 0.00
unix-epoll-input polling 5925 0 0 1.69e6 0.00
vpe-oam-process any wait 0 0 2 6.20e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 253.46, last 128 main loops 48.00 per node 267.13
vector rates in 5.3838e6, out 5.3838e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 46786 11858176 0 9.21e0 253.46
TenGigabitEtherneta/0/0-tx active 46786 11858176 0 4.19e1 253.46
TenGigabitEtherneta/0/1-output active 46785 11858176 0 9.60e0 253.46
TenGigabitEtherneta/0/1-tx active 46785 11858176 0 4.15e1 253.46
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.56e3 0.00
acl-plugin-out-ip4-l2 active 93571 23716352 0 1.82e2 253.46
dpdk-input polling 46786 23716352 0 4.62e1 506.91
ethernet-input active 93571 23716352 0 1.84e1 253.46
interface-output active 93571 23716352 0 1.09e1 253.46
l2-fwd active 93571 23716352 0 2.99e1 253.46
l2-input active 93571 23716352 0 2.93e1 253.46
l2-learn active 93571 23716352 0 1.99e1 253.46
l2-output active 93571 23716352 0 1.04e1 253.46
l2-output-feat-arc active 93571 23716352 0 1.91e1 253.46
l2-output-feat-arc-end active 93571 23716352 0 8.17e0 253.46
unix-epoll-input polling 46 0 0 1.53e3 0.00
64b-2t2c-eth-l2bdbasemaclrn-oacl50sl-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 18 2.32e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 9.56e2 0.00
api-rx-from-ring active 0 0 52 4.71e4 0.00
dpdk-process any wait 0 0 2 8.85e5 0.00
fib-walk any wait 0 0 3 2.25e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 4.58e3 0.00
lisp-retry-service any wait 0 0 3 6.95e3 0.00
unix-epoll-input polling 10316 0 0 9.77e5 0.00
vpe-oam-process any wait 0 0 2 1.10e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 253.46, last 128 main loops 24.00 per node 256.00
vector rates in 5.4334e6, out 5.4334e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 94497 23951616 0 9.26e0 253.46
TenGigabitEtherneta/0/1-tx active 94497 23951616 0 4.00e1 253.46
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.53e3 0.00
acl-plugin-out-ip4-l2 active 94497 23951616 0 1.81e2 253.46
dpdk-input polling 96171 23951616 0 4.54e1 249.05
ethernet-input active 94497 23951616 0 1.84e1 253.46
interface-output active 94497 23951616 0 9.94e0 253.46
l2-fwd active 94497 23951616 0 3.01e1 253.46
l2-input active 94497 23951616 0 2.99e1 253.46
l2-learn active 94497 23951616 0 2.08e1 253.46
l2-output active 94497 23951616 0 9.03e0 253.46
l2-output-feat-arc active 94497 23951616 0 1.87e1 253.46
l2-output-feat-arc-end active 94497 23951616 0 8.16e0 253.46
unix-epoll-input polling 94 0 0 1.51e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 4.4, average vectors/node 241.42, last 128 main loops 24.00 per node 256.00
vector rates in 5.4336e6, out 5.4336e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 99212 23952128 0 9.82e0 241.42
TenGigabitEtherneta/0/0-tx active 99212 23952128 0 4.06e1 241.42
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.58e3 0.00
acl-plugin-out-ip4-l2 active 99212 23952128 0 1.81e2 241.42
dpdk-input polling 99212 23952128 0 4.44e1 241.42
ethernet-input active 99212 23952128 0 1.94e1 241.42
interface-output active 99212 23952128 0 1.01e1 241.42
l2-fwd active 99212 23952128 0 2.99e1 241.42
l2-input active 99212 23952128 0 2.86e1 241.42
l2-learn active 99212 23952128 0 2.07e1 241.42
l2-output active 99212 23952128 0 8.98e0 241.42
l2-output-feat-arc active 99212 23952128 0 1.89e1 241.42
l2-output-feat-arc-end active 99212 23952128 0 8.29e0 241.42
unix-epoll-input polling 97 0 0 1.55e3 0.00
64b-4t4c-eth-l2bdbasemaclrn-oacl50sl-10kflows-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 16 2.49e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 9.30e2 0.00
api-rx-from-ring active 0 0 52 5.23e4 0.00
dpdk-process any wait 0 0 2 9.87e5 0.00
fib-walk any wait 0 0 2 2.19e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 3.99e3 0.00
lisp-retry-service any wait 0 0 2 1.39e4 0.00
unix-epoll-input polling 5436 0 0 1.86e6 0.00
vpe-oam-process any wait 0 0 2 9.33e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 172.15, last 128 main loops 13.22 per node 141.00
vector rates in 4.4033e6, out 4.4033e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 113269 19499032 0 1.05e1 172.15
TenGigabitEtherneta/0/1-tx active 113269 19499032 0 4.05e1 172.15
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.55e3 0.00
acl-plugin-out-ip4-l2 active 113269 19499032 0 2.67e2 172.15
dpdk-input polling 113269 19499032 0 4.72e1 172.15
ethernet-input active 113269 19499032 0 1.99e1 172.15
interface-output active 113269 19499032 0 1.04e1 172.15
l2-fwd active 113269 19499032 0 3.04e1 172.15
l2-input active 113269 19499032 0 3.02e1 172.15
l2-learn active 113269 19499032 0 2.27e1 172.15
l2-output active 113269 19499032 0 1.06e1 172.15
l2-output-feat-arc active 113269 19499032 0 2.06e1 172.15
l2-output-feat-arc-end active 113269 19499032 0 9.36e0 172.15
unix-epoll-input polling 110 0 0 1.61e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 4.4, average vectors/node 173.74, last 128 main loops 16.31 per node 174.00
vector rates in 4.4033e6, out 4.4033e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 112232 19499022 0 1.03e1 173.74
TenGigabitEtherneta/0/1-tx active 112232 19499022 0 4.08e1 173.74
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.43e3 0.00
acl-plugin-out-ip4-l2 active 112232 19499022 0 2.68e2 173.74
dpdk-input polling 112232 19499022 0 4.64e1 173.74
ethernet-input active 112232 19499022 0 1.96e1 173.74
interface-output active 112232 19499022 0 1.05e1 173.74
l2-fwd active 112232 19499022 0 3.03e1 173.74
l2-input active 112232 19499022 0 3.11e1 173.74
l2-learn active 112232 19499022 0 2.24e1 173.74
l2-output active 112232 19499022 0 1.04e1 173.74
l2-output-feat-arc active 112232 19499022 0 2.04e1 173.74
l2-output-feat-arc-end active 112232 19499022 0 9.53e0 173.74
unix-epoll-input polling 110 0 0 1.55e3 0.00
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 4.4, average vectors/node 116.15, last 128 main loops 18.38 per node 196.00
vector rates in 4.4034e6, out 4.4034e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 167887 19499405 0 1.18e1 116.15
TenGigabitEtherneta/0/0-tx active 167887 19499405 0 4.01e1 116.15
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.51e3 0.00
acl-plugin-out-ip4-l2 active 167887 19499405 0 2.60e2 116.15
dpdk-input polling 167887 19499405 0 4.72e1 116.15
ethernet-input active 167887 19499405 0 2.01e1 116.15
interface-output active 167887 19499405 0 1.11e1 116.15
l2-fwd active 167887 19499405 0 3.11e1 116.15
l2-input active 167887 19499405 0 2.97e1 116.15
l2-learn active 167887 19499405 0 2.40e1 116.15
l2-output active 167887 19499405 0 1.19e1 116.15
l2-output-feat-arc active 167887 19499405 0 2.15e1 116.15
l2-output-feat-arc-end active 167887 19499405 0 1.07e1 116.15
unix-epoll-input polling 164 0 0 1.48e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 4.4, average vectors/node 154.52, last 128 main loops 12.28 per node 131.00
vector rates in 4.4034e6, out 4.4034e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 126189 19499336 0 1.09e1 154.52
TenGigabitEtherneta/0/0-tx active 126189 19499336 0 4.19e1 154.52
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.47e3 0.00
acl-plugin-out-ip4-l2 active 126189 19499336 0 2.59e2 154.52
dpdk-input polling 126189 19499336 0 5.03e1 154.52
ethernet-input active 126189 19499336 0 1.99e1 154.52
interface-output active 126189 19499336 0 1.06e1 154.52
l2-fwd active 126189 19499336 0 3.08e1 154.52
l2-input active 126189 19499336 0 3.01e1 154.52
l2-learn active 126189 19499336 0 2.30e1 154.52
l2-output active 126189 19499336 0 1.11e1 154.52
l2-output-feat-arc active 126189 19499336 0 2.11e1 154.52
l2-output-feat-arc-end active 126189 19499336 0 9.81e0 154.52
unix-epoll-input polling 123 0 0 1.41e3 0.00

srv6

10ge2p1x520-ethip6ip6-ip6base-srv6enc1sid-ndrpdr

Packet throughput Segment routing over IPv6 dataplane with one SID (SRH not inserted) test cases

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv6-IPv6 on DUT1-DUT2, Eth-IPv6 on TG-DUTn for IPv6 routing over SRv6.
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv6 routing and static route, SR policy and steering policy for one direction and one SR behaviour (function) - End - for other direction. DUT1 and DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header,IPv6 header with static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: SRv6 Network Programming - draft 3.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
78b-1t1c-ethip6ip6-ip6base-srv6enc1sid-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 50 4.52e4 0.00
dpdk-process any wait 0 0 1 4.45e4 0.00
fib-walk any wait 0 0 2 9.27e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 8.61e3 0.00
lisp-retry-service any wait 0 0 2 4.29e3 0.00
unix-epoll-input polling 3122 0 0 2.87e6 0.00
vpe-oam-process any wait 0 0 2 7.66e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 213.85, last 128 main loops 36.00 per node 271.06
vector rates in 7.1346e6, out 7.1346e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 66540 13983413 0 9.99e0 210.15
TenGigabitEtherneta/0/0-tx active 66540 13983413 0 4.14e1 210.15
TenGigabitEtherneta/0/1-output active 64286 13983488 0 1.12e1 217.52
TenGigabitEtherneta/0/1-tx active 64286 13983488 0 4.14e1 217.52
dpdk-input polling 66632 27966901 0 4.76e1 419.72
ethernet-input active 130826 27966901 0 1.62e1 213.77
ip6-input active 129527 27966901 0 2.53e1 215.92
ip6-load-balance active 66540 13983413 0 1.94e1 210.15
ip6-lookup active 196067 41950314 0 6.44e1 213.96
ip6-rewrite active 130826 27966901 0 3.13e1 213.77
sr-localsid-d active 64286 13983488 0 3.42e1 217.52
sr-pl-rewrite-encaps active 66540 13983413 0 5.01e1 210.15
unix-epoll-input polling 65 0 0 1.43e3 0.00
78b-2t2c-ethip6ip6-ip6base-srv6enc1sid-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 43 2.79e4 0.00
dpdk-process any wait 0 0 1 2.88e4 0.00
fib-walk any wait 0 0 2 3.25e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 7.07e3 0.00
lisp-retry-service any wait 0 0 2 1.11e4 0.00
unix-epoll-input polling 3443 0 0 2.63e6 0.00
vpe-oam-process any wait 0 0 2 2.39e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 30.07, last 128 main loops 0.00 per node 0.00
vector rates in 4.8249e6, out 4.8249e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 635590 19110088 0 1.76e1 30.07
TenGigabitEtherneta/0/1-tx active 635590 19110088 0 4.42e1 30.07
dpdk-input polling 19553894 19110088 0 1.42e2 .98
ethernet-input active 635590 19110088 0 2.57e1 30.07
ip6-input active 635590 19110088 0 3.07e1 30.07
ip6-lookup active 635590 19110088 0 6.27e1 30.07
ip6-rewrite active 635590 19110088 0 3.60e1 30.07
sr-localsid-d active 635590 19110088 0 4.09e1 30.07
unix-epoll-input polling 19077 0 0 1.33e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 48.47, last 128 main loops 0.00 per node 0.00
vector rates in 4.8266e6, out 4.8266e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 394369 19116636 0 1.44e1 48.47
TenGigabitEtherneta/0/0-tx active 394369 19116636 0 4.19e1 48.47
dpdk-input polling 3560810 19116636 0 6.93e1 5.37
ethernet-input active 394369 19116636 0 2.18e1 48.47
ip6-input active 394369 19116636 0 3.13e1 48.47
ip6-load-balance active 394369 19116636 0 2.27e1 48.47
ip6-lookup active 788738 38233272 0 8.76e1 48.47
ip6-rewrite active 394369 19116636 0 3.33e1 48.47
sr-pl-rewrite-encaps active 394369 19116636 0 5.04e1 48.47
unix-epoll-input polling 3474 0 0 1.34e3 0.00
78b-4t4c-ethip6ip6-ip6base-srv6enc1sid-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 44 2.95e4 0.00
dpdk-process any wait 0 0 1 1.42e4 0.00
fib-walk any wait 0 0 2 3.45e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 3.98e3 0.00
lisp-retry-service any wait 0 0 2 3.93e3 0.00
unix-epoll-input polling 3839 0 0 2.35e6 0.00
vpe-oam-process any wait 0 0 2 1.44e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 131.62, last 128 main loops 7.50 per node 120.00
vector rates in 8.9739e6, out 8.9739e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 268609 35355366 0 1.09e1 131.62
TenGigabitEtherneta/0/1-tx active 268609 35355366 0 3.77e1 131.62
dpdk-input polling 272168 35355366 0 4.70e1 129.90
ethernet-input active 268609 35355366 0 1.56e1 131.62
ip6-input active 268609 35355366 0 2.51e1 131.62
ip6-lookup active 268609 35355366 0 5.64e1 131.62
ip6-rewrite active 268609 35355366 0 2.92e1 131.62
sr-localsid-d active 268609 35355366 0 3.26e1 131.62
unix-epoll-input polling 266 0 0 1.38e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-input polling 58883464 0 0 7.47e1 0.00
unix-epoll-input polling 57447 0 0 9.04e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 3.9, average vectors/node 19.09, last 128 main loops 1.88 per node 24.00
vector rates in 4.5047e6, out 4.5047e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 929737 17747524 0 2.17e1 19.09
TenGigabitEtherneta/0/0-tx active 929737 17747524 0 4.77e1 19.09
dpdk-input polling 989613 17747524 0 7.24e1 17.93
ethernet-input active 929737 17747524 0 3.08e1 19.09
ip6-input active 929737 17747524 0 4.16e1 19.09
ip6-load-balance active 929737 17747524 0 2.86e1 19.09
ip6-lookup active 1859474 35495048 0 8.20e1 19.09
ip6-rewrite active 929737 17747524 0 3.92e1 19.09
sr-pl-rewrite-encaps active 929737 17747524 0 5.72e1 19.09
unix-epoll-input polling 966 0 0 1.32e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 3.9, average vectors/node 20.18, last 128 main loops 1.95 per node 25.00
vector rates in 4.4692e6, out 4.4692e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 872445 17607784 0 2.10e1 20.18
TenGigabitEtherneta/0/0-tx active 872445 17607784 0 4.74e1 20.18
dpdk-input polling 907056 17607784 0 8.03e1 19.41
ethernet-input active 872445 17607784 0 3.09e1 20.18
ip6-input active 872445 17607784 0 4.09e1 20.18
ip6-load-balance active 872445 17607784 0 2.92e1 20.18
ip6-lookup active 1744890 35215568 0 8.13e1 20.18
ip6-rewrite active 872445 17607784 0 3.83e1 20.18
sr-pl-rewrite-encaps active 872445 17607784 0 5.83e1 20.18
unix-epoll-input polling 885 0 0 1.47e3 0.00

10ge2p1x520-ethip6srhip6-ip6base-srv6enc2sids-ndrpdr

Packet throughput Segment routing over IPv6 dataplane with two SIDs (SRH inserted) test cases

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv6-SRH-IPv6 on DUT1-DUT2, Eth-IPv6 on TG-DUTn for IPv6 routing over SRv6.
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv6 routing and static route, SR policy and steering policy for one direction and two SR behaviours (functions) - End and End.DX6 - for other direction. DUT1 and DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header,IPv6 header with static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: SRv6 Network Programming - draft 3.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 51 6.15e4 0.00
dpdk-process any wait 0 0 2 8.45e5 0.00
fib-walk any wait 0 0 2 7.47e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 5.41e3 0.00
lisp-retry-service any wait 0 0 2 9.02e3 0.00
unix-epoll-input polling 3680 0 0 2.45e6 0.00
vpe-oam-process any wait 0 0 2 1.75e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 220.27, last 128 main loops 38.20 per node 257.37
vector rates in 5.9685e6, out 5.9685e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 54501 11793068 0 9.85e0 216.38
TenGigabitEtherneta/0/0-tx active 54501 11793068 0 4.32e1 216.38
TenGigabitEtherneta/0/1-output active 53536 11793011 0 1.05e1 220.28
TenGigabitEtherneta/0/1-tx active 53536 11793011 0 4.22e1 220.28
dpdk-input polling 54503 23586079 0 4.75e1 432.75
ethernet-input active 108037 23586079 0 1.61e1 218.31
ip6-input active 105475 23586079 0 2.54e1 223.62
ip6-load-balance active 54501 11793068 0 1.93e1 216.38
ip6-lookup active 213512 47172158 0 6.21e1 220.93
ip6-rewrite active 105475 23586079 0 3.35e1 223.62
sr-localsid-d active 53536 11793011 0 3.48e1 220.28
sr-localsid active 53536 11793011 0 3.73e1 220.28
sr-pl-rewrite-encaps active 54501 11793068 0 7.62e1 216.38
unix-epoll-input polling 53 0 0 1.63e3 0.00
78b-2t2c-ethip6srhip6-ip6base-srv6enc2sids-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 4.61e4 0.00
dpdk-process any wait 0 0 1 1.97e4 0.00
fib-walk any wait 0 0 2 2.69e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.52e3 0.00
lisp-retry-service any wait 0 0 2 8.48e3 0.00
unix-epoll-input polling 3487 0 0 2.60e6 0.00
vpe-oam-process any wait 0 0 2 5.88e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 41.28, last 128 main loops .94 per node 12.00
vector rates in 5.3842e6, out 5.3842e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 517918 21379067 0 1.59e1 41.28
TenGigabitEtherneta/0/1-tx active 517918 21379067 0 4.33e1 41.28
dpdk-input polling 1100600 21379067 0 6.18e1 19.42
ethernet-input active 517918 21379067 0 2.36e1 41.28
ip6-input active 517918 21379067 0 3.28e1 41.28
ip6-lookup active 1035836 42758134 0 6.26e1 41.28
ip6-rewrite active 517918 21379067 0 3.46e1 41.28
sr-localsid-d active 517918 21379067 0 4.11e1 41.28
sr-localsid active 517918 21379067 0 4.31e1 41.28
unix-epoll-input polling 1074 0 0 1.35e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 234.23, last 128 main loops 19.92 per node 255.00
vector rates in 5.3842e6, out 5.3842e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 91275 21379077 0 9.79e0 234.23
TenGigabitEtherneta/0/0-tx active 91275 21379077 0 3.90e1 234.23
dpdk-input polling 91275 21379077 0 4.47e1 234.23
ethernet-input active 91275 21379077 0 1.49e1 234.23
ip6-input active 91275 21379077 0 2.60e1 234.23
ip6-load-balance active 91275 21379077 0 1.94e1 234.23
ip6-lookup active 182550 42758154 0 8.19e1 234.23
ip6-rewrite active 91275 21379077 0 3.06e1 234.23
sr-pl-rewrite-encaps active 91275 21379077 0 7.69e1 234.23
unix-epoll-input polling 89 0 0 1.57e3 0.00
78b-4t4c-ethip6srhip6-ip6base-srv6enc2sids-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 49 3.19e4 0.00
dpdk-process any wait 0 0 2 9.90e5 0.00
fib-walk any wait 0 0 2 2.00e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 3.96e3 0.00
lisp-retry-service any wait 0 0 2 2.59e3 0.00
unix-epoll-input polling 3763 0 0 2.40e6 0.00
vpe-oam-process any wait 0 0 2 6.89e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 129.16, last 128 main loops 11.17 per node 143.00
vector rates in 6.4056e6, out 6.4056e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 195948 25309103 0 1.11e1 129.16
TenGigabitEtherneta/0/1-tx active 195948 25309103 0 3.80e1 129.16
dpdk-input polling 199276 25309103 0 4.80e1 127.01
ethernet-input active 195948 25309103 0 1.61e1 129.16
ip6-input active 195948 25309103 0 2.64e1 129.16
ip6-lookup active 391896 50618206 0 5.71e1 129.16
ip6-rewrite active 195948 25309103 0 3.07e1 129.16
sr-localsid-d active 195948 25309103 0 3.46e1 129.16
sr-localsid active 195948 25309103 0 3.77e1 129.16
unix-epoll-input polling 195 0 0 1.39e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-input polling 60390073 0 0 7.65e1 0.00
unix-epoll-input polling 58917 0 0 8.96e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 3.9, average vectors/node 14.46, last 128 main loops 0.00 per node 0.00
vector rates in 3.2155e6, out 3.2155e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 878449 12704590 0 2.56e1 14.46
TenGigabitEtherneta/0/0-tx active 878449 12704590 0 5.28e1 14.46
dpdk-input polling 11018359 12704590 0 1.50e2 1.15
ethernet-input active 878449 12704590 0 3.67e1 14.46
ip6-input active 878449 12704590 0 4.54e1 14.46
ip6-load-balance active 878449 12704590 0 3.18e1 14.46
ip6-lookup active 1756898 25409180 0 8.72e1 14.46
ip6-rewrite active 878449 12704590 0 4.18e1 14.46
sr-pl-rewrite-encaps active 878449 12704590 0 8.59e1 14.46
unix-epoll-input polling 10749 0 0 1.25e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 3.9, average vectors/node 14.84, last 128 main loops 0.00 per node 0.00
vector rates in 3.1902e6, out 3.1902e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 849570 12604536 0 2.52e1 14.84
TenGigabitEtherneta/0/0-tx active 849570 12604536 0 5.27e1 14.84
dpdk-input polling 10640529 12604536 0 1.56e2 1.18
ethernet-input active 849570 12604536 0 3.66e1 14.84
ip6-input active 849570 12604536 0 4.67e1 14.84
ip6-load-balance active 849570 12604536 0 3.18e1 14.84
ip6-lookup active 1699140 25209072 0 8.64e1 14.84
ip6-rewrite active 849570 12604536 0 4.25e1 14.84
sr-pl-rewrite-encaps active 849570 12604536 0 9.08e1 14.84
unix-epoll-input polling 10381 0 0 1.34e3 0.00

10ge2p1x520-ethip6srhip6-ip6base-srv6enc2sids-nodecaps-ndrpdr

Packet throughput Segment routing over IPv6 dataplane with two SIDs (SRH inserted) without decapsulation test cases

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv6-SRH-IPv6 on DUT1-DUT2 and DUTn->TG, Eth-IPv6 on TG->DUTn for IPv6 routing over SRv6.
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv6 routing and static route, SR policy and steering policy for one direction and one SR behaviour (function) - End - for other direction. DUT1 and DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header,IPv6 header with static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: SRv6 Network Programming - draft 3.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
78b-1t1c-ethip6srhip6-ip6base-srv6enc2sids-nodecaps-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 50 5.65e4 0.00
dpdk-process any wait 0 0 1 1.87e4 0.00
fib-walk any wait 0 0 2 6.46e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.39e3 0.00
lisp-retry-service any wait 0 0 2 2.00e3 0.00
unix-epoll-input polling 3409 0 0 2.63e6 0.00
vpe-oam-process any wait 0 0 2 1.19e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 232.74, last 128 main loops 32.87 per node 233.72
vector rates in 6.1930e6, out 6.1930e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 52175 12142560 0 1.02e1 232.73
TenGigabitEtherneta/0/0-tx active 52175 12142560 0 4.24e1 232.73
TenGigabitEtherneta/0/1-output active 52174 12142592 0 1.04e1 232.73
TenGigabitEtherneta/0/1-tx active 52174 12142592 0 4.37e1 232.73
dpdk-input polling 52176 24285152 0 4.69e1 465.45
ethernet-input active 104349 24285152 0 1.56e1 232.73
ip6-input active 104338 24285152 0 2.49e1 232.75
ip6-load-balance active 52175 12142560 0 1.92e1 232.73
ip6-lookup active 208687 48570304 0 6.55e1 232.74
ip6-rewrite active 104349 24285152 0 3.09e1 232.73
sr-localsid active 52174 12142592 0 3.72e1 232.73
sr-pl-rewrite-encaps active 52175 12142560 0 7.70e1 232.73
unix-epoll-input polling 51 0 0 1.44e3 0.00
78b-2t2c-ethip6srhip6-ip6base-srv6enc2sids-nodecaps-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 46 3.97e4 0.00
dpdk-process any wait 0 0 1 3.53e4 0.00
fib-walk any wait 0 0 2 1.37e4 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 7.59e3 0.00
lisp-retry-service any wait 0 0 2 3.11e3 0.00
unix-epoll-input polling 3782 0 0 2.39e6 0.00
vpe-oam-process any wait 0 0 2 1.27e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 31.05, last 128 main loops 0.00 per node 0.00
vector rates in 5.4229e6, out 5.4229e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 691517 21470313 0 1.77e1 31.05
TenGigabitEtherneta/0/1-tx active 691517 21470313 0 4.42e1 31.05
dpdk-input polling 2633605 21470313 0 7.19e1 8.15
ethernet-input active 691517 21470313 0 2.60e1 31.05
ip6-input active 691517 21470313 0 3.57e1 31.05
ip6-lookup active 1383034 42940626 0 6.95e1 31.05
ip6-rewrite active 691517 21470313 0 3.45e1 31.05
sr-localsid active 691517 21470313 0 4.41e1 31.05
unix-epoll-input polling 2569 0 0 1.31e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 245.59, last 128 main loops 20.00 per node 256.00
vector rates in 5.4228e6, out 5.4228e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 87421 21470208 0 9.83e0 245.59
TenGigabitEtherneta/0/0-tx active 87421 21470208 0 3.89e1 245.59
dpdk-input polling 87421 21470208 0 4.45e1 245.59
ethernet-input active 87421 21470208 0 1.47e1 245.59
ip6-input active 87421 21470208 0 2.58e1 245.59
ip6-load-balance active 87421 21470208 0 1.92e1 245.59
ip6-lookup active 174842 42940416 0 8.14e1 245.59
ip6-rewrite active 87421 21470208 0 3.07e1 245.59
sr-pl-rewrite-encaps active 87421 21470208 0 7.54e1 245.59
unix-epoll-input polling 86 0 0 1.64e3 0.00
78b-4t4c-ethip6srhip6-ip6base-srv6enc2sids-nodecaps-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 46 2.96e4 0.00
dpdk-process any wait 0 0 2 2.12e4 0.00
fib-walk any wait 0 0 2 3.57e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 3 1.58e4 0.00
lisp-retry-service any wait 0 0 2 1.68e4 0.00
unix-epoll-input polling 4927 0 0 1.83e6 0.00
vpe-oam-process any wait 0 0 2 1.26e4 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 119.17, last 128 main loops 7.52 per node 107.00
vector rates in 6.9574e6, out 6.9574e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 230544 27473836 0 1.11e1 119.17
TenGigabitEtherneta/0/1-tx active 230544 27473836 0 3.76e1 119.17
dpdk-input polling 233856 27473836 0 4.76e1 117.48
ethernet-input active 230544 27473836 0 1.58e1 119.17
ip6-input active 230544 27473836 0 2.67e1 119.17
ip6-lookup active 461088 54947672 0 6.18e1 119.17
ip6-rewrite active 230544 27473836 0 2.89e1 119.17
sr-localsid active 230544 27473836 0 3.71e1 119.17
unix-epoll-input polling 228 0 0 1.37e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-input polling 58789680 0 0 7.97e1 0.00
unix-epoll-input polling 57356 0 0 8.96e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 3.9, average vectors/node 14.17, last 128 main loops 0.00 per node 0.00
vector rates in 3.4924e6, out 3.4924e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 973371 13791212 0 2.53e1 14.17
TenGigabitEtherneta/0/0-tx active 973371 13791212 0 5.15e1 14.17
dpdk-input polling 7197501 13791212 0 1.23e2 1.92
ethernet-input active 973371 13791212 0 3.59e1 14.17
ip6-input active 973371 13791212 0 4.60e1 14.17
ip6-load-balance active 973371 13791212 0 3.18e1 14.17
ip6-lookup active 1946742 27582424 0 8.76e1 14.17
ip6-rewrite active 973371 13791212 0 4.24e1 14.17
sr-pl-rewrite-encaps active 973371 13791212 0 8.55e1 14.17
unix-epoll-input polling 7022 0 0 1.26e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 3.9, average vectors/node 14.70, last 128 main loops 0.00 per node 0.00
vector rates in 3.4649e6, out 3.4649e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 930745 13682620 0 2.52e1 14.70
TenGigabitEtherneta/0/0-tx active 930745 13682620 0 5.25e1 14.70
dpdk-input polling 6551648 13682620 0 1.27e2 2.09
ethernet-input active 930745 13682620 0 3.68e1 14.70
ip6-input active 930745 13682620 0 4.56e1 14.70
ip6-load-balance active 930745 13682620 0 3.19e1 14.70
ip6-lookup active 1861490 27365240 0 8.72e1 14.70
ip6-rewrite active 930745 13682620 0 4.19e1 14.70
sr-pl-rewrite-encaps active 930745 13682620 0 9.01e1 14.70
unix-epoll-input polling 6392 0 0 1.33e3 0.00

10ge2p1x520-ethip6srhip6-ip6base-srv6proxy-dyn-ndrpdr

Packet throughput Segment routing over IPv6 dataplane with Dynamic SRv6 proxy test cases

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv6-SRH-IPv6 on DUT1-DUT2 and DUTn->TG, Eth-IPv6 on TG->DUTn and DUTn-LXC for IPv6 routing over SRv6.
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv6 routing and static route, SR policy and steering policy for one direction and one SR behaviour (function) - End.AD - for other direction. DUT1 and DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header,IPv6 header with static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: SRv6 Network Programming - draft 3 and Segment Routing for Service Chaining - internet draft 01.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
78b-1t1c-ethip6srhip6-ip6base-srv6proxy-dyn-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 1.00e5 0.00
dpdk-process any wait 0 0 1 4.23e4 0.00
fib-walk any wait 0 0 2 1.86e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 1.77e4 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 6.84e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 2.76e3 0.00
lisp-retry-service any wait 0 0 2 2.52e3 0.00
memif-process any wait 0 0 1 1.81e3 0.00
statseg-collector-process time wait 0 0 1 5.59e3 0.00
unix-epoll-input polling 3345 0 0 2.67e6 0.00
vpe-oam-process any wait 0 0 1 8.36e2 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 232.77, last 128 main loops 49.50 per node 253.44
vector rates in 5.4549e6, out 5.4549e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 30807 7095808 0 1.00e1 230.33
TenGigabitEtherneta/0/0-tx active 30807 7095808 0 4.48e1 230.33
TenGigabitEtherneta/0/1-output active 30532 7095808 0 1.17e1 232.41
TenGigabitEtherneta/0/1-tx active 30532 7095808 0 5.04e1 232.41
dpdk-input polling 30809 14191649 0 5.05e1 460.63
ethernet-input active 92147 21287457 0 1.52e1 231.02
ip6-input active 90312 21287457 0 3.18e1 235.71
ip6-load-balance active 30807 7095808 0 2.02e1 230.33
ip6-lookup active 121119 28383265 0 6.73e1 234.34
ip6-rewrite active 90997 21287457 0 3.09e1 233.94
memif-input polling 30809 7095808 0 9.72e1 230.32
memif1/1-output active 30808 7095841 0 1.02e1 230.32
memif1/1-tx active 30808 7095841 0 1.36e2 230.32
sr-pl-rewrite-encaps active 30807 7095808 0 7.96e1 230.33
srv6-ad-localsid active 30808 7095841 0 8.17e1 230.32
srv6-ad6-rewrite active 30532 7095808 0 1.13e2 232.41
unix-epoll-input polling 30 0 0 2.35e3 0.00
78b-2t2c-ethip6srhip6-ip6base-srv6proxy-dyn-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 6.05e4 0.00
dpdk-process any wait 0 0 2 1.73e4 0.00
fib-walk any wait 0 0 2 5.79e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 4.04e3 0.00
lisp-retry-service any wait 0 0 2 3.26e3 0.00
memif-process any wait 0 0 1 1.55e4 0.00
unix-epoll-input polling 2575 0 0 3.47e6 0.00
vpe-oam-process any wait 0 0 2 7.90e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 13.66, last 128 main loops 14.81 per node 12.47
vector rates in 2.7385e6, out 2.7385e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-input polling 9566970 10706981 0 1.74e2 1.12
ethernet-input active 784039 10706981 0 3.83e1 13.66
ip6-input active 784039 10706981 0 3.97e1 13.66
ip6-lookup active 784039 10706981 0 7.39e1 13.66
ip6-rewrite active 784039 10706981 0 4.49e1 13.66
memif-input polling 9566970 0 0 8.48e1 0.00
memif1/1-output active 784039 10706981 0 2.66e1 13.66
memif1/1-tx active 784039 10706981 0 2.02e2 13.66
srv6-ad-localsid active 784039 10706981 0 9.47e1 13.66
unix-epoll-input polling 9334 0 0 1.28e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 249.78, last 128 main loops 36.00 per node 256.00
vector rates in 5.4769e6, out 5.4769e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 42872 10706944 0 9.77e0 249.74
TenGigabitEtherneta/0/0-tx active 42872 10706944 0 5.34e1 249.74
TenGigabitEtherneta/0/1-output active 42870 10706950 0 1.15e1 249.75
TenGigabitEtherneta/0/1-tx active 42870 10706950 0 4.99e1 249.75
dpdk-input polling 42873 10706944 0 5.11e1 249.74
ethernet-input active 85742 21413894 0 1.52e1 249.75
ip6-input active 85708 21413894 0 3.06e1 249.85
ip6-load-balance active 42872 10706944 0 1.97e1 249.74
ip6-lookup active 128581 32120838 0 7.12e1 249.81
ip6-rewrite active 85742 21413894 0 2.93e1 249.75
memif-input polling 42873 10706950 0 1.00e2 249.74
sr-pl-rewrite-encaps active 42872 10706944 0 8.09e1 249.74
srv6-ad6-rewrite active 42870 10706950 0 9.51e1 249.75
unix-epoll-input polling 42 0 0 1.75e3 0.00
78b-4t4c-ethip6srhip6-ip6base-srv6proxy-dyn-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 43 2.99e4 0.00
dpdk-process any wait 0 0 1 3.05e4 0.00
fib-walk any wait 0 0 2 2.62e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.88e3 0.00
lisp-retry-service any wait 0 0 2 1.99e3 0.00
memif-process any wait 0 0 2 1.27e4 0.00
unix-epoll-input polling 5913 0 0 1.51e6 0.00
vpe-oam-process any wait 0 0 2 2.56e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 21.49, last 128 main loops 0.00 per node 0.00
vector rates in 2.9435e6, out 2.9435e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-input polling 11358732 11509879 0 1.74e2 1.01
ethernet-input active 535585 11509879 0 3.08e1 21.49
ip6-input active 535585 11509879 0 3.78e1 21.49
ip6-lookup active 535585 11509879 0 6.85e1 21.49
ip6-rewrite active 535585 11509879 0 3.93e1 21.49
memif-input polling 11358732 0 0 8.04e1 0.00
memif1/1-output active 535585 11509879 0 2.09e1 21.49
memif1/1-tx active 535585 11509879 0 1.71e2 21.49
srv6-ad-localsid active 535585 11509879 0 8.41e1 21.49
unix-epoll-input polling 11081 0 0 1.33e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-input polling 37012917 0 0 9.55e1 0.00
memif-input polling 37012917 0 0 7.34e1 0.00
unix-epoll-input polling 36110 0 0 8.59e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 3.9, average vectors/node 38.55, last 128 main loops 1.56 per node 20.00
vector rates in 4.4211e6, out 4.4211e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 199139 5777686 0 2.00e1 29.01
TenGigabitEtherneta/0/0-tx active 199139 5777686 0 5.39e1 29.01
TenGigabitEtherneta/0/1-output active 278178 11509860 0 1.69e1 41.38
TenGigabitEtherneta/0/1-tx active 278178 11509860 0 6.23e1 41.38
dpdk-input polling 507950 5777686 0 8.31e1 11.37
ethernet-input active 477317 17287546 0 2.69e1 36.22
ip6-input active 331923 17287546 0 4.48e1 52.08
ip6-load-balance active 199139 5777686 0 2.92e1 29.01
ip6-lookup active 550018 23065232 0 8.19e1 41.94
ip6-rewrite active 477317 17287546 0 3.85e1 36.22
memif-input polling 507950 11509860 0 1.35e2 22.66
sr-pl-rewrite-encaps active 199139 5777686 0 8.66e1 29.01
srv6-ad6-rewrite active 278178 11509860 0 9.37e1 41.38
unix-epoll-input polling 496 0 0 1.47e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 3.9, average vectors/node 13.53, last 128 main loops 0.00 per node 0.00
vector rates in 1.4659e6, out 1.4659e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 423761 5732193 0 2.73e1 13.53
TenGigabitEtherneta/0/0-tx active 423761 5732193 0 5.52e1 13.53
dpdk-input polling 21551445 5732193 0 4.49e2 .27
ethernet-input active 423761 5732193 0 3.89e1 13.53
ip6-input active 423761 5732193 0 5.00e1 13.53
ip6-load-balance active 423761 5732193 0 3.39e1 13.53
ip6-lookup active 847522 11464386 0 9.49e1 13.53
ip6-rewrite active 423761 5732193 0 4.46e1 13.53
memif-input polling 21551445 0 0 8.09e1 0.00
sr-pl-rewrite-encaps active 423761 5732193 0 9.52e1 13.53
unix-epoll-input polling 21026 0 0 1.24e3 0.00

10ge2p1x520-ethip6srhip6-ip6base-srv6proxy-masq-ndrpdr

Packet throughput Segment routing over IPv6 dataplane with Masquerading SRv6 proxy test cases

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv6-SRH-IPv6 on DUT1-DUT2, DUTn-LXC and DUTn->TG, Eth-IPv6 on TG->DUTn for IPv6 routing over SRv6.
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv6 routing and static route, SR policy and steering policy for one direction and one SR behaviour (function) - End.AM - for other direction. DUT1 and DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header,IPv6 header with static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: SRv6 Network Programming - draft 3 and Segment Routing for Service Chaining - internet draft 01.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
78b-1t1c-ethip6srhip6-ip6base-srv6proxy-masq-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 4.27e4 0.00
dpdk-process any wait 0 0 1 1.62e6 0.00
fib-walk any wait 0 0 2 1.77e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.25e3 0.00
lisp-retry-service any wait 0 0 2 1.58e3 0.00
memif-process any wait 0 0 2 2.12e3 0.00
unix-epoll-input polling 3812 0 0 2.34e6 0.00
vpe-oam-process any wait 0 0 2 9.16e2 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 255.58, last 128 main loops 52.00 per node 266.24
vector rates in 5.9012e6, out 5.9012e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 30027 7671808 0 9.86e0 255.49
TenGigabitEtherneta/0/0-tx active 30027 7671808 0 4.38e1 255.49
TenGigabitEtherneta/0/1-output active 30021 7671808 0 1.14e1 255.55
TenGigabitEtherneta/0/1-tx active 30021 7671808 0 4.96e1 255.55
dpdk-input polling 30027 15343616 0 5.04e1 510.99
ethernet-input active 90075 23015424 0 1.47e1 255.51
ip6-input active 90023 23015424 0 2.83e1 255.66
ip6-load-balance active 30027 7671808 0 1.95e1 255.49
ip6-lookup active 120050 30687232 0 7.06e1 255.62
ip6-rewrite active 90029 23015424 0 3.02e1 255.64
memif-input polling 30027 7671808 0 1.23e2 255.49
memif1/1-output active 30027 7671808 0 9.80e0 255.49
memif1/1-tx active 30027 7671808 0 1.51e2 255.49
sr-pl-rewrite-encaps active 30027 7671808 0 7.97e1 255.49
srv6-am-localsid active 30027 7671808 0 3.79e1 255.49
srv6-am-rewrite active 30021 7671808 0 2.52e1 255.55
unix-epoll-input polling 29 0 0 2.03e3 0.00
78b-2t2c-ethip6srhip6-ip6base-srv6proxy-masq-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 5.43e4 0.00
dpdk-process any wait 0 0 2 2.48e4 0.00
fib-walk any wait 0 0 2 7.85e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.27e3 0.00
lisp-retry-service any wait 0 0 2 1.61e3 0.00
memif-process any wait 0 0 1 1.18e4 0.00
unix-epoll-input polling 4967 0 0 1.79e6 0.00
vpe-oam-process any wait 0 0 2 6.50e2 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 14.88, last 128 main loops 0.00 per node 0.00
vector rates in 2.9934e6, out 2.9934e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-input polling 9722907 11703049 0 1.71e2 1.20
ethernet-input active 786437 11703049 0 3.76e1 14.88
ip6-input active 786437 11703049 0 3.85e1 14.88
ip6-lookup active 786437 11703049 0 7.19e1 14.88
ip6-rewrite active 786437 11703049 0 4.26e1 14.88
memif-input polling 9722907 0 0 7.93e1 0.00
memif1/1-output active 786437 11703049 0 2.63e1 14.88
memif1/1-tx active 786437 11703049 0 2.10e2 14.88
srv6-am-localsid active 786437 11703049 0 4.04e1 14.88
unix-epoll-input polling 9486 0 0 1.28e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 246.14, last 128 main loops 34.00 per node 241.78
vector rates in 5.9868e6, out 5.9868e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 47572 11703040 0 9.62e0 246.01
TenGigabitEtherneta/0/0-tx active 47572 11703040 0 5.27e1 246.01
TenGigabitEtherneta/0/1-output active 47568 11703058 0 1.14e1 246.03
TenGigabitEtherneta/0/1-tx active 47568 11703058 0 4.95e1 246.03
dpdk-input polling 47674 11703040 0 5.05e1 245.48
ethernet-input active 95140 23406098 0 1.55e1 246.02
ip6-input active 94969 23406098 0 2.89e1 246.46
ip6-load-balance active 47572 11703040 0 1.95e1 246.01
ip6-lookup active 142542 35109138 0 6.77e1 246.31
ip6-rewrite active 95140 23406098 0 2.94e1 246.02
memif-input polling 47674 11703058 0 1.15e2 245.48
sr-pl-rewrite-encaps active 47572 11703040 0 8.13e1 246.01
srv6-am-rewrite active 47568 11703058 0 2.39e1 246.03
unix-epoll-input polling 46 0 0 1.60e3 0.00
78b-4t4c-ethip6srhip6-ip6base-srv6proxy-masq-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 44 2.75e4 0.00
dpdk-process any wait 0 0 1 1.76e6 0.00
fib-walk any wait 0 0 2 2.64e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 3 1.74e3 0.00
lisp-retry-service any wait 0 0 2 2.54e3 0.00
memif-process any wait 0 0 1 2.14e3 0.00
unix-epoll-input polling 2877 0 0 3.09e6 0.00
vpe-oam-process any wait 0 0 2 6.42e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 20.03, last 128 main loops 0.00 per node 0.00
vector rates in 3.2458e6, out 3.2458e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-input polling 10751288 12620686 0 1.59e2 1.17
ethernet-input active 630054 12620686 0 3.14e1 20.03
ip6-input active 630054 12620686 0 3.52e1 20.03
ip6-lookup active 630054 12620686 0 6.69e1 20.03
ip6-rewrite active 630054 12620686 0 3.90e1 20.03
memif-input polling 10751288 0 0 7.66e1 0.00
memif1/1-output active 630054 12620686 0 2.15e1 20.03
memif1/1-tx active 630054 12620686 0 1.88e2 20.03
srv6-am-localsid active 630054 12620686 0 3.73e1 20.03
unix-epoll-input polling 10489 0 0 1.33e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-input polling 33369463 0 0 1.11e2 0.00
memif-input polling 33369463 0 0 7.41e1 0.00
unix-epoll-input polling 32556 0 0 8.60e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 3.9, average vectors/node 37.23, last 128 main loops 2.94 per node 47.00
vector rates in 4.8751e6, out 4.8751e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 221340 6335243 0 2.03e1 28.62
TenGigabitEtherneta/0/0-tx active 221340 6335243 0 5.38e1 28.62
TenGigabitEtherneta/0/1-output active 321753 12620645 0 1.68e1 39.22
TenGigabitEtherneta/0/1-tx active 321753 12620645 0 6.23e1 39.22
dpdk-input polling 527788 6335243 0 8.57e1 12.00
ethernet-input active 543093 18955888 0 2.75e1 34.90
ip6-input active 378768 18955888 0 3.95e1 50.05
ip6-load-balance active 221340 6335243 0 2.59e1 28.62
ip6-lookup active 622522 25291131 0 7.52e1 40.63
ip6-rewrite active 543093 18955888 0 3.88e1 34.90
memif-input polling 527788 12620645 0 1.51e2 23.91
sr-pl-rewrite-encaps active 221340 6335243 0 9.29e1 28.62
srv6-am-rewrite active 321753 12620645 0 2.27e1 39.22
unix-epoll-input polling 514 0 0 1.40e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 3.9, average vectors/node 14.10, last 128 main loops 0.00 per node 0.00
vector rates in 1.6165e6, out 1.6165e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 445626 6285358 0 2.66e1 14.10
TenGigabitEtherneta/0/0-tx active 445626 6285358 0 5.53e1 14.10
dpdk-input polling 20531025 6285358 0 3.97e2 .31
ethernet-input active 445626 6285358 0 3.78e1 14.10
ip6-input active 445626 6285358 0 4.84e1 14.10
ip6-load-balance active 445626 6285358 0 3.33e1 14.10
ip6-lookup active 891252 12570716 0 8.75e1 14.10
ip6-rewrite active 445626 6285358 0 4.39e1 14.10
memif-input polling 20531025 0 0 7.79e1 0.00
sr-pl-rewrite-encaps active 445626 6285358 0 1.05e2 14.10
unix-epoll-input polling 20030 0 0 1.25e3 0.00

10ge2p1x520-ethip6srhip6-ip6base-srv6proxy-stat-ndrpdr

Packet throughput Segment routing over IPv6 dataplane with Static SRv6 proxy test cases

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv6-SRH-IPv6 on DUT1-DUT2 and DUTn->TG, Eth-IPv6 on TG->DUTn and DUTn-LXC for IPv6 routing over SRv6.
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with IPv6 routing and static route, SR policy and steering policy for one direction and one SR behaviour (function) - End.AS - for other direction. DUT1 and DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header,IPv6 header with static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: SRv6 Network Programming - draft 3 and Segment Routing for Service Chaining - internet draft 01.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
78b-1t1c-ethip6srhip6-ip6base-srv6proxy-stat-ndrpdr
 Not Captured 
78b-2t2c-ethip6srhip6-ip6base-srv6proxy-stat-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 7.07e4 0.00
dhcp-client-process any wait 0 0 1 1.08e3 0.00
dpdk-process any wait 0 0 1 3.14e4 0.00
fib-walk any wait 0 0 2 6.33e3 0.00
ip-route-resolver-process any wait 0 0 1 9.36e2 0.00
ip4-reassembly-expire-walk any wait 0 0 1 2.35e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 1.27e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 2.16e3 0.00
lisp-retry-service any wait 0 0 2 2.29e3 0.00
memif-process any wait 0 0 2 2.22e3 0.00
statseg-collector-process time wait 0 0 1 5.08e3 0.00
unix-epoll-input polling 4719 0 0 1.87e6 0.00
vpe-oam-process any wait 0 0 2 1.25e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 13.82, last 128 main loops 0.00 per node 0.00
vector rates in 2.8009e6, out 2.8009e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-input polling 10793988 10841823 0 1.85e2 1.00
ethernet-input active 784721 10841823 0 3.85e1 13.82
ip6-input active 784721 10841823 0 3.95e1 13.82
ip6-lookup active 784721 10841823 0 7.29e1 13.82
ip6-rewrite active 784721 10841823 0 4.83e1 13.82
memif-input polling 10793988 0 0 8.06e1 0.00
memif1/1-output active 784721 10841823 0 2.64e1 13.82
memif1/1-tx active 784721 10841823 0 2.05e2 13.82
srv6-as-localsid active 784721 10841823 0 4.92e1 13.82
unix-epoll-input polling 10531 0 0 1.32e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 234.62, last 128 main loops 36.00 per node 256.00
vector rates in 5.6018e6, out 5.6018e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 46302 10841896 0 9.82e0 234.16
TenGigabitEtherneta/0/0-tx active 46302 10841896 0 5.27e1 234.16
TenGigabitEtherneta/0/1-output active 46291 10841903 0 1.16e1 234.21
TenGigabitEtherneta/0/1-tx active 46291 10841903 0 5.06e1 234.21
dpdk-input polling 46313 10841896 0 5.14e1 234.10
ethernet-input active 92593 21683799 0 1.57e1 234.18
ip6-input active 91989 21683799 0 2.95e1 235.72
ip6-load-balance active 46302 10841896 0 1.96e1 234.16
ip6-lookup active 138292 32525695 0 6.91e1 235.19
ip6-rewrite active 92593 21683799 0 3.04e1 234.18
memif-input polling 46313 10841903 0 1.03e2 234.10
sr-pl-rewrite-encaps active 46302 10841896 0 8.22e1 234.16
srv6-as6-rewrite active 46291 10841903 0 7.83e1 234.21
unix-epoll-input polling 45 0 0 1.56e3 0.00
78b-4t4c-ethip6srhip6-ip6base-srv6proxy-stat-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 7.44e4 0.00
dpdk-process any wait 0 0 1 2.01e4 0.00
fib-walk any wait 0 0 2 1.42e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 9.88e2 0.00
lisp-retry-service any wait 0 0 2 2.26e3 0.00
memif-process any wait 0 0 1 1.96e3 0.00
unix-epoll-input polling 3331 0 0 2.67e6 0.00
vpe-oam-process any wait 0 0 2 6.46e2 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 3.9, average vectors/node 249.03, last 128 main loops 32.00 per node 256.00
vector rates in 6.0684e6, out 6.0684e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 47480 11804928 0 1.04e1 248.63
TenGigabitEtherneta/0/1-tx active 47480 11804928 0 4.83e1 248.63
dpdk-input polling 48010 11804928 0 5.12e1 245.88
ethernet-input active 94960 23609856 0 1.45e1 248.63
ip6-input active 94651 23609856 0 2.89e1 249.44
ip6-lookup active 94651 23609856 0 6.38e1 249.44
ip6-rewrite active 94652 23609856 0 3.35e1 249.44
memif-input polling 48010 11804928 0 9.43e1 245.88
memif1/1-output active 47480 11804928 0 9.75e0 248.63
memif1/1-tx active 47480 11804928 0 1.33e2 248.63
srv6-as-localsid active 47480 11804928 0 5.02e1 248.63
srv6-as6-rewrite active 47480 11804928 0 7.62e1 248.63
unix-epoll-input polling 47 0 0 2.21e3 0.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 3.9, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-input polling 36236963 0 0 9.69e1 0.00
memif-input polling 36236963 0 0 7.57e1 0.00
unix-epoll-input polling 35353 0 0 8.64e2 0.00
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 3.9, average vectors/node 17.09, last 128 main loops 0.00 per node 0.00
vector rates in 1.5231e6, out 1.5231e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 346562 5925721 0 2.39e1 17.09
TenGigabitEtherneta/0/0-tx active 346562 5925721 0 5.27e1 17.09
dpdk-input polling 22273702 5925721 0 4.37e2 .27
ethernet-input active 346562 5925721 0 3.42e1 17.09
ip6-input active 346562 5925721 0 4.58e1 17.09
ip6-load-balance active 346562 5925721 0 3.06e1 17.09
ip6-lookup active 693124 11851442 0 8.40e1 17.09
ip6-rewrite active 346562 5925721 0 4.05e1 17.09
memif-input polling 22273702 0 0 8.19e1 0.00
sr-pl-rewrite-encaps active 346562 5925721 0 8.37e1 17.09
unix-epoll-input polling 21730 0 0 1.18e3 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 3.9, average vectors/node 17.44, last 128 main loops 0.00 per node 0.00
vector rates in 1.5111e6, out 1.5111e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 337149 5879059 0 2.37e1 17.44
TenGigabitEtherneta/0/0-tx active 337149 5879059 0 5.25e1 17.44
dpdk-input polling 22057029 5879059 0 4.37e2 .27
ethernet-input active 337149 5879059 0 3.37e1 17.44
ip6-input active 337149 5879059 0 4.66e1 17.44
ip6-load-balance active 337149 5879059 0 3.08e1 17.44
ip6-lookup active 674298 11758118 0 8.39e1 17.44
ip6-rewrite active 337149 5879059 0 4.09e1 17.44
memif-input polling 22057029 0 0 8.34e1 0.00
sr-pl-rewrite-encaps active 337149 5879059 0 9.03e1 17.44
unix-epoll-input polling 21519 0 0 1.30e3 0.00

vts

10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr

RFC2544: Packet throughput L2BD test cases with VXLANoIPv4 and vhost

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 for L2 switching of IPv4. Eth-IPv4-VXLAN-Eth-IPv4 is applied on link between DUT1 and DUT2.
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with L2 bridge- domain and MAC learning enabled. Qemu Guest is connected to VPP via vhost-user interfaces. Guest is running DPDK testpmd interconnecting vhost-user interfaces using 5 cores pinned to cpus 5-9 and 2048M memory. Testpmd is using socket-mem=1024M (512x2M hugepages), 5 cores (1 main core and 4 cores dedicated for io), forwarding mode is set to io, rxd/txd=256, burst=64. DUT1, DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: RFC2544, RFC7348.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
114b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 23 2.84e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 2.36e3 0.00
api-rx-from-ring active 0 0 52 8.56e4 0.00
dpdk-process any wait 0 0 1 2.89e4 0.00
fib-walk any wait 0 0 2 8.38e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 5 1.08e4 0.00
lisp-retry-service any wait 0 0 2 6.27e3 0.00
unix-epoll-input polling 8913 0 0 1.12e6 0.00
vhost-user-process any wait 0 0 2 1.63e4 0.00
vpe-oam-process any wait 0 0 3 3.05e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 253.01, last 128 main loops 84.00 per node 268.80
vector rates in 6.2151e6, out 6.2151e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 26558 6798080 0 1.10e1 255.97
TenGigabitEtherneta/0/0-tx active 26558 6798080 0 5.13e1 255.97
TenGigabitEtherneta/0/1-output active 26555 6798080 0 1.05e1 256.00
TenGigabitEtherneta/0/1-tx active 26555 6798080 0 4.96e1 256.00
VirtualEthernet0/0/0-output active 27088 6798080 0 1.00e1 250.96
VirtualEthernet0/0/0-tx active 27088 6798080 0 9.76e1 250.96
VirtualEthernet0/0/1-output active 27088 6798080 0 9.65e0 250.96
VirtualEthernet0/0/1-tx active 27088 6798080 0 1.04e2 250.96
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.72e3 0.00
acl-plugin-in-ip4-l2 active 27088 6798080 0 1.69e2 250.96
dpdk-input polling 27088 13596160 0 5.15e1 501.93
ethernet-input active 107289 27192320 0 1.77e1 253.45
ip4-input-no-checksum active 27088 6798080 0 2.13e1 250.96
ip4-local active 27088 6798080 0 4.58e1 250.96
ip4-lookup active 27088 6798080 0 3.18e1 250.96
ip4-rewrite active 26555 6798080 0 2.57e1 256.00
ip4-udp-lookup active 27088 6798080 0 2.91e1 250.96
l2-fwd active 107289 27192320 0 3.03e1 253.45
l2-input active 107289 27192320 0 3.03e1 253.45
l2-input-feat-arc active 27088 6798080 0 1.98e1 250.96
l2-input-feat-arc-end active 27088 6798080 0 8.95e0 250.96
l2-learn active 107289 27192320 0 2.01e1 253.45
l2-output active 107289 27192320 0 8.71e0 253.45
unix-epoll-input polling 27 0 0 3.46e3 0.00
vhost-user-input polling 27088 13596160 0 7.76e1 501.93
vxlan4-encap active 26555 6798080 0 5.69e1 256.00
vxlan4-input active 27088 6798080 0 3.42e1 250.96
114b-2t2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 16 4.39e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 2.46e3 0.00
api-rx-from-ring active 0 0 52 6.94e4 0.00
dpdk-process any wait 0 0 1 2.47e4 0.00
fib-walk any wait 0 0 2 4.86e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 5.96e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 2.22e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 4.22e3 0.00
lisp-retry-service any wait 0 0 2 9.28e3 0.00
statseg-collector-process time wait 0 0 1 8.10e3 0.00
unix-epoll-input polling 8441 0 0 1.18e6 0.00
vhost-user-process any wait 0 0 1 2.10e4 0.00
vpe-oam-process any wait 0 0 2 4.20e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 248.41, last 128 main loops 42.00 per node 256.00
vector rates in 5.5457e6, out 5.5457e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 48681 12116992 0 1.01e1 248.91
TenGigabitEtherneta/0/1-tx active 48681 12116992 0 4.89e1 248.91
VirtualEthernet0/0/1-output active 48900 12116992 0 9.26e0 247.79
VirtualEthernet0/0/1-tx active 48900 12116992 0 1.16e2 247.79
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.92e3 0.00
acl-plugin-in-ip4-l2 active 48900 12116992 0 1.79e2 247.79
dpdk-input polling 48901 12116992 0 5.26e1 247.79
ethernet-input active 97581 24233984 0 1.85e1 248.35
ip4-rewrite active 48681 12116992 0 2.52e1 248.91
l2-fwd active 97581 24233984 0 3.06e1 248.35
l2-input active 97253 24233984 0 3.09e1 249.18
l2-input-feat-arc active 48900 12116992 0 2.07e1 247.79
l2-input-feat-arc-end active 48900 12116992 0 7.88e0 247.79
l2-learn active 97581 24233984 0 2.04e1 248.35
l2-output active 97581 24233984 0 8.28e0 248.35
unix-epoll-input polling 48 0 0 1.96e3 0.00
vhost-user-input polling 48901 12116992 0 8.12e1 247.79
vxlan4-encap active 48681 12116992 0 5.67e1 248.91
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 4.4, average vectors/node 73.41, last 128 main loops 0.00 per node 0.00
vector rates in 5.5457e6, out 5.5457e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 178594 12117048 0 1.45e1 67.85
TenGigabitEtherneta/0/0-tx active 178594 12117048 0 5.39e1 67.85
VirtualEthernet0/0/0-output active 157693 12117168 0 1.31e1 76.84
VirtualEthernet0/0/0-tx active 157693 12117168 0 1.32e2 76.84
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.92e3 0.00
dpdk-input polling 1033051 12117168 0 6.63e1 11.73
ethernet-input active 336287 24234216 0 2.36e1 72.06
ip4-input-no-checksum active 157693 12117168 0 2.73e1 76.84
ip4-local active 157693 12117168 0 5.09e1 76.84
ip4-lookup active 157693 12117168 0 3.67e1 76.84
ip4-udp-lookup active 157693 12117168 0 3.16e1 76.84
l2-fwd active 336287 24234216 0 3.34e1 72.06
l2-input active 336287 24234216 0 3.17e1 72.06
l2-learn active 336287 24234216 0 2.71e1 72.06
l2-output active 336287 24234216 0 1.22e1 72.06
unix-epoll-input polling 1008 0 0 1.44e3 0.00
vhost-user-input polling 1033051 12117048 0 9.63e1 11.73
vxlan4-input active 157693 12117168 0 4.11e1 76.84
114b-4t4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermit-2vhostvr1024-1vm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 18 5.69e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.06e3 0.00
api-rx-from-ring active 0 0 52 8.11e4 0.00
dpdk-process any wait 0 0 1 5.79e3 0.00
fib-walk any wait 0 0 2 4.14e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 2.38e3 0.00
lisp-retry-service any wait 0 0 2 4.04e3 0.00
unix-epoll-input polling 8741 0 0 1.16e6 0.00
vhost-user-process any wait 0 0 1 1.12e4 0.00
vpe-oam-process any wait 0 0 2 2.76e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 63.98, last 128 main loops 0.00 per node 0.00
vector rates in 3.0805e6, out 3.0805e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 213147 13637120 0 1.31e1 63.98
TenGigabitEtherneta/0/1-tx active 213147 13637120 0 5.86e1 63.98
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.89e3 0.00
dpdk-input polling 19815358 0 0 7.72e1 0.00
ethernet-input active 213147 13637120 0 1.95e1 63.98
ip4-rewrite active 213147 13637120 0 2.71e1 63.98
l2-fwd active 213147 13637120 0 3.10e1 63.98
l2-input active 213147 13637120 0 3.06e1 63.98
l2-learn active 213147 13637120 0 2.57e1 63.98
l2-output active 213147 13637120 0 8.77e0 63.98
unix-epoll-input polling 19332 0 0 1.34e3 0.00
vhost-user-input polling 19815358 13637120 0 2.68e2 .69
vxlan4-encap active 213147 13637120 0 5.97e1 63.98
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 4.4, average vectors/node 253.22, last 128 main loops 38.00 per node 256.00
vector rates in 6.1609e6, out 6.1609e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 53856 13636872 0 9.93e0 253.21
TenGigabitEtherneta/0/0-tx active 53856 13636872 0 5.01e1 253.21
VirtualEthernet0/0/1-output active 53856 13637120 0 9.65e0 253.21
VirtualEthernet0/0/1-tx active 53856 13637120 0 1.14e2 253.21
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.55e3 0.00
acl-plugin-in-ip4-l2 active 53856 13637120 0 1.82e2 253.21
dpdk-input polling 54183 13637120 0 5.15e1 251.69
ethernet-input active 107712 27273992 0 1.84e1 253.21
l2-fwd active 107712 27273992 0 3.04e1 253.21
l2-input active 107691 27273992 0 3.12e1 253.26
l2-input-feat-arc active 53856 13637120 0 1.96e1 253.21
l2-input-feat-arc-end active 53856 13637120 0 7.92e0 253.21
l2-learn active 107712 27273992 0 2.01e1 253.21
l2-output active 107712 27273992 0 8.00e0 253.21
unix-epoll-input polling 53 0 0 2.05e3 0.00
vhost-user-input polling 54183 13636872 0 8.16e1 251.68
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 2.24e3 0.00
dpdk-input polling 40881527 0 0 7.44e1 0.00
unix-epoll-input polling 39885 0 0 8.69e2 0.00
vhost-user-input polling 40881527 0 0 1.17e2 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 4.4, average vectors/node 48.93, last 128 main loops 0.00 per node 0.00
vector rates in 3.0805e6, out 3.0805e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
VirtualEthernet0/0/0-output active 278704 13637238 0 1.53e1 48.93
VirtualEthernet0/0/0-tx active 278704 13637238 0 1.49e2 48.93
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.97e3 0.00
dpdk-input polling 10129131 13637238 0 1.24e2 1.35
ethernet-input active 278704 13637238 0 2.15e1 48.93
ip4-input-no-checksum active 278704 13637238 0 2.87e1 48.93
ip4-local active 278704 13637238 0 5.19e1 48.93
ip4-lookup active 278704 13637238 0 3.64e1 48.93
ip4-udp-lookup active 278704 13637238 0 3.22e1 48.93
l2-fwd active 278704 13637238 0 3.49e1 48.93
l2-input active 278704 13637238 0 3.32e1 48.93
l2-learn active 278704 13637238 0 2.93e1 48.93
l2-output active 278704 13637238 0 1.45e1 48.93
unix-epoll-input polling 9882 0 0 1.39e3 0.00
vhost-user-input polling 10129131 0 0 1.22e2 0.00
vxlan4-input active 278704 13637238 0 3.93e1 48.93

10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr

RFC2544: Packet throughput L2BD test cases with VXLANoIPv4 and vhost

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 for L2 switching of IPv4. Eth-IPv4-VXLAN-Eth-IPv4 is applied on link between DUT1 and DUT2.
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with L2 bridge- domain and MAC learning enabled. Qemu Guest is connected to VPP via vhost-user interfaces. Guest is running DPDK testpmd interconnecting vhost-user interfaces using 5 cores pinned to cpus 5-9 and 2048M memory. Testpmd is using socket-mem=1024M (512x2M hugepages), 5 cores (1 main core and 4 cores dedicated for io), forwarding mode is set to io, rxd/txd=256, burst=64. DUT1, DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: RFC2544, RFC7348.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
114b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.3, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 20 3.81e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.93e3 0.00
api-rx-from-ring active 0 0 50 9.32e4 0.00
dpdk-process any wait 0 0 2 7.79e5 0.00
fib-walk any wait 0 0 2 2.93e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 5 7.23e3 0.00
lisp-retry-service any wait 0 0 2 1.02e4 0.00
unix-epoll-input polling 8276 0 0 1.20e6 0.00
vhost-user-process any wait 0 0 2 1.76e4 0.00
vpe-oam-process any wait 0 0 2 2.69e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.3, average vectors/node 254.59, last 128 main loops 84.00 per node 268.80
vector rates in 6.5415e6, out 6.5415e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 27789 7113728 0 1.10e1 255.99
TenGigabitEtherneta/0/0-tx active 27789 7113728 0 5.15e1 255.99
TenGigabitEtherneta/0/1-output active 27788 7113728 0 1.05e1 256.00
TenGigabitEtherneta/0/1-tx active 27788 7113728 0 4.91e1 256.00
VirtualEthernet0/0/0-output active 28050 7113728 0 9.94e0 253.61
VirtualEthernet0/0/0-tx active 28050 7113728 0 9.68e1 253.61
VirtualEthernet0/0/1-output active 28050 7113728 0 9.58e0 253.61
VirtualEthernet0/0/1-tx active 28050 7113728 0 1.01e2 253.61
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.70e3 0.00
acl-plugin-in-ip4-l2 active 28050 7113728 0 9.84e1 253.61
dpdk-input polling 28050 14227456 0 5.12e1 507.22
ethernet-input active 111677 28454912 0 1.78e1 254.79
ip4-input-no-checksum active 28050 7113728 0 2.13e1 253.61
ip4-local active 28050 7113728 0 4.55e1 253.61
ip4-lookup active 28050 7113728 0 3.35e1 253.61
ip4-rewrite active 27788 7113728 0 2.59e1 256.00
ip4-udp-lookup active 28050 7113728 0 2.91e1 253.61
l2-fwd active 111677 28454912 0 3.03e1 254.79
l2-input active 111677 28454912 0 3.03e1 254.79
l2-input-feat-arc active 28050 7113728 0 1.96e1 253.61
l2-input-feat-arc-end active 28050 7113728 0 8.68e0 253.61
l2-learn active 111677 28454912 0 2.01e1 254.79
l2-output active 111677 28454912 0 8.75e0 254.79
unix-epoll-input polling 27 0 0 1.83e3 0.00
vhost-user-input polling 28050 14227456 0 7.74e1 507.22
vxlan4-encap active 27788 7113728 0 5.69e1 256.00
vxlan4-input active 28050 7113728 0 3.42e1 253.61
114b-2t2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 18 3.95e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.88e3 0.00
api-rx-from-ring active 0 0 52 7.37e4 0.00
dhcp-client-process any wait 0 0 1 2.90e3 0.00
dpdk-process any wait 0 0 1 1.80e4 0.00
fib-walk any wait 0 0 2 4.06e3 0.00
ip-neighbor-scan-process any wait 0 0 1 2.66e3 0.00
ip-route-resolver-process any wait 0 0 1 4.65e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 3.74e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 5 2.62e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 4.58e3 0.00
lisp-retry-service any wait 0 0 2 4.64e3 0.00
statseg-collector-process time wait 0 0 1 7.73e3 0.00
unix-epoll-input polling 6779 0 0 1.48e6 0.00
vhost-user-process any wait 0 0 1 1.15e4 0.00
vpe-oam-process any wait 0 0 2 3.25e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 255.99, last 128 main loops 42.00 per node 256.00
vector rates in 6.2732e6, out 6.2732e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 53746 13758912 0 9.94e0 255.99
TenGigabitEtherneta/0/1-tx active 53746 13758912 0 4.87e1 255.99
VirtualEthernet0/0/1-output active 53746 13758976 0 9.10e0 256.00
VirtualEthernet0/0/1-tx active 53746 13758976 0 1.06e2 256.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 1.80e3 0.00
acl-plugin-in-ip4-l2 active 53746 13758976 0 9.49e1 256.00
dpdk-input polling 53746 13758976 0 5.29e1 256.00
ethernet-input active 107492 27517888 0 1.82e1 255.99
ip4-rewrite active 53746 13758912 0 2.50e1 255.99
l2-fwd active 107492 27517888 0 3.07e1 255.99
l2-input active 107492 27517888 0 3.11e1 255.99
l2-input-feat-arc active 53746 13758976 0 2.04e1 256.00
l2-input-feat-arc-end active 53746 13758976 0 8.04e0 256.00
l2-learn active 107492 27517888 0 2.03e1 255.99
l2-output active 107492 27517888 0 8.48e0 255.99
unix-epoll-input polling 52 0 0 1.84e3 0.00
vhost-user-input polling 53746 13758912 0 8.05e1 255.99
vxlan4-encap active 53746 13758912 0 5.64e1 255.99
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 4.4, average vectors/node 148.52, last 128 main loops 23.96 per node 146.05
vector rates in 6.2797e6, out 6.2797e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 91928 13773139 0 1.27e1 149.83
TenGigabitEtherneta/0/0-tx active 91928 13773139 0 5.16e1 149.83
VirtualEthernet0/0/0-output active 93171 13773006 0 1.07e1 147.83
VirtualEthernet0/0/0-tx active 93171 13773006 0 1.14e2 147.83
acl-plugin-fa-worker-cleaner-pinterrupt wa 9 0 0 2.11e3 0.00
dpdk-input polling 94409 13773006 0 5.48e1 145.89
ethernet-input active 185099 27546145 0 2.03e1 148.82
ip4-input-no-checksum active 93171 13773006 0 2.34e1 147.83
ip4-local active 93171 13773006 0 4.77e1 147.83
ip4-lookup active 93171 13773006 0 3.52e1 147.83
ip4-udp-lookup active 93171 13773006 0 3.02e1 147.83
l2-fwd active 185099 27546145 0 3.12e1 148.82
l2-input active 185099 27546145 0 3.01e1 148.82
l2-learn active 185099 27546145 0 2.26e1 148.82
l2-output active 185099 27546145 0 9.72e0 148.82
unix-epoll-input polling 92 0 0 1.94e3 0.00
vhost-user-input polling 94409 13773139 0 8.37e1 145.89
vxlan4-input active 93171 13773006 0 3.67e1 147.83
114b-4t4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-aclpermitreflect-2vhostvr1024-1vm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-cleaner-process any wait 0 0 16 5.58e3 0.00
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.78e3 0.00
api-rx-from-ring active 0 0 52 7.29e4 0.00
dpdk-process any wait 0 0 1 7.11e3 0.00
fib-walk any wait 0 0 2 6.35e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 9.00e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 5 3.09e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 6.07e3 0.00
lisp-retry-service any wait 0 0 2 9.72e3 0.00
statseg-collector-process time wait 0 0 1 9.21e3 0.00
unix-epoll-input polling 5029 0 0 1.99e6 0.00
vhost-user-process any wait 0 0 2 1.32e4 0.00
vpe-oam-process any wait 0 0 2 4.72e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 63.74, last 128 main loops 0.00 per node 0.00
vector rates in 3.5102e6, out 3.5102e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 241845 15414016 0 1.25e1 63.74
TenGigabitEtherneta/0/1-tx active 241845 15414016 0 5.84e1 63.74
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.99e3 0.00
dpdk-input polling 17443470 0 0 7.87e1 0.00
ethernet-input active 241845 15414016 0 1.83e1 63.74
ip4-rewrite active 241845 15414016 0 2.67e1 63.74
l2-fwd active 241845 15414016 0 3.09e1 63.74
l2-input active 241845 15414016 0 3.08e1 63.74
l2-learn active 241845 15414016 0 2.62e1 63.74
l2-output active 241845 15414016 0 8.76e0 63.74
unix-epoll-input polling 17018 0 0 1.35e3 0.00
vhost-user-input polling 17443470 15414016 0 2.17e2 .88
vxlan4-encap active 241845 15414016 0 5.94e1 63.74
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 4.4, average vectors/node 252.58, last 128 main loops 38.00 per node 256.00
vector rates in 7.0205e6, out 7.0205e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 61029 15414152 0 9.85e0 252.57
TenGigabitEtherneta/0/0-tx active 61029 15414152 0 5.03e1 252.57
VirtualEthernet0/0/1-output active 61035 15414272 0 9.65e0 252.55
VirtualEthernet0/0/1-tx active 61035 15414272 0 1.10e2 252.55
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 2.42e3 0.00
acl-plugin-in-ip4-l2 active 61035 15414272 0 9.60e1 252.55
dpdk-input polling 61277 15414272 0 5.14e1 251.55
ethernet-input active 122064 30828424 0 1.80e1 252.56
l2-fwd active 122064 30828424 0 3.03e1 252.56
l2-input active 121995 30828424 0 3.15e1 252.70
l2-input-feat-arc active 61035 15414272 0 1.89e1 252.55
l2-input-feat-arc-end active 61035 15414272 0 7.91e0 252.55
l2-learn active 122064 30828424 0 2.01e1 252.56
l2-output active 122064 30828424 0 8.01e0 252.56
unix-epoll-input polling 60 0 0 1.82e3 0.00
vhost-user-input polling 61277 15414152 0 8.16e1 251.55
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 1.72e3 0.00
dpdk-input polling 40546564 0 0 7.44e1 0.00
unix-epoll-input polling 39557 0 0 8.67e2 0.00
vhost-user-input polling 40546564 0 0 1.18e2 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 4.4, average vectors/node 52.48, last 128 main loops 0.00 per node 0.00
vector rates in 3.5102e6, out 3.5102e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
VirtualEthernet0/0/0-output active 293725 15414180 0 1.47e1 52.48
VirtualEthernet0/0/0-tx active 293725 15414180 0 1.52e2 52.48
acl-plugin-fa-worker-cleaner-pinterrupt wa 8 0 0 2.20e3 0.00
dpdk-input polling 5775859 15414180 0 9.62e1 2.67
ethernet-input active 293725 15414180 0 2.07e1 52.48
ip4-input-no-checksum active 293725 15414180 0 2.79e1 52.48
ip4-local active 293725 15414180 0 5.16e1 52.48
ip4-lookup active 293725 15414180 0 3.56e1 52.48
ip4-udp-lookup active 293725 15414180 0 3.22e1 52.48
l2-fwd active 293725 15414180 0 3.49e1 52.48
l2-input active 293725 15414180 0 3.31e1 52.48
l2-learn active 293725 15414180 0 2.85e1 52.48
l2-output active 293725 15414180 0 1.44e1 52.48
unix-epoll-input polling 5635 0 0 1.35e3 0.00
vhost-user-input polling 5775859 0 0 1.36e2 0.00
vxlan4-input active 293725 15414180 0 3.80e1 52.48

10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr

RFC2544: Packet throughput L2BD test cases with VXLANoIPv4 and vhost

  • [Top] Network Topologies: TG-DUT1-DUT2-TG 3-node circular topology with single links between nodes.
  • [Enc] Packet Encapsulations: Eth-IPv4 for L2 switching of IPv4. Eth-IPv4-VXLAN-Eth-IPv4 is applied on link between DUT1 and DUT2.
  • [Cfg] DUT configuration: DUT1 and DUT2 are configured with L2 bridge- domain and MAC learning enabled. Qemu Guest is connected to VPP via vhost-user interfaces. Guest is running DPDK testpmd interconnecting vhost-user interfaces using 5 cores pinned to cpus 5-9 and 2048M memory. Testpmd is using socket-mem=1024M (512x2M hugepages), 5 cores (1 main core and 4 cores dedicated for io), forwarding mode is set to io, rxd/txd=256, burst=64. DUT1, DUT2 are tested with Intel-X520-DA2.
  • [Ver] TG verification: TG finds and reports throughput NDR (Non Drop Rate) with zero packet loss tolerance and throughput PDR (Partial Drop Rate) with non-zero packet loss tolerance (LT) expressed in percentage of packets transmitted. NDR and PDR are discovered for different Ethernet L2 frame sizes using MLRsearch library. Test packets are generated by TG on links to DUTs. TG traffic profile contains two L3 flow-groups (flow-group per direction, 253 flows per flow-group) with all packets containing Ethernet header, IPv4 header with IP protocol=61 and static payload. MAC addresses are matching MAC addresses of the TG node interfaces.
  • [Ref] Applicable standard specifications: RFC2544, RFC7348.
Name VPP Operational Data - Outputs of ‘show runtime’ at NDR packet rate
114b-1t1c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 7.85e4 0.00
dpdk-process any wait 0 0 1 1.20e4 0.00
fib-walk any wait 0 0 2 1.84e4 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 5 1.20e4 0.00
lisp-retry-service any wait 0 0 2 5.62e3 0.00
unix-epoll-input polling 2901 0 0 3.46e6 0.00
vhost-user-process any wait 0 0 1 1.53e4 0.00
vpe-oam-process any wait 0 0 2 3.07e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 253.28, last 128 main loops 78.00 per node 269.84
vector rates in 7.2288e6, out 7.2288e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 31026 7942656 0 1.02e1 256.00
TenGigabitEtherneta/0/0-tx active 31026 7942656 0 5.28e1 256.00
TenGigabitEtherneta/0/1-output active 31439 7942656 0 1.02e1 252.64
TenGigabitEtherneta/0/1-tx active 31439 7942656 0 4.91e1 252.64
VirtualEthernet0/0/0-output active 31439 7942656 0 9.83e0 252.64
VirtualEthernet0/0/0-tx active 31439 7942656 0 1.02e2 252.64
VirtualEthernet0/0/1-output active 31439 7942656 0 9.93e0 252.64
VirtualEthernet0/0/1-tx active 31439 7942656 0 9.81e1 252.64
dpdk-input polling 31439 15885312 0 5.05e1 505.27
ethernet-input active 125343 31770624 0 1.76e1 253.47
ip4-input-no-checksum active 31439 7942656 0 2.14e1 252.64
ip4-local active 31439 7942656 0 4.52e1 252.64
ip4-lookup active 31439 7942656 0 3.40e1 252.64
ip4-rewrite active 31439 7942656 0 2.75e1 252.64
ip4-udp-lookup active 31439 7942656 0 2.99e1 252.64
l2-fwd active 125343 31770624 0 3.03e1 253.47
l2-input active 125343 31770624 0 2.93e1 253.47
l2-learn active 125343 31770624 0 2.01e1 253.47
l2-output active 125343 31770624 0 7.75e0 253.47
unix-epoll-input polling 30 0 0 2.03e3 0.00
vhost-user-input polling 31439 15885312 0 7.71e1 505.27
vxlan4-encap active 31439 7942656 0 5.65e1 252.64
vxlan4-input active 31439 7942656 0 3.43e1 252.64
114b-2t2c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 52 6.01e4 0.00
dpdk-process any wait 0 0 1 1.68e6 0.00
fib-walk any wait 0 0 2 4.41e3 0.00
ip4-reassembly-expire-walk any wait 0 0 1 4.64e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 5 5.82e3 0.00
ip6-reassembly-expire-walk any wait 0 0 1 5.34e3 0.00
lisp-retry-service any wait 0 0 2 9.34e3 0.00
statseg-collector-process time wait 0 0 1 9.09e3 0.00
unix-epoll-input polling 3652 0 0 2.73e6 0.00
vhost-user-process any wait 0 0 1 1.29e4 0.00
vpe-oam-process any wait 0 0 3 4.24e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 86.82, last 128 main loops 0.00 per node 0.00
vector rates in 6.5985e6, out 6.5985e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 197102 14405001 0 1.24e1 73.08
TenGigabitEtherneta/0/1-tx active 197102 14405001 0 5.18e1 73.08
VirtualEthernet0/0/1-output active 245430 14405094 0 1.53e1 58.69
VirtualEthernet0/0/1-tx active 245430 14405094 0 1.25e2 58.69
dpdk-input polling 414357 14405094 0 6.27e1 34.76
ethernet-input active 442532 28810095 0 2.34e1 65.10
ip4-rewrite active 197102 14405001 0 3.10e1 73.08
l2-fwd active 260925 28810095 0 3.20e1 110.42
l2-input active 260925 28810095 0 3.05e1 110.42
l2-learn active 260925 28810095 0 2.46e1 110.42
l2-output active 260925 28810095 0 1.23e1 110.42
unix-epoll-input polling 404 0 0 1.65e3 0.00
vhost-user-input polling 414357 14405001 0 8.77e1 34.76
vxlan4-encap active 197102 14405001 0 6.08e1 73.08
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 4.4, average vectors/node 251.77, last 128 main loops 42.00 per node 256.00
vector rates in 6.5988e6, out 6.5988e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 57203 14405568 0 1.01e1 251.83
TenGigabitEtherneta/0/0-tx active 57203 14405568 0 5.03e1 251.83
VirtualEthernet0/0/0-output active 57225 14405632 0 9.77e0 251.74
VirtualEthernet0/0/0-tx active 57225 14405632 0 1.19e2 251.74
dpdk-input polling 57225 14405632 0 5.13e1 251.74
ethernet-input active 114428 28811200 0 1.69e1 251.78
ip4-input-no-checksum active 57225 14405632 0 2.03e1 251.74
ip4-local active 57225 14405632 0 4.49e1 251.74
ip4-lookup active 57225 14405632 0 3.30e1 251.74
ip4-udp-lookup active 57225 14405632 0 2.92e1 251.74
l2-fwd active 114428 28811200 0 2.99e1 251.78
l2-input active 114428 28811200 0 2.94e1 251.78
l2-learn active 114428 28811200 0 2.04e1 251.78
l2-output active 114428 28811200 0 7.39e0 251.78
unix-epoll-input polling 55 0 0 2.00e3 0.00
vhost-user-input polling 57225 14405568 0 8.25e1 251.74
vxlan4-input active 57225 14405632 0 3.44e1 251.74
114b-4t4c-ethip4vxlan-l2bdbasemaclrn-eth-iacldstbase-noacl-2vhostvr1024-1vm-ndrpdr
 DUT1: 
Thread 0 vpp_main (lcore 1)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
api-rx-from-ring active 0 0 51 4.12e4 0.00
dpdk-process any wait 0 0 2 1.28e4 0.00
fib-walk any wait 0 0 2 5.81e3 0.00
ip6-icmp-neighbor-discovery-ev any wait 0 0 4 5.75e3 0.00
lisp-retry-service any wait 0 0 2 1.08e4 0.00
unix-epoll-input polling 4396 0 0 2.26e6 0.00
vhost-user-process any wait 0 0 2 1.42e4 0.00
vpe-oam-process any wait 0 0 2 4.12e3 0.00
—————
Thread 1 vpp_wk_0 (lcore 2)
Time 4.4, average vectors/node 64.00, last 128 main loops 0.00 per node 0.00
vector rates in 3.9404e6, out 3.9404e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/1-output active 268110 17160248 0 1.27e1 64.00
TenGigabitEtherneta/0/1-tx active 268110 17160248 0 5.89e1 64.00
dpdk-input polling 14416787 0 0 7.98e1 0.00
ethernet-input active 268110 17160248 0 1.94e1 64.00
ip4-rewrite active 268110 17160248 0 2.65e1 64.00
l2-fwd active 268110 17160248 0 3.10e1 64.00
l2-input active 268110 17160248 0 3.06e1 64.00
l2-learn active 268110 17160248 0 2.59e1 64.00
l2-output active 268110 17160248 0 9.23e0 64.00
unix-epoll-input polling 14065 0 0 1.29e3 0.00
vhost-user-input polling 14416787 17160248 0 1.88e2 1.19
vxlan4-encap active 268110 17160248 0 5.94e1 64.00
—————
Thread 2 vpp_wk_1 (lcore 3)
Time 4.4, average vectors/node 127.97, last 128 main loops 12.69 per node 135.33
vector rates in 7.8888e6, out 7.8888e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
TenGigabitEtherneta/0/0-output active 168769 17160808 0 1.09e1 101.68
TenGigabitEtherneta/0/0-tx active 168769 17160808 0 5.21e1 101.68
VirtualEthernet0/0/1-output active 197319 17194532 0 1.30e1 87.14
VirtualEthernet0/0/1-tx active 197319 17194532 0 1.34e2 87.14
dpdk-input polling 202797 17194532 0 5.52e1 84.79
ethernet-input active 366088 34355340 0 2.03e1 93.84
l2-fwd active 219650 34355340 0 3.08e1 156.41
l2-input active 219650 34355340 0 2.95e1 156.41
l2-learn active 219650 34355340 0 2.26e1 156.41
l2-output active 219650 34355340 0 9.64e0 156.41
unix-epoll-input polling 197 0 0 2.04e3 0.00
vhost-user-input polling 202797 17160808 0 8.87e1 84.62
—————
Thread 3 vpp_wk_2 (lcore 4)
Time 4.4, average vectors/node 0.00, last 128 main loops 0.00 per node 0.00
vector rates in 0.0000e0, out 0.0000e0, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
dpdk-input polling 40132911 0 0 7.42e1 0.00
unix-epoll-input polling 39154 0 0 8.85e2 0.00
vhost-user-input polling 40132911 0 0 1.18e2 0.00
—————
Thread 4 vpp_wk_3 (lcore 5)
Time 4.4, average vectors/node 54.49, last 128 main loops 0.00 per node 0.00
vector rates in 3.9483e6, out 3.9483e6, drop 0.0000e0, punt 0.0000e0
Name State Calls Vectors Suspends Clocks Vectors/Call
VirtualEthernet0/0/0-output active 315555 17194487 0 1.44e1 54.49
VirtualEthernet0/0/0-tx active 315555 17194487 0 1.55e2 54.49
dpdk-input polling 1766537 17194487 0 7.42e1 9.73
ethernet-input active 315555 17194487 0 2.06e1 54.49
ip4-input-no-checksum active 315555 17194487 0 2.84e1 54.49
ip4-local active 315555 17194487 0 5.05e1 54.49
ip4-lookup active 315555 17194487 0 3.52e1 54.49
ip4-udp-lookup active 315555 17194487 0 3.17e1 54.49
l2-fwd active 315555 17194487 0 3.44e1 54.49
l2-input active 315555 17194487 0 3.28e1 54.49
l2-learn active 315555 17194487 0 2.82e1 54.49
l2-output active 315555 17194487 0 1.42e1 54.49
unix-epoll-input polling 1723 0 0 1.34e3 0.00
vhost-user-input polling 1766537 0 0 1.49e2 0.00
vxlan4-input active 315555 17194487 0 3.84e1 54.49