CSIT 17.01

• 1. Introduction
  • 1.1. Overview
  • 1.2. General Notes
  • 1.3. CSIT Test Naming
    • 1.3.1. Background
    • 1.3.2. Naming Convention
    • 1.3.3. Naming Examples
• 2. VPP Performance Tests
  • 2.1. Overview
    • 2.1.1. Tested Physical Topologies
    • 2.1.2. Performance Tests Coverage
    • 2.1.3. Performance Tests Naming
    • 2.1.4. Methodology: Multi-Thread and Multi-Core
    • 2.1.5. Methodology: Packet Throughput
    • 2.1.6. Methodology: Packet Latency
    • 2.1.7. Methodology: KVM VM vhost
  • 2.2. CSIT Release Notes
    • 2.2.1. Changes in CSIT rls1701
    • 2.2.2. Performance Improvements
      • 2.2.2.1. NDR Throughput
      • 2.2.2.2. PDR Throughput
    • 2.2.3. Other Performance Changes
      • 2.2.3.1. NDR Throughput
      • 2.2.3.2. PDR Throughput
    • 2.2.4. Known Issues
    • 2.2.5. Tests to be Added - Cryptodev
    • 2.2.6. Tests to be Added - SNAT44
  • 2.3. Packet Throughput Graphs
    • 2.3.1. L2 Ethernet Switching
      • 2.3.1.1. NDR Throughput
      • 2.3.1.2. PDR Throughput
    • 2.3.2. IPv4 Routed-Forwarding
      • 2.3.2.1. NDR Throughput
      • 2.3.2.2. PDR Throughput
    • 2.3.3. IPv6 Routed-Forwarding
      • 2.3.3.1. NDR Throughput
      • 2.3.3.2. PDR Throughput
    • 2.3.4. IPv4 Overlay Tunnels
      • 2.3.4.1. NDR Throughput
      • 2.3.4.2. PDR Throughput
    • 2.3.5. IPv6 Overlay Tunnels
      • 2.3.5.1. NDR Throughput
      • 2.3.5.2. PDR Throughput
    • 2.3.6. VM vhost Connections
      • 2.3.6.1. NDR Throughput
      • 2.3.6.2. PDR Throughput
  • 2.4. Packet Latency Graphs
    • 2.4.1. L2 Ethernet Switching
    • 2.4.2. IPv4 Routed-Forwarding
    • 2.4.3. IPv6 Routed-Forwarding
    • 2.4.4. IPv4 Overlay Tunnels
    • 2.4.5. IPv6 Overlay Tunnels
    • 2.4.6. VM vhost Connections
  • 2.5. Test Environment
    • 2.5.1. SUT Configuration - Host HW
    • 2.5.2. SUT Configuration - Host OS Linux
    • 2.5.3. DUT Configuration - VPP
    • 2.5.4. TG Configuration - TRex
  • 2.6. Documentation
• 3. Testpmd Performance Tests
  • 3.1. Overview
    • 3.1.1. Tested Physical Topologies
    • 3.1.2. Performance Tests Coverage
    • 3.1.3. Methodology: Multi-Thread and Multi-Core
    • 3.1.4. Methodology: Packet Throughput
    • 3.1.5. Methodology: Packet Latency
  • 3.2. CSIT Release Notes
    • 3.2.1. Changes in CSIT rls1701
    • 3.2.2. Tests to be Added - Additional NICs
  • 3.3. Packet Throughput Graphs
    • 3.3.1. L2 Ethernet Looping
      • 3.3.1.1. NDR Throughput
      • 3.3.1.2. PDR Throughput
  • 3.4. Packet Latency Graphs
    • 3.4.1. L2 Ethernet Switching
  • 3.5. Test Environment
    • 3.5.1. SUT Configuration - Host HW
    • 3.5.2. SUT Configuration - Host OS Linux
    • 3.5.3. DUT Configuration - DPDK
    • 3.5.4. TG Configuration - TRex
  • 3.6. Documentation
• 4. VPP Functional Tests
  • 4.1. Overview
    • 4.1.1. Tested Virtual Topologies
    • 4.1.2. Functional Tests Coverage
    • 4.1.3. Functional Tests Naming
  • 4.2. CSIT Release Notes
    • 4.2.1. Changes in CSIT rls1701
    • 4.2.2. Known Issues
    • 4.2.3. Tests to be Added - Centos
  • 4.3. Test Environment
    • 4.3.1. SUT Configuration - VIRL Guest VM
    • 4.3.2. SUT Configuration - VIRL Guest OS Linux
    • 4.3.3. DUT Configuration - VPP
    • 4.3.4. TG Configuration
  • 4.4. Documentation
• 5. HoneyComb Functional Tests
  • 5.1. Overview
    • 5.1.1. Tested Virtual Topologies
    • 5.1.2. Functional Tests Coverage
    • 5.1.3. Functional Tests Naming
  • 5.2. CSIT Release Notes
    • 5.2.1. Changes in CSIT rls1701
    • 5.2.2. Known Issues
  • 5.3. Test Environment
  • 5.4. Documentation
• 6. VPP Unit Tests
  • 6.1. Overview
    • 6.1.1. VPP Unit Test Framework
    • 6.1.2. Unit Tests Coverage
  • 6.2. Documentation
• 7. Detailed Test Results
  • 7.1. VPP Performance Results
    • 7.1.1. L2 Ethernet Switching
      • 7.1.1.1. 10ge2p1x520-dot1ad-l2xcbase-ndrpdrdisc
      • 7.1.1.2. 10ge2p1x520-dot1q-l2xcbase-ndrpdrdisc
      • 7.1.1.3. 10ge2p1x520-eth-l2bdbasemaclrn-ndrpdrdisc
      • 7.1.1.4. 10ge2p1x520-eth-l2xcbase-ndrpdrdisc
      • 7.1.1.5. 10ge2p1x710-eth-l2bdbasemaclrn-ndrpdrdisc
      • 7.1.1.6. 40ge2p1xl710-eth-l2bdbasemaclrn-ndrpdrdisc
      • 7.1.1.7. 40ge2p1xl710-eth-l2xcbase-ndrpdrdisc
    • 7.1.2. IPv4 Routed-Forwarding
      • 7.1.2.1. 10ge2p1x520-ethip4-ip4base-copwhtlistbase-ndrpdrdisc
      • 7.1.2.2. 10ge2p1x520-ethip4-ip4base-iacldstbase-ndrpdrdisc
      • 7.1.2.3. 10ge2p1x520-ethip4-ip4base-ipolicemarkbase-ndrpdrdisc
      • 7.1.2.4. 10ge2p1x520-ethip4-ip4base-ndrpdrdisc
      • 7.1.2.5. 10ge2p1x520-ethip4-ip4scale200k-ndrpdrdisc
      • 7.1.2.6. 10ge2p1x520-ethip4-ip4scale20k-ndrpdrdisc
      • 7.1.2.7. 10ge2p1x520-ethip4-ip4scale2m-ndrpdrdisc
      • 7.1.2.8. 40ge2p1xl710-ethip4-ip4base-ndrpdrdisc
    • 7.1.3. IPv6 Routed-Forwarding
      • 7.1.3.1. 10ge2p1x520-ethip6-ip6base-copwhtlistbase-ndrpdrdisc
      • 7.1.3.2. 10ge2p1x520-ethip6-ip6base-iacldstbase-ndrpdrdisc
      • 7.1.3.3. 10ge2p1x520-ethip6-ip6base-ndrpdrdisc
      • 7.1.3.4. 10ge2p1x520-ethip6-ip6scale200k-ndrpdrdisc
      • 7.1.3.5. 10ge2p1x520-ethip6-ip6scale20k-ndrpdrdisc
      • 7.1.3.6. 10ge2p1x520-ethip6-ip6scale2m-ndrpdrdisc
      • 7.1.3.7. 40ge2p1xl710-ethip6-ip6base-ndrpdrdisc
    • 7.1.4. IPv4 Overlay Tunnels
      • 7.1.4.1. 10ge2p1x520-ethip4lispip4-ip4base-ndrpdrdisc
      • 7.1.4.2. 10ge2p1x520-ethip4lispip6-ip4base-ndrpdrdisc
      • 7.1.4.3. 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-ndrpdrdisc
      • 7.1.4.4. 10ge2p1x520-ethip4vxlan-l2xcbase-ndrpdrdisc
    • 7.1.5. IPv6 Overlay Tunnels
      • 7.1.5.1. 10ge2p1x520-ethip6lispip4-ip6base-ndrpdrdisc
      • 7.1.5.2. 10ge2p1x520-ethip6lispip6-ip6base-ndrpdrdisc
    • 7.1.6. VM Vhost Connections
      • 7.1.6.1. 10ge2p1x520-dot1q-l2bdbasemaclrn-eth-2vhost-1vm-ndrpdrdisc
      • 7.1.6.2. 10ge2p1x520-dot1q-l2xcbase-eth-2vhost-1vm-ndrpdrdisc
      • 7.1.6.3. 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrpdrdisc
      • 7.1.6.4. 10ge2p1x520-eth-l2xcbase-eth-2vhost-1vm-ndrpdrdisc
      • 7.1.6.5. 10ge2p1x520-ethip4-ip4base-eth-2vhost-1vm-ndrpdrdisc
      • 7.1.6.6. 10ge2p1x520-ethip4vxlan-l2bdbasemaclrn-eth-2vhost-1vm-ndrpdrdisc
      • 7.1.6.7. 10ge2p1x710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrpdrdisc
      • 7.1.6.8. 40ge2p1xl710-eth-l2bdbasemaclrn-eth-2vhost-1vm-ndrpdrdisc
  • 7.2. Testpmd Performance Results
    • 7.2.1. L2 Ethernet Looping
      • 7.2.1.1. 10ge2p1x520-eth-l2xcbase-ndrdisc
  • 7.3. VPP Functional Results
    • 7.3.1. DHCP - Client and Proxy
      • 7.3.1.1. eth2p-ethip4-ip4base-ip4dhcpclient-func
      • 7.3.1.2. eth2p-ethip4-ip4base-ip4dhcpproxy-func
      • 7.3.1.3. eth2p-ethip6-ip6base-ip6dhcpproxy-func
    • 7.3.2. GRE Overlay Tunnels
      • 7.3.2.1. eth2p-ethip4gre-ip4base-func
    • 7.3.3. L2BD Ethernet Switching
      • 7.3.3.1. eth2p-eth-l2bdbasemaclrn-eth-2vhost-1vm-func
      • 7.3.3.2. eth2p-eth-l2bdbasemaclrn-func
      • 7.3.3.3. eth2p-eth-l2bdbasemacstc-eth-2vhost-1vm-func
      • 7.3.3.4. eth2p-eth-l2bdbasemacstc-func
      • 7.3.3.5. eth4p-eth-l2bdbasemaclrn-l2shg-func
    • 7.3.4. L2XC Ethernet Switching
      • 7.3.4.1. eth2p-eth-l2xcbase-eth-2vhost-1vm-func
      • 7.3.4.2. eth2p-eth-l2xcbase-func
    • 7.3.5. LISP Overlay Tunnels
      • 7.3.5.1. api-crud-lisp-func
      • 7.3.5.2. eth2p-ethip4ipsectptlispgpe-ip4base-eth-2vhost-1vm-func
      • 7.3.5.3. eth2p-ethip4ipsectptlispgpe-ip4base-func
      • 7.3.5.4. eth2p-ethip4ipsectptlispgpe-ip6base-eth-2vhost-1vm-func
      • 7.3.5.5. eth2p-ethip4ipsectptlispgpe-ip6base-func
      • 7.3.5.6. eth2p-ethip4ipsectptlispgpe-ip6basevrf-func
      • 7.3.5.7. eth2p-ethip4lisp-ip4base-func
      • 7.3.5.8. eth2p-ethip4lisp-l2bdbasemaclrn-func
      • 7.3.5.9. eth2p-ethip4lispgpe-ip4base-eth-2vhost-1vm-func
      • 7.3.5.10. eth2p-ethip4lispgpe-ip4base-func
      • 7.3.5.11. eth2p-ethip4lispgpe-ip4basevrf-eth-2vhost-1vm-func
      • 7.3.5.12. eth2p-ethip4lispgpe-ip4basevrf-func
      • 7.3.5.13. eth2p-ethip4lispgpe-ip6base-eth-2vhost-1vm-func
      • 7.3.5.14. eth2p-ethip4lispgpe-ip6base-func
      • 7.3.5.15. eth2p-ethip4lispgpe-ip6basevrf-func
      • 7.3.5.16. eth2p-ethip6ipsectptlispgpe-ip4base-eth-2vhost-1vm-func
      • 7.3.5.17. eth2p-ethip6ipsectptlispgpe-ip4base-func
      • 7.3.5.18. eth2p-ethip6ipsectptlispgpe-ip6base-eth-2vhost-1vm-func
      • 7.3.5.19. eth2p-ethip6ipsectptlispgpe-ip6base-func
      • 7.3.5.20. eth2p-ethip6lisp-l2bdbasemaclrn-func
      • 7.3.5.21. eth2p-ethip6lispgpe-ip4base-func
      • 7.3.5.22. eth2p-ethip6lispgpe-ip6base-eth-2vhost-1vm-func
      • 7.3.5.23. eth2p-ethip6lispgpe-ip6base-func
      • 7.3.5.24. eth2p-ethip6lispgpe-ip6basevrf-eth-2vhost-1vm-func
      • 7.3.5.25. eth2p-ethip6lispgpe-ip6basevrf-func
    • 7.3.6. Softwire Tunnels
      • 7.3.6.1. eth2p-ethip4–ethip6ip4-ip4base–ip6base-swirelw46-func
      • 7.3.6.2. eth2p-ethip4–ethip6ip4-ip4base–ip6base-swiremape-func
      • 7.3.6.3. eth2p-ethip4–ethip6ip4-ip4base–ip6base-swiremapt-func
    • 7.3.7. Cop Address Security
      • 7.3.7.1. eth2p-ethip4-ip4base-copblklistbase-func
      • 7.3.7.2. eth2p-ethip4-ip4base-copwhlistbase-func
      • 7.3.7.3. eth2p-ethip6-ip6base-copblklistbase-func
      • 7.3.7.4. eth2p-ethip6-ip6base-copwhlistbase-func
    • 7.3.8. IPSec - Tunnels and Transport
      • 7.3.8.1. eth2p-ethip4ipsectnl-ip4base-func
      • 7.3.8.2. eth2p-ethip4ipsectpt-ip4base-func
      • 7.3.8.3. eth2p-ethip6ipsectnl-ip6base-func
      • 7.3.8.4. eth2p-ethip6ipsectpt-ip6base-func
    • 7.3.9. IPv6 Routed-Forwarding
      • 7.3.9.1. eth2p-ethip6-ip6base-func
      • 7.3.9.2. eth2p-ethip6-ip6base-ip6ecmp-func
      • 7.3.9.3. eth2p-ethip6-ip6base-ip6ra-func
    • 7.3.10. RPF Source Security
      • 7.3.10.1. eth2p-ethip4-ip4base-rpf-func
    • 7.3.11. Tap Interface
      • 7.3.11.1. api-crud-tap-func
      • 7.3.11.2. eth2p-eth-l2bdbasemaclrn-eth-2tap-func
      • 7.3.11.3. eth2p-eth-l2bdbasemaclrn-l2shg-eth-2tap-func
      • 7.3.11.4. eth2p-ethip4-ip4base-eth-1tap-func
    • 7.3.12. Telemetry - IPFIX and SPAN
      • 7.3.12.1. IPFIX Netflow Statistics
        • 7.3.12.1.1. eth2p-ethip4-ip4base-ip4ipfixbase-func
        • 7.3.12.1.2. eth2p-ethip4-ip4base-ip4ipfixscale-func
        • 7.3.12.1.3. eth2p-ethip6-ip6base-ip6ipfixbase-func
        • 7.3.12.1.4. eth2p-ethip6-ip6base-ip6ipfixscale-func
      • 7.3.12.2. SPAN Port Mirroring
        • 7.3.12.2.1. eth2p-ethip4-ip4base-spanrx-func
        • 7.3.12.2.2. eth2p-ethip6-ip6base-spanrx-func
    • 7.3.13. VRF Routed-Forwarding
      • 7.3.13.1. eth2p-ethip4-ip4basevrf-func
      • 7.3.13.2. eth2p-ethip6-ip6basevrf-func
    • 7.3.14. iACL Security
      • 7.3.14.1. eth2p-eth-l2xcbase-iaclbase-func
      • 7.3.14.2. eth2p-ethip4-ip4base-iaclbase-func
      • 7.3.14.3. eth2p-ethip6-ip6base-iaclbase-func
    • 7.3.15. IPv4 Routed-Forwarding
      • 7.3.15.1. eth2p-ethip4-ip4base-func
      • 7.3.15.2. eth2p-ethip4-ip4base-ip4arp-func
      • 7.3.15.3. eth2p-ethip4-ip4base-ip4ecmp-func
      • 7.3.15.4. eth2p-ethip4-ip4base-ip4proxyarp-func
    • 7.3.16. QoS Policer Metering
      • 7.3.16.1. eth2p-ethip4-ip4base-ipolicemarkbase-func
      • 7.3.16.2. eth2p-ethip6-ip6base-ipolicemarkbase-func
    • 7.3.17. VLAN Tag Translation
      • 7.3.17.1. eth2p-dot1ad–dot1q-l2bdbasemaclrn-vlantrans21-func
      • 7.3.17.2. eth2p-dot1ad–dot1q-l2xcbase-vlantrans21-func
      • 7.3.17.3. eth2p-dot1ad-l2bdbasemaclrn-vlantrans22-func
      • 7.3.17.4. eth2p-dot1ad-l2xcbase-func
      • 7.3.17.5. eth2p-dot1ad-l2xcbase-vlantrans22-func
      • 7.3.17.6. eth2p-dot1q–dot1ad-l2bdbasemaclrn-vlantrans12-func
      • 7.3.17.7. eth2p-dot1q–dot1ad-l2xcbase-vlantrans12-func
      • 7.3.17.8. eth2p-dot1q-l2bdbasemaclrn-vlantrans11-func
      • 7.3.17.9. eth2p-dot1q-l2xcbase-vlantrans11-func
    • 7.3.18. VXLAN Overlay Tunnels
      • 7.3.18.1. eth2p-dot1qip4vxlan-l2bdbasemaclrn-func
      • 7.3.18.2. eth2p-ethip4vxlan-l2bdbasemaclrn-eth-2vhost-1vm-func
      • 7.3.18.3. eth2p-ethip4vxlan-l2bdbasemaclrn-func
      • 7.3.18.4. eth2p-ethip4vxlan-l2xcbase-func
      • 7.3.18.5. eth2p-ethip6vxlan-l2bdbasemaclrn-eth-2vhost-1vm-func
      • 7.3.18.6. eth2p-ethip6vxlan-l2bdbasemaclrn-func
      • 7.3.18.7. eth4p-ethip4vxlan-l2bdbasemaclrn-l2shg-func
      • 7.3.18.8. eth4p-ethip6vxlan-l2bdbasemaclrn-l2shg-func
  • 7.4. HoneyComb Functional Results
    • 7.4.1. mgmt-cfg-acl-apihc-apivat-func
    • 7.4.2. mgmt-cfg-int-apihcnc-func
    • 7.4.3. mgmt-cfg-int-subint-apihc-apivat-func
    • 7.4.4. mgmt-cfg-intip4-intip6-apihc-apivat-func
    • 7.4.5. mgmt-cfg-inttap-apihc-apivat-func
    • 7.4.6. mgmt-cfg-intvhost-apihc-apivat-func
    • 7.4.7. mgmt-cfg-l2bd-apihc-apivat-func
    • 7.4.8. mgmt-cfg-l2fib-apihc-apivat-func
    • 7.4.9. mgmt-cfg-lisp-apihc-apivat-func
    • 7.4.10. mgmt-cfg-nsh-apihc-apivat-func
    • 7.4.11. mgmt-cfg-pbb-apihc-apivat-func
    • 7.4.12. mgmt-cfg-snat44-apihc-apivat-func
    • 7.4.13. mgmt-cfg-vxlan-apihc-apivat-func
    • 7.4.14. mgmt-cfg-vxlangpe-apihc-apivat-func
    • 7.4.15. mgmt-notif-apihcnc-func
    • 7.4.16. mgmt-statepersist-apihc-func
  • 7.5. VPP Unit Test Results
    • 7.5.1. CRUD Loopback
    • 7.5.2. Flow-per-packet plugin
    • 7.5.3. DHCP
    • 7.5.4. IP4 VRF Multi-instance
    • 7.5.5. Load Balancer
    • 7.5.6. BFD IPv4
    • 7.5.7. BFD IPv6
    • 7.5.8. BFD API tests
    • 7.5.9. BFD authorization
    • 7.5.10. BFD authentication
    • 7.5.11. IPv6 Tests
    • 7.5.12. SPAN Test
    • 7.5.13. GRE Tests
    • 7.5.14. SNAT Test Cases
    • 7.5.15. L2XC Multi-instance
    • 7.5.16. IPv4 Tests
    • 7.5.17. IPv4 FIB CRUD
    • 7.5.18. IRB Tests
    • 7.5.19. MPLS Tests
    • 7.5.20. L2XC Tests
    • 7.5.21. Classifier
    • 7.5.22. VXLAN Tests
    • 7.5.23. L2 FIB CRUD
    • 7.5.24. L2BD Tests