CSIT-1901

Introduction

• Report History
• Report Structure
• Test Scenarios
• Physical Testbeds
  • 3-Node Xeon Haswell (3n-hsw)
  • 3-Node Xeon Skylake (3n-skx)
  • 2-Node Xeon Skylake (2n-skx)
• Test Methodology
  • VPP Forwarding Modes
  • Tunnel Encapsulations
  • VPP Features
  • Data Plane Throughput
  • MLRsearch Tests
  • (B)MRR Throughput
  • Packet Latency
  • Multi-Core Speedup
  • VPP Startup Settings
  • KVM VMs vhost-user
  • LXC/DRC Container Memif
  • K8s Container Memif
  • NFV Service Density
  • VPP_Device Functional
  • IPSec on Intel QAT
  • TRex Traffic Generator
  • PLRsearch

VPP Performance

• Overview
  • Logical Topologies
  • Performance Tests Coverage
  • Performance Tests Naming
• Release Notes
  • Changes in CSIT-1901
  • Known Issues
• Packet Throughput
  • L2 Ethernet Switching
  • IPv4 Routing
  • IPv6 Routing
  • SRv6 Routing
  • IPv4 Tunnels
  • IPv6 Tunnels
  • KVM VMs vhost-user
  • LXC/DRC Container Memif
  • K8s Container Memif
  • IPSec IPv4 Routing
  • VTS
• Speedup Multi-Core
  • L2 Ethernet Switching
  • IPv4 Routing
  • IPv6 Routing
  • SRv6 Routing
  • IPv4 Tunnels
  • IPv6 Tunnels
  • KVM VMs vhost-user
  • LXC/DRC Container Memif
  • K8s Container Memif
  • IPSec IPv4 Routing
  • VTS
• Packet Latency
  • L2 Ethernet Switching
  • IPv4 Routing
  • IPv6 Routing
  • SRv6 Routing
  • IPv4 Tunnels
  • IPv6 Tunnels
  • KVM VMs vhost-user
  • LXC/DRC Container Memif
  • K8s Container Memif
  • IPSec IPv4 Routing
• Soak Tests
• NFV Service Density
  • VNF Service Chains
  • CNF Service Chains
  • CNF Service Pipelines
• Comparisons
  • Current vs. Previous Release
  • 3n-Skx vs. 3n-Hsw Testbeds
  • 3n-Skx vs. 2n-Skx Testbeds
  • NICs Comparison
• Throughput Trending
• Test Environment
  • Physical Testbeds
  • Server Specifications
  • Pre-Test Server Calibration
  • Calibration Data - Haswell
  • Calibration Data - Skylake
  • SUT Settings - Linux
  • DUT Settings - VPP
  • TG Settings - TRex
• Documentation
  • Container Orchestration in CSIT
  • Test Code Documentation

DPDK Performance

• Overview
  • Logical Topologies
  • Performance Tests Coverage
• Release Notes
  • Changes in CSIT-1901
  • Known Issues
• Packet Throughput
  • Testpmd
  • L3fwd
• Packet Latency
  • Testpmd
  • L3fwd
• Comparisons
  • Current vs. Previous Release
  • 3n-Skx vs. 3n-Hsw Testbeds
  • 3n-Skx vs. 2n-Skx Testbeds
• Throughput Trending
• Test Environment
  • Physical Testbeds
  • Server Specifications
  • Pre-Test Server Calibration
  • Calibration Data - Haswell
  • Calibration Data - Skylake
  • SUT Settings - Linux
  • DUT Settings - DPDK
  • TG Settings - TRex
• Documentation

VPP Device

• Overview
  • Virtual Topologies
  • Functional Tests Coverage
  • Tests Naming
• Release Notes
  • Changes in CSIT-1901
  • Known Issues
• Integration Tests
  • Abstract
  • Overview
  • Physical Testbeds
  • Containers
  • Environment initialization
  • VF reservation
  • Network traffic isolation - Intel i40evf
  • Open tasks
  • Links
• Documentation

VPP Functional

• Overview
  • Virtual Topologies
  • Functional Tests Coverage
  • Functional Tests Naming
• Release Notes
  • Changes in CSIT-1901
  • Known Issues
• Test Environment
  • SUT Settings - VIRL Guest VM
  • SUT Settings - VIRL Guest OS Linux
  • DUT Settings - VPP
  • TG Settings - Scapy
• Documentation

HoneyComb Functional

• Overview
  • Virtual Topologies
  • Functional Tests Coverage
  • Functional Tests Naming
• Release Notes
  • Changes in CSIT-1901
  • Known Issues
• Test Environment
• Documentation

DMM Functional

• Overview
  • Virtual Topologies
  • Functional Tests Coverage
• Release Notes
  • Changes in CSIT-1901
  • Known Issues
• Test Environment
• Documentation

Detailed Results

• VPP Throughput
  • 3n-hsw
  • 3n-skx
  • 2n-skx
• VPP MRR
  • 3n-hsw
  • 3n-skx
  • 2n-skx
• VPP K8s Container Memif
  • 3n-hsw
• DPDK Throughput
  • 3n-hsw
  • 3n-skx
  • 2n-skx
• VPP Functional
  • Ubuntu
  • CentOS
• VPP Device
  • device
• HoneyComb Functional
  • mgmt-cfg-acl-apihc-apivat-func
  • mgmt-cfg-apihcv6-func
  • mgmt-cfg-bgp-apihc-func
  • mgmt-cfg-dhcp-apihc-apivat-func
  • mgmt-cfg-int-apihcnc-func
  • mgmt-cfg-int-subint-apihc-apivat-func
  • mgmt-cfg-intip4-intip6-apihc-apivat-func
  • mgmt-cfg-inttap-apihc-apivat-func
  • mgmt-cfg-intvhost-apihc-apivat-func
  • mgmt-cfg-l2bd-apihc-apivat-func
  • mgmt-cfg-l2fib-apihc-apivat-func
  • mgmt-cfg-lisp-apihc-apivat-func
  • mgmt-cfg-lispgpe-apihc-apivat-func
  • mgmt-cfg-pbb-apihc-apivat-func
  • mgmt-cfg-pluginacl-apihc-apivat-func
  • mgmt-cfg-policer-apihc-func
  • mgmt-cfg-proxyarp-apihc-func
  • mgmt-cfg-proxynd6-apihc-func
  • mgmt-cfg-routing-apihc-apivat-func
  • mgmt-cfg-slaac-apihc-func
  • mgmt-cfg-snat44-apihc-apivat-func
  • mgmt-cfg-spanrx-apihc-apivat-func
  • mgmt-cfg-vxlan-apihc-apivat-func
  • mgmt-cfg-vxlangpe-apihc-apivat-func
  • mgmt-notif-apihcnc-func
  • mgmt-statepersist-apihc-func
• DMM Functional
  • singlecliser-func

Test Configuration

• VPP Throughput
  • 3n-hsw
  • 3n-skx
  • 2n-skx
• VPP MRR
  • 3n-hsw
  • 3n-skx
  • 2n-skx
• VPP K8s Container Memif
• VPP Functional
  • Ubuntu
  • CentOS
• VPP Device
  • device

Test Operational Data

• VPP Throughput
  • 3n-hsw
  • 3n-skx
  • 2n-skx

CSIT Framework Documentation

• Design
  • Design Hierarchy
  • Test Lifecycle Abstraction
  • RF Keywords Functional Classification
  • RF Keywords Naming Guidelines
  • Coding Guidelines
• Test Naming
  • Background
  • Naming Convention
  • Naming Examples
• Presentation and Analytics
  • Overview
  • Data
  • Data processing
  • Data presentation
  • Report generation
  • Continuous Performance Measurements and Trending
  • Root Cause Analysis
  • API
• CSIT RF Tags Descriptions
  • Testbed Topology Tags
  • Objective Tags
  • Environment Tags
  • NIC Model Tags
  • Scaling Tags
  • Test Category Tags
  • Performance Type Tags
  • Ethernet Frame Size Tags
  • Test Type Tags
  • NF Service Density Tags
  • Forwarding Mode Tags
  • Underlay Tags
  • Overlay Tags
  • Tagging Tags
  • Encapsulation Tags
  • Interface Tags
  • Feature Tags
  • Encryption Tags
  • Client-Workload Tags
  • Container Orchestration Tags
  • Multi-Threading Tags
  • Honeycomb Tags