Overview¶
Virtual Topologies¶
CSIT HoneyComb functional tests are executed in VM-based virtual topologies created on demand using VIRL simulation platform contributed by Cisco. VIRL runs on physical baremetal servers hosted by LF FD.io project.
All tests are executed in two-node virtual test topology shown in the figure below.
SUT (System Under Test) is a VM running Ubuntu Linux (or Centos, depending on the test suite), TG (Traffic Generator) is another VM running Ubuntu Linux. SUT VMs run HoneyComb management agent and VPP in Linux user-mode as a combined DUT (Device Under Test). TG runs Scapy application as a packet Traffic Generator. Virtual connectivity between SUT and TG is provided using virtual NICs using VMs’ virtio drivers.
Functional Tests Coverage¶
CSIT-1904 includes following HoneyComb functionality tested in virtual VM environment:
Functionality | Description |
---|---|
ACL |
|
ACL-PLUGIN |
|
Basic interface management |
|
Border Gateway Protocol |
|
DHCP Relay |
|
Honeycomb Infractructure |
|
L2BD |
|
L2FIB |
|
LISP |
|
LISP GPE |
|
NAT |
|
NSH_SFC (excluded) |
|
PBB |
|
Policer |
|
Port mirroring |
|
ProxyARP |
|
ProxyND6 |
|
Routing |
|
SLAAC |
|
Vhost-user |
|
VLAN |
|
VxLAN |
|
VxLAN-GPE |
|
TAP |
|
Total 213 Honeycomb functional tests in the CSIT-1904.
Operational data in Honeycomb should mirror configuration data at all times. Because of this, test cases follow this general pattern:
- read operational data of the feature using restconf.
- read status of the feature using VPP API dump.
- modify configuration of the feature using restconf.
- verify changes to operational data using restconf.
- verify changes using VPP API dump, OR
- send a packet to VPP node and observe behaviour to verify configuration.
Test cases involving network interfaces utilize the first two interfaces on the DUT node.
Functional Tests Naming¶
CSIT-1904 follows a common structured naming convention for all performance and system functional tests, introduced in CSIT-17.01.
The naming should be intuitive for majority of the tests. Complete description of CSIT test naming convention is provided on Test Naming.