Software: testing

Generic

Robot Framework

About: "is a generic test automation framework for acceptance testing and acceptance test-driven development (ATDD)"

Links: home,

Google perfkit

https://github.com/GoogleCloudPlatform/PerfKitBenchmarker

BatFish

About: "a network configuration analysis tool that can find bugs and guarantee the correctness of (planned or current) network configurations."

https://www.batfish.org/

vrnetlab - VR Network Lab

Run your favourite virtual routers in docker for convenient labbing, development and testing

https://github.com/plajjan/vrnetlab

 

Network vendors

Cisco

Test automation: GitHub, DevNet

pyosupgrade

Juniper

Contrail-testNITA (Juniper's professional services toolkit - not available publicly)

 

OpenStack

Tempest

About: "The OpenStack Integration Test Suite"

Links: Docs

Rally

About: "a benchmarking tool that is capable of performing specific, complicated and reproducible test cases on real deployment scenarios"

Links: GitHub, wiki

Shaker

About: "The distributed data-plane testing tool built for OpenStack; ...wraps around popular system network testing tools like iperf, iperf3 and netperf (with help of flent)"

Links: GitHubdocs

Flent

About: "Python wrapper to run multiple simultaneous network benchmarking tool instances (e.g. netperf/iperf/ping) and aggregate the results. It was previously known as 'netperf-wrapper'."

Links: home

VMTP

About: "data path performance measurement tool for OpenStack cloud"

Links: GitHub

 

Open vSwitch (OVS)

See 'Testsuites' section of the install guide.

 

NFV

OPNFV Yardstick, FuncTest, ...

https://docs.opnfv.org

 

Traffic generators

"PacketGen provides simple ways to generate, send and capture network packets."

Trex - an open source, low cost, stateful traffic generator fuelled by DPDK

MoonGen - "fully scriptable high-speed packet generator built on DPDK and LuaJIT. It can saturate a 10 Gbit/s connection with 64 byte packets on a single CPU core while executing user-provided Lua scripts for each packet. Multi-core support allows for even higher rates. It also features precise and accurate timestamping and rate control"

"Ostinato is a packet crafter, network traffic generator and analyzer with a friendly GUI. Also a powerful Python API for network test automation." 

 

Misc

Skydive - "real-time network topology and protocols analyzer" - http://skydive.network/

Scapy - "can easily handle most classical tasks like scanning, tracerouting, probing, unit tests, attacks or network discovery" - https://scapy.net/

Selenium - portable software-testing framework for web applications - http://www.seleniumhq.org/

hrPing - High-precision ping utility - https://www.cfos.de/en/ping/ping.htm

ToDD ("Testing on Demand: Distributed!") - "An extensible framework for providing natively distributed testing on demand." - https://github.com/toddproject/todd

Intel Dataplane Performance Demonstrators - https://01.org/intel-data-plane-performance-demonstrators/overview

libvirt-test-API - "test tool designed to complement existing libvirt test tools such as libvirt-TCK and the internal test suite. It aims at functional regression testing, trying to exercise nearly all the API by the way of the Python bindings" - https://libvirt.org/testapi.html

Fio - storage performance tests. "Fio spawns a number of threads or processes doing a particular type of I/O action as specified by the user". https://github.com/axboe/fio

Nmap ("Network Mapper") - "utility for network discovery and security auditing" - https://nmap.org/

Openstack + OpenDaylight Tempest Results - http://ankur-odl.github.io/