Skip to content

Latest commit

 

History

History
141 lines (90 loc) · 5.61 KB

FAQ.md

File metadata and controls

141 lines (90 loc) · 5.61 KB
Raw

CNF Test Suite Frequently Asked Questions

General

What is the CNF Test Suite?

  • The CNF Test Suite program enables interoperability of Cloud native Network Functions (CNFs) from multiple vendors running on top of Kubernetes. The CNF Test Suite's goal is to provide an open source test suite to demonstrate conformance and implementation of best practices for both open and closed source Cloud Native Network Functions.

Can I contribute to the CNF Test Suite?

Does the CNF Test Suite community meet?

  • Yes. The CNF Test Suite team meets once a week on Thursdays at 14:15-15:00 UTC. You can find more info about the meeting here.

Does CNF Test Suite have a slack channel?

If I found a bug or I think it's a bug, how do I report it?

  • If you would like to report a bug, please create a new issue (using the Bug Report Template).

How do I request a new feature?

  • If you would like to request an enhancement, please create a new issue (using the Feature Request Template).

Can I request a new workload or platform test for the CNF Test Suite?

  • Yes. If you would like to request a new workload test, please create a new issue (using the New Workload Test Template) or create a new issue (using the New Platform Test Template).

Technical and Usage

Can I run the CNF Test Suite without a Kubernetes cluster?

  • In simple terms, no. You need some type of Kubernetes (K8s) cluster whether it's bare metal, kind, Docker and so on to run the CNF Test Suite against your CNF.

Does the CNF Test Suite have any pre-requisites or other requirements to run?

  • Yes. There are a few requirements for the CNF Test Suite. You can read about the requirements in the INSTALL Guide.

How are points assigned for tests?

  • Points are different for each test and workload but in general terms, pass defaults to 5 and fail is a -1. See points.yml for more details on the different points for default scoring.

What platforms are supported by the CNF Test Suite?

  • The CNF Test Suite runs on most major Linux distributions, Mac OS X (Intel + source install only) and WSL (Windows Subsystem for Linux).

Does the CNF Test Suite support or run on other architectures besides amd64?

  • Currently only amd64 (Intel) is supported.

Can I run the CNF Test Suite on clusters currently in use?

  • Yes but it's not recommended. There is a destructive option that will test your nodes with reboots and recovery. We recommend that tests are run in an environment that is not currently used by others, typically in a test or dev environment setting.

I ran several tests and missed the output of the results, are these lost or can I view past test results?

  • All test results are stored in the results/ directory of where you installed the CNF Test Suite in yaml format.

Why is the CNF Test Suite written in Crystal and not in other languages like Go?

  • The short answer is Crystal fit the criteria we looked at in a language at the time which needed to run external programs/test suites and internal tests - Taylor Carpenter via https://slack.cncf.io/
  • Usability for Humans - Crystal, puts readablility for humans as a priority, which is why its syntax heavily inspired by Ruby.
  • Type checking system to help humans catch their errors earlier
  • Compiled language for portability, reduced size, and performance
  • Metaprogramming through Crystal's powerful macro system
  • Concurrency throughy green threads, called fiberes, which communicate over channels like Go lang and Clojure
  • Dependency management for libraries and applications via the crystal manager Shards

Troubleshooting

Running cnf-testsuite says "No found config" or similiar type errors?

  • This may indicate that you are not pointing to a valid cnf-testsuite.yml config file for your CNF. You may want to read or review the INSTALL instructions or the USAGE Documentation.