From ba55ad95305e0da59b4d50b5fdb099cd21732bc5 Mon Sep 17 00:00:00 2001 From: Sangyoon21 <143711987+Sangyoon21@users.noreply.github.com> Date: Thu, 23 May 2024 22:20:47 +0300 Subject: [PATCH] AQAVIT Terminology markdown (#5336) * AQAVIT Teminonlogy markdown #5336 Signed-off-by: Sangyoon21 * AQAVIT Teminonlogy markdown #5336 Signed-off-by: Sangyoon21 * AQAVIT Teminonlogy markdown #5336 Signed-off-by: Sangyoon21 * Update aqa-reference.markdown * Update docs/pages/aqa-reference.markdown Co-authored-by: Shelley Lambert --------- Signed-off-by: Sangyoon21 Co-authored-by: Shelley Lambert --- docs/pages/AQAvit-terminology.markdown | 20 ++++++++++++++++++++ docs/pages/aqa-reference.markdown | 4 +++- 2 files changed, 23 insertions(+), 1 deletion(-) create mode 100644 docs/pages/AQAvit-terminology.markdown diff --git a/docs/pages/AQAvit-terminology.markdown b/docs/pages/AQAvit-terminology.markdown new file mode 100644 index 0000000000..126984a188 --- /dev/null +++ b/docs/pages/AQAvit-terminology.markdown @@ -0,0 +1,20 @@ +# AQAvit Terminology + +--- + +In AQAvit, we attempt to treat all types of test targets in the same way, to make it easier to automate and also easier to add new tests and onboard new people. This normalization starts with some agreed-upon common terminology, naming and labeling conventions, and repeatable/predictable behaviour applied across all types of test material. + + + +#### Quick review of the terminology used in AQAvit + +Screenshot 2024-03-14 at 10 25 01 AM + + +* **group** indicates a collection of tests that are related in some way + * For example the openjdk group is related by where those tests are pulled from, they are the jtreg tests from the upstream OpenJDK project. +* **level** refers to an arbitrarily divided subset of the tests in a group. The different levels that we divide tests into are sanity, extended, special and dev + * **sanity** level is meant to contain short-running tests that test regularly changing code and have shown to be often finding defects. + * **extended** level is meant to contain longer tests or tests that exercise code that is not changing as often or do not find defects as often + * **special** level is reserved for tests that need special setup or need to be handled in a special way + * **dev** level is for newly added tests and tests that are under-development or are somehow not stable and not yet ready to graduate to other levels \ No newline at end of file diff --git a/docs/pages/aqa-reference.markdown b/docs/pages/aqa-reference.markdown index 97ab1b18da..911b5ca6c0 100644 --- a/docs/pages/aqa-reference.markdown +++ b/docs/pages/aqa-reference.markdown @@ -1,3 +1,5 @@ ## Reference -- [How OpenJDK tests map to AQAvit test targets](How-OpenJDK-tests-map-to-AQAvit-test-targets.md) \ No newline at end of file +1. [AQAvit Terminology](AQAvit-terminology.markdown) + +2. [How OpenJDK tests map to AQAvit test targets](How-OpenJDK-tests-map-to-AQAvit-test-targets.md)