master-0aa8add November 02, 2020

Artifact info:

• Commit: master-0aa8add
• SHA256SUM: efb9ed384666c84466aa6163eae3153402d05e3e02a1ae82d27cab893781fd4b cnf-conformance-master-0aa8add.tar.gz

v0.9.4 October 29, 2020

Changes since v0.8.5

✨ Enhancements

• [Enhancement] running the "all" command should run all workload and platform tests (#401)
• [Enhancement] Update static workload test that checks for ip addresses (#402)
• [Enhancement] Update prerequisite checker to "not download helm if helm is in $PATH" (#397)
• [Enhancement] Skip prerequisite tasks (#419)

📖 Documentation

• [Documentation] Document where prereqs can be found and that they are automatically checked (#387)
• [Documentation] Add an FAQ.md to address commonly asked questions (#390)

🐛 Bug Fixes

• [BUG] weird errors when a command is not found (#296)
• [BUG] Running cleanup and or cleanup_all fails with 'Failed to raise an exception: END_OF_STACK' (#351)
• [BUG] Errors when setting up cnf-conformance (#369)
• [BUG] Travis KIND cluster fails intermittently with etcd failures (#384)
• [BUG] Latest Binary Error - Curl Installation Method for cnf-conformance v0.8.4 (#398)
• [BUG] LOG_LEVEL=debug not showing LOGGING.debug messages (#400)
• [BUG] Runner needs to clean up jobs, even when the build fails (#422)

💡 Proof of Concept tests

• [Platform] Proof of Concept - Scalability test: Test if Cluster API is enabled on the platform and manages a node (#328)

🌱 Other Changes

• Switch from TravisCI to GitHub Actions for CI builds and releases (#438)

🚉 Platform Tests

• 🚫

📦 Workload Tests

• 🚫

Artifact info:

• Commit: v0.9.4
• SHA256SUM: 2a946dfaed14d71913a0fb1a714c1d8695f5621fdedc6189c0a236999de3a52c cnf-conformance-v0.9.4.tar.gz

master-e05eff1 October, 28 2020

UPDATES

Issues addressed in this release:

• #328 Title: [Platform] Proof of Concept - Scalability test: Test if Cluster API is enabled on the platform and manages a node
  • PR #446

Artifact info:

• Commit: master-e05eff1
• SHA256SUM: 25956d2647c7a4d7c8424951d301d446c307e3aab4abea5aaf20dafc6c24f84a cnf-conformance-master-e05eff1.tar.gz

master-b3d81a2 October, 28 2020

UPDATES

Issues addressed in this release:
issue: #445 Title: Switch from TravisCI to GitHub Actions for CI builds and releases #438
issue: #438 Title: Switch from TravisCI to GitHub Actions for CI builds and releases
issue: #443 Title: update https://slack.cncf.io/ and punctuation
issue: #390 Title: [Feature] Add an FAQ.md to address commonly asked questions
issue: #442 Title: Faq documentation #390
issue: #441 Title: updated documentation for ipaddress conformance test
issue: #402 Title: [Enhancement] Update frequently failing static workload test that checks for ip addresses
issue: #440 Title: Update prerequisite checker to "not download helm if helm is in $PATH" #397
issue: #397 Title: [Enhancement] Update prerequisite checker to "not download helm if helm is in $PATH"
issue: #417 Title: cluster api spec test
issue: #328 Title: [Platform] Proof of Concept - Scalability test: Test if Cluster API is enabled on the platform and manages a node
issue: #437 Title: #296 [BUG] weird errors when a command is not found.
issue: #296 Title: [BUG] weird errors when a command is not found.
issue: #387 Title: [Feature] Document where prereqs can be found and that they are automatically checked.
issue: #439 Title: Small changes to FAQ.md draft

Artifact info:

• Commit: master-b3d81a2
• SHA256SUM: 841325b6bce4eb32c54a09f2c207d8a278a4cbc9c0fcddbfce2c258554306a75 cnf-conformance-master-b3d81a2.tar.gz

master-a32f503 October, 29 2020

UPDATES

Issues addressed in this release:
issue: #447 Title: allow underscore in logger level set env var name
issue: #400 Title: [BUG] LOG_LEVEL=debug not showing LOGGING.debug messages

Artifact info:

• Commit: master-a32f503
• SHA256SUM: d53276220d8c6c4ec932948501da56656f4105bb0a2ceb0a2dbd6015a8865bc5 cnf-conformance-master-a32f503.tar.gz

master-43630a9 October, 19 2020

UPDATES

Issues addressed in this release:
issue: #435 Title: Update frequently failing static workload test that checks for ip addresses #402
issue: #402 Title: [Enhancement] Update frequently failing static workload test that checks for ip addresses

Artifact info:

• Commit: master-43630a9
• SHA256SUM: 49dda5a1524f7461452bb1df1405d5cc5f52149dd1fb3b051e4339d87c9a634c cnf-conformance-master-43630a9.tar.gz

master-a7a5bd8 October, 15 2020

UPDATES

n/a

Artifact info:

• Commit: master-a7a5bd8
• SHA256SUM: 9441c775222def468a7eec05fcd6c45c6832b48c8413710a99824954babdeb57 cnf-conformance-master-a7a5bd8.tar.gz

master-85b305c October, 14 2020

UPDATES

Issues addressed in this release:

• #433 - #397 helm prerequisite checker
• #397 - [Enhancement] Update prerequisite checker to "not download helm if helm is in $PATH"

Artifact info:

• Commit: master-85b305c
• SHA256SUM: ac820b9b15c60c2499c83ab2b5687e3908d908b2cb18cca6ef5f696b234e6511 cnf-conformance-master-85b305c.tar.gz

master-a324300 October, 12 2020

UPDATES

Issues addressed in this release:

• #431 - #387 prereq docs updated
• #387 - [Feature] Document where prereqs can be found and that they are automatically checked.

Artifact info:

• Commit: master-a324300
• SHA256SUM: 948dcc87c4a092aca359a2fbfe350d578b3f72baad65b0564169d03fe91cfea8 cnf-conformance-master-a324300.tar.gz

master-1244350 October, 09 2020

UPDATES

Issues addressed in this release:

• #418 - test binary in empty folder
• #398 - [BUG] Latest Binary Error - Curl Installation Method for cnf-conformance v0.8.4
• #430 - Switch to using the Travis runner for CI Jobs

Artifact info:

• Commit: master-1244350
• SHA256SUM: 3bf86b118fc6994627eeaaf871c6f567a27fd540d613e08ab59c236be0837b8d cnf-conformance-master-1244350.tar.gz