ReFrame 3.11.0-rc2

Release Notes

New features and enhancements

• Add display name to the failure statistics (#2472)

Bug fixes

• Fix regression with tests that treat stdin as a tty (#2476)
• Make rerun prompt consistent with the new naming scheme (#2471)

Test library

n/a

Other

n/a

ReFrame 3.11.0-rc1

Release Notes

New features and enhancements

• Extend the public API of Job (#2463)

Bug fixes

• Fix and enhance LSF support (#2383)

Test library

• Make bench_name loggable in Gromacs library test (#2462)

Other

• Update checkout and setup-python versions for GH actions (#2457)
• Minor deployment improvements (#2447)
• Modernize test syntax in the test dependencies docs (#2459)
• Update versionadded annotations (#2448)

ReFrame 3.11.0-rc0

Release Notes

New features and enhancements

• Add support for Python 3.10 (#2443)
• Support for loggable variables, parameters and properties of tests (#2428)
• Remove runtime timings from the default output (#2425)

Bug fixes

• Properly select configuration when running tests (#2438)
• Enforce override of hooks with the same name (#2436)
• Do not set up Spack shell support (#2424)

Test library

n/a

Other

• Add a small note in the Spack backend tutorial on specifying a spec targets (#2422)

ReFrame 3.10.1

Release Notes

New features and enhancements

• Add convenience function to set a test variable only if it's undefined (#2403)

Bug fixes

• Fix job cancellation when job is pending due to ReqNodeNotAvail (#2417)
• Fix --show-config for null config options (#2414)
• Automatically convert numeric configuration parameters when set from the command line or the environment (#2392)
• Fix find_modules to return unique module names (#2401)
• Print skip test messages for new asynchronous execution policy (#2400)

Test library

• Add support for building both GPU dgemm+sgemm executables (#2372)

Other

• Use compile as the name of the build pipeline stage (#2418)
• Enhance documentation of environment variables set in the system configuration (#2419)

ReFrame 3.10.0

Release Notes

Changes since 3.9.0

New features and enhancements

• Introduce new naming scheme for tests (#2355)
• Execute build phase asynchronously (#2194)
• Add a command line option that allows decreasing the verbosity level of the output (#2314)
• Improve OAR preamble commands (#2318)
• Support passing arbitrary options to git clone in the git_clone() utility function (#2279)
• Define the execution order of hooks and implement it properly (#2273)
• Accept 0 and 1 for boolean env variables (#2274)
• Add metadata to environment definitions in the configuration (#2265)
• Add a utility function to skip tests that have no topology information (#2267)
• Filter tests based on the maintainers (#2263)

Bug fixes

• Avoid conflicts with already loaded Python modules when loading ReFrame tests (#2390)
• Fix regex pattern for matching node lists (#2379)
• Add support for heterogeneous jobs in Slurm backend (#2376)
• Fix setting boolean variables from the command line (#2309)
• Use conformant job names for Torque backend (#2329)
• Fix hook execution order for hooks in the same class (#2287)
• Fix incorrect regex for gpu_bandwidth_check perf results (#2272)

Test library

• Append to executable_opts in Gromacs library test (#2316)
• Add PyTorch library test and base CSCS test on top of it (#2183)
• Add GROMACS benchmark tests (#2186)
• Add a generic test for TensorFlow with Horovod (#2182)
• Fix test library docs and rearrange the Jupyter tests (#2266)
• Rename apps to sciapps in test library (#2260)
• Add a library test for Apache Spark (#2214)

Other

• Use v4 super-linter in Github Actions (#2358)
• Change interval of dependabot check to "monthly" (#2344)
• Create dependabot file to update ReFrame requirements (#2310)
• Decrease verbosity when running the tutorial from the CI (#2299)
• Base the CSCS ReFrame deployment on version 3.9.1 (#2293)
• Remove remote autodetect from CI (#2271)
• Fix reference URL for Gitlab CI validation (#2262)
• Update copyright year to 2022 in all files (#2393)
• Add PyPI download badges (#2381)
• Fix typos in tutorials (#2361)
• Use documentation tags for literalinclude (#2295)
• Update README (#2294)
• Improve documentation of (pre|post)run_cmds (#2285)
• Add tutorial about fixtures (#2257)
• Update README (#2256)

ReFrame 3.9.3

Release Notes

New features and enhancements

• Add a command line option that allows decreasing the verbosity level of the output (#2314)
• Improve OAR preamble commands (#2318)

Bug fixes

• Fix setting boolean variables from the command line (#2309)
• Use conformant job names for Torque backend (#2329)

Test library

• Append to executable_opts in Gromacs library test (#2316)

Other

• Change interval of dependabot check to "monthly" (#2344)
• Create dependabot file to update ReFrame requirements (#2310)

ReFrame 3.9.2

Release Notes

New features and enhancements

• Support passing arbitrary options to git clone in the git_clone() utility function (#2279)
• Define the execution order of hooks and implement it properly (#2273)
• Accept 0 and 1 for boolean env variables (#2274)

Bug fixes

• Fix hook execution order for hooks in the same class (#2287)

Test library

• Fix incorrect regex for gpu_bandwidth_check perf results (#2272)
• Add PyTorch library test and base CSCS test on top of it (#2183)
• Add GROMACS benchmark tests (#2186)

Other

• Decrease verbosity when running the tutorial from the CI (#2299)
• Use documentation tags for literalinclude (#2295)
• Update README (#2294)
• Improve documentation of (pre|post)run_cmds (#2285)

ReFrame 3.9.1

Release Notes

New features and enhancements

• Add metadata to environment definitions in the configuration (#2265)
• Add a utility function to skip tests that have no topology information (#2267)
• Filter tests based on the maintainers (#2263)

Bug fixes

N/A

Test library

• Add a generic test for TensorFlow with Horovod (#2182)
• Fix test library docs and rearrange the Jupyter tests (#2266)
• Rename apps to sciapps in test library (#2260)
• Add a library test for Apache Spark (#2214)

Other

• Remove remote autodetect from CI (#2271)
• Fix reference URL for Gitlab CI validation (#2262)
• Add tutorial about fixtures (#2257)
• Update README (#2256)

ReFrame 3.9.0

Release Notes

Changes since 3.8.0

New features and enhancements

• Support for test fixtures (#2166)
• Add command line option to exclude tests with a specific tag (#2223)
• Add configuration parameter to control the timeout of the git clone commands (#2225)
• Emit JUnit report in child pipeline CI jobs (#2205)
• Use fully qualified domain names when retrieving hostnames (#2216)
• Add support for the OAR scheduler (#2129)
• Store the default Spack environment in the build_system instance (#2195)
• Pass parent CI image name and ReFrame verbosity level in the generated Gitlab child pipelines (#2137)
• Add support for the LSF scheduler and LLNL's lrun parallel launcher (#2133)

Bug fixes

• Introduce properly the RFM_TRAP_JOB_ERRORS environment variable (#2253)
• Fix type error when RFM_GIT_TIMEOUT is set (#2243)
• Remove timeout argument from git clone command (#2239)
• Fix duplicate walltime directive in OAR scheduler (#2235)
• Fix variable attribute injection (#2232)
• Fix uncontrolled job submission for remote autodetection (#2229)
• Store performance variables in run report (#2209)
• Fix error when cache associativity information is not available by sysctl (#2206)
• Fix --restore-session failure when ReFrame root directory is not in sys.path[0] (#2201)
• Fix division by zero when calculating the poll rate (#2199)
• Fix timestamp prefix when --timestamp option is passed no arguments (#2198)
• Fix remote auto-detection crash (#2189)
• Fix incomplete processor info object when processor topology is auto-detected (#2168)
• Fix pattern matching for test name in --ci-generate output (#2160)

Test library

• Add a library test for CSCS' ipcmagic (#2192)
• Make the Amber library test available for immediate use (#2221)

Other

• Update CI deployment scripts (#2220)
• Add GitHub Action to run unit tests on macOS (#2207)
• Test run Spack and EasyBuild tutorial examples in a container (#2102)
• Add entry page for the library documentation (#2244)
• Document how to control default values of variables from the command line (#2228)
• Document more of the existing Job properties (#2227)
• Indicate in the documentation that the @required_version decorator is deprecated (#2211)
• Update tutorials to the new sanity and performance syntax (#2167)
• Sort command line options and environment variables alphabetically in -h output and the man page (#2174)

ReFrame 3.8.3

ReFrame v3.8.3 Release Notes

New features and enhancements

• Use fully qualified domain names when retrieving hostnames (#2216)

Bug fixes

• Store performance variables in run report (#2209)
• Fix error when cache associativity information is not available by sysctl (#2206)
• Fix --restore-session failure when ReFrame root directory is not in sys.path[0] (#2201)

Test library

• Add Python NumPy library check and build CSCS test on top of it (#2184)
• Add new Amber NVE library test and refactor the CSCS Amber check (#2172)

Other

• Enable remote auto-detection in CSCS configs (#2213)
• Add GitHub Action to run unit tests on macOS (#2207)
• Indicate in the documentation that the @required_version decorator is deprecated (#2211)