feat: Validate dataset properties in jobs #1473
Draft
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Allows jobs to validate properties of the dataset.
Motivation
The
validate
action currently allows operators to enforce attributes of the DTO.However, many jobs depend on
jobParams.datasetLists
to link a job to certain datasets. This allows validation of properties on datasets associated with the dataset.The motivating example would be checking datasetLifecycle properties for certain jobs. These are currently hard-coded for special job types. This would allow them to be applied to custom job types as well.
Changes:
datasets
property to validate actions (only increate
operations) to validate linked dataset propertiesTests included
(WIP pending tests and documentation)
Documentation
official documentation info
Docs are included in SciCatProject/documentation#56