feat: scoring for multistep ORA configuration #6
+316
−54
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
TL;DR - This PR implements behind a systems feature flag a grading strategy of accumulating scores obtained on each workflow step.
The changes I have made are intended to allow a grade that accumulates the final score of each step each time the grade changes. That is when the instructor grades the student, then the student's final grade is the sum of the steps graded so far (for now only staff). When the peers grade my submission, then the student's final grade is the sum of the steps graded so far (staff + peer). Thus, we do not modify how the score is calculated, but what the final score is.
What changed?
Now, the accumulative scoring strategy can be turned on/off system-wide. When off, the ORA scoring system works as usual.
Developer Checklist
Testing Instructions
Install this version into your environment.
Turn on the feature flag for the LMS:
FEATURES['ENABLE_ACCUMULATIVE_GRADING'] = True
Configure your ORA with the default criteria
Configure the ORA steps as follows:
Now try replicating the following:
5 (median peer) + 5 (staff) = 10/10.
3 (median peer) + 1 (staff) = 4/10
And the total: 14/20
3 (median peer) + 0 (staff) = 3/10.
3 (median peer) + 1 (staff) = 4/10
And the total: 7/20
Reviewer Checklist
Collectively, these should be completed by reviewers of this PR: