Partially manual correction

[tbarbette]

Hi all,

Have there been some thoughts to enable mixed marking? E.g. 60% of the grade is given by inginious but you've also got a few "manual" criterions to mark the report, code style, algorithmic or anything too complex for auto-grading.

Especially for the first step of a project in Bac 1, I want students to do some work that I can automatically verify (say input/output functional tests), print a few important pointers (say the number of LOC, execution time), but also grade a few criterions that I must check manually using this previous information and the submission itself.

I place this question in the context of a Moodle workflow, but it is a bit orthogonal.

The current way (please give pointers for enhanced workflow, of course):

• Get my student list in excel format from moodle, on a fake Assignment (students do not submit there, but on Inginious).
• Go student-by-student in the excel sheet
  • find the student in the inginious submissions list (CTRL + F for the name), filter
  • click on the submission and the results.
  • Copy the inginious mark for my 'automatic test' criterion
  • mark my manual criterion, add feedback to a given column
• export the excel back to Moodle

Manually downloading all submissions is not really better because reading the json is less efficient than browsing the web.

The LTI integration to Moodle does not help, because moodle will not enable to add some more "criterions" either. In my last project I ended up doing a python script that would collect jsons etc but it didn't prove much more convenient. I would still need to go manually open a report.pdf or something like that.

What I would like:

• The mark of inginious is only a percentage of the total grade, say 60%
• Have a list of criterions for which I can give a grade + eventual global feedback directly on the "View submissions" page.
• The mark of inginious is the final mark, students can see their feedback. If integrated in Moodle through LTI, this also works without any change.

An alternative I could see is an LTI-of-LTI, where I get the inginious results side-by-side with a list of criterions managed through a middleware. Maybe conceptually Inginious should not include non-automatic grading, and therefore this is a better solution.

Another alternative would be to change moodle to enable mixing LTI grade with more criterions. We can of course create a second activity but for marking it does not help, one must go through inginious side-by-side to find the matching submission and that's a huge loss of time when we have 100+ students. Typically when students also submit a report, one must open the report, inginious, and the grading tool (excel in general as Moodle itself is a pain), where all this could be integrated together. But modifying Moodle seems rather complex...

Thanks,
Tom

[GuillaumeDerval]

See #598 for a very old idea