Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Refactor:Developer] Add hidden test case details #619

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions Gemfile.lock
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,7 @@ GEM
faraday-net_http (3.1.0)
net-http
ffi (1.16.3)
ffi (1.16.3-x64-mingw-ucrt)
forwardable-extended (2.6.0)
gemoji (4.1.0)
github-pages (231)
Expand Down Expand Up @@ -233,6 +234,8 @@ GEM
uri
nokogiri (1.16.3-arm64-darwin)
racc (~> 1.4)
nokogiri (1.16.3-x64-mingw-ucrt)
racc (~> 1.4)
nokogiri (1.16.3-x86_64-linux)
racc (~> 1.4)
octokit (4.25.1)
Expand Down Expand Up @@ -270,19 +273,23 @@ GEM
unf (0.1.4)
unf_ext
unf_ext (0.0.9.1)
unf_ext (0.0.9.1-x64-mingw-ucrt)
unicode-display_width (1.8.0)
uri (0.13.0)
wdm (0.2.0)
webrick (1.8.1)
yell (2.2.2)

PLATFORMS
arm64-darwin-22
x64-mingw-ucrt
x86_64-linux

DEPENDENCIES
github-pages (= 231)
html-proofer (~> 3.19.4)
json
wdm (>= 0.1.1)
webrick (~> 1.8)

BUNDLED WITH
Expand Down
52 changes: 52 additions & 0 deletions _docs/instructor/autograding/hidden_testcase_examples.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,52 @@
---
title: Hidden Testcase Examples
category: Instructor > Autograding
redirect_from:
- /instructor/assignment_configuration/hidden_testcase_examples
---

### Hide Testcase Details and Score, Never Release

In your `config.json`, add this line to the testcase:
```
"hidden": true
```

This is what it will look like for students:

#### Image goes here

#### Discussion of use

### Hide Testcase Details and Score, Release With Grades

In your `config.json`, add these lines to the testcase:
```
"hidden": true,
"release_hidden_details": true
```

This is what it will look like for students:

#### Image goes here

#### Discussion of use

### Hide Testcase Details, Show Score

In your `config.json`, **do not** change the `hidden` field.
Instead, add these lines to the validation of the testcase:
```
"show_actual": never,
"show_expected": never
```
Additionally, if working with image differences, add this line:
```
"show_difference_image": never
```

This is what it will look like for students:

#### Image goes here

#### Discussion of use
10 changes: 10 additions & 0 deletions _docs/instructor/autograding/specification.md
Original file line number Diff line number Diff line change
Expand Up @@ -128,6 +128,16 @@ executables.
**type:** _boolean_
**default value:** ``false``

_Students will not know how many points hidden test cases are worth or
how many points they recieve for that test case. For similar functionality
while still allowing students to see how many points they receive, adjust
``show_message``, ``show_actual``, and ``show_expected`` in validation instead._


* **field:** ``"release_hidden_details"``
**type:** _boolean_
**default value:** ``false``


* **field:** ``"extra_credit"``
**type:** _boolean_
Expand Down
1 change: 1 addition & 0 deletions navtreedata.js
Original file line number Diff line number Diff line change
Expand Up @@ -128,6 +128,7 @@ var NAVTREE =
[ "Validation", "/instructor/autograding/validation", null ],
[ "Batch Regrade Submissions", "/instructor/autograding/batch_regrade", null ],
[ "Sample Assignments", "/instructor/autograding/sample_assignments", null ],
[ "Hidden Testcase Examples", "/instructor/autograding/hidden_testcase_examples", null ],
[ "Docker Images", "/instructor/autograding/docker_images", null ],
[ "Docker UI", "/instructor/autograding/docker_ui", null ],
[ "Static Analysis", "/instructor/autograding/static_analysis/index", [
Expand Down
Loading