CSC/ECE 517 Fall 2021 - E2155. Calibration submissions should be copied along with calibration assignments: Difference between revisions
(Clarify background and remove Expertiza introduction as it is implied that by being here they know what Expertiza is.) |
(Grammar corrections) |
||
| Line 1: | Line 1: | ||
==Project Overview== | ==Project Overview== | ||
===Background=== | ===Background=== | ||
To improve the experience of peer reviewing and | To improve the experience of peer-reviewing in Expertiza and determine the competent reviewers amongst all the reviewers, creating a new form of review for assignments appeared to be a possible fix. As a result, "calibration assignments" were introduced to the Expertiza system. The calibration assignments were to be assigned before peer review occurred so that students would know if they reviewed using the same rubrics as the instructor. | ||
To set up a calibration assignment that both the instructor and the students | To set up a calibration assignment that both the instructor and the course students can review, the instructor needs to create a new assignment, add the extra participant manually, impersonate the participant, and finally, submit the review, which is not a great experience. What's more is that currently, if an instructor wishes to do this every semester or every year with the same course to copy over the calibration assignments, they have to repeat this process yet again. | ||
===Objectives=== | ===Objectives=== | ||
Expertiza can fix the problem of repeatedly setting up the calibration assignments by automatically copying the previous calibration assignments with all attached reviews. | |||
===Previous Implementation=== | ===Previous Implementation=== | ||
In the previous implementation, the calibration review | In the previous implementation, the implementors designed the calibration review as part of the assignment and students were able to participate in calibration review training before reviewing other students' work. | ||
The instructor | The instructor can enable the calibration review in an assignment by checking "Calibration for training?" before assignment creation. | ||
[[File:2021-11-03 011751.png]] | [[File:2021-11-03 011751.png]] | ||
| Line 17: | Line 17: | ||
[https://expertiza.csc.ncsu.edu/index.php/CSC/ECE_517_Fall_2017/E17A4_Allow_calibration_to_be_part_of_an_assignment CSC/ECE 517 Fall 2017/E17A4 Allow calibration to be part of an assignment] | [https://expertiza.csc.ncsu.edu/index.php/CSC/ECE_517_Fall_2017/E17A4_Allow_calibration_to_be_part_of_an_assignment CSC/ECE 517 Fall 2017/E17A4 Allow calibration to be part of an assignment] | ||
However, their implementation introduced several assumptions about the system that | However, their implementation introduced several assumptions about the system that we will address to allow merging into production. | ||
===Issues of Previous work=== | ===Issues of Previous work=== | ||
#The project assumes that the calibration starts at directory 0 which causes the wrong submission | #The project assumes that the calibration starts at directory 0, which occasionally causes Expertiza to copy the wrong submission. | ||
##Suggested Fix: set submitter_count to the largest directory number that | ##Suggested Fix: set submitter_count to the largest directory number that Expertiza used for calibration. | ||
###Allows us to keep track of the most recent calibration submission. | ###Allows us to keep track of the most recent calibration submission. | ||
###Gives us something we can reference during copying to get the correct directory. | ###Gives us something we can reference during copying to get the correct directory. | ||
Revision as of 21:24, 3 November 2021
Project Overview
Background
To improve the experience of peer-reviewing in Expertiza and determine the competent reviewers amongst all the reviewers, creating a new form of review for assignments appeared to be a possible fix. As a result, "calibration assignments" were introduced to the Expertiza system. The calibration assignments were to be assigned before peer review occurred so that students would know if they reviewed using the same rubrics as the instructor.
To set up a calibration assignment that both the instructor and the course students can review, the instructor needs to create a new assignment, add the extra participant manually, impersonate the participant, and finally, submit the review, which is not a great experience. What's more is that currently, if an instructor wishes to do this every semester or every year with the same course to copy over the calibration assignments, they have to repeat this process yet again.
Objectives
Expertiza can fix the problem of repeatedly setting up the calibration assignments by automatically copying the previous calibration assignments with all attached reviews.
Previous Implementation
In the previous implementation, the implementors designed the calibration review as part of the assignment and students were able to participate in calibration review training before reviewing other students' work.
The instructor can enable the calibration review in an assignment by checking "Calibration for training?" before assignment creation.
CSC/ECE 517 Fall 2017/E17A4 Allow calibration to be part of an assignment
However, their implementation introduced several assumptions about the system that we will address to allow merging into production.
Issues of Previous work
- The project assumes that the calibration starts at directory 0, which occasionally causes Expertiza to copy the wrong submission.
- Suggested Fix: set submitter_count to the largest directory number that Expertiza used for calibration.
- Allows us to keep track of the most recent calibration submission.
- Gives us something we can reference during copying to get the correct directory.
- Suggested Fix: set submitter_count to the largest directory number that Expertiza used for calibration.