CSC/ECE 517 Fall 2016 E1679 Let experts as well as students do reviews
E1679. Let experts as well as students do reviews
Introduction
Currently, the functionality of calibration is limited. It does not support varying-rubric-by-round feature. And for student side, there is no way to notify for an author to tell that a particular review that they received was submitted by an expert. Moreover,if an expert (instructor or TA) has reviewed an assignment, the students should be able to see how that expert rated the assignment, just like they can see calibration results for calibrated assignments by clicking on the “Show calibration results” link.
Current Implemetation
Snapshots of what is currently implemented:
1.Log in as instructor6 and edit an assignment.
2.In “General” tab, check the box of “Calibration for training” and save the change, then “Calibration” tab will be shown.
3.Go to “Calibration” tab and the a list of student works will be given and the instructor can select one of them to begin a calibration review.
4.The review rubrics for calibration is the same as student reviewing and the instructor can make his own review.
5.After the instructor submitted his review, the student can see the detail of this review in his “score” section. But currently, there’s no way to distinguish student reviews and expert reviews. In addition, the instructors cannot implement a multi-round review and vary the rubrics for different review rounds.
Files Involved
1.app/views/student_review/_responses.html.erb
2.app/views/assignments/edit/_calibration.html.erb
3.app/views/student_review/list.html.erb
4.app/views/grades/_reviews.html.erb
Task Description and Design Process
Change the “is_calibrated” field in assignment table to “has_expert_review”
Change the “calibrate_to” field in response_map table to “expert_review_to”
A new DB migration file would be added to change name of the two existing columns in the DB to a new one and all related search of these 2 column in the files involved above have to be changed to the new name.
Change the checkbox title
In assignment setting page (“General” tab), change the checkbox title from “Calibrated peer-review for training?” To “Add expert peer review?”