CSC/ECE 517 Fall 2020 - E2078. Improve self-review Link peer review & self-review to derive grades
Project Overview
Description of project
View documentation for previous implementation here.
Team
Courtney Ripoll (ctripoll)
Jonathan Nguyen (jhnguye4)
Justin Kirschner (jkirsch)
Files Involved
Tasks
Currently, it is possible to check the “Allow self-review” box on the Review Strategy tab of assignment creation, and then an author will be asked to review his/her own submission in addition to the submissions of others. But as currently implemented, nothing is done with the scores on these self-reviews.
Display Self-Review Scores w/ Peer-Reviews
It should be possible to see self-review scores juxtaposed with peer-review scores. Design a way to show them in the regular “View Scores” page and the alternate (heat-map) view. They should be shown amidst the other reviews, but in a way that highlights them as being a different kind of review.
Design Plan
Derive Composite Score
Implement a way to combine self-review and peer-review scores to derive a composite score. The actual formula is not as important as it is to encapsulate the formula in a method that can easily be modified if we want to change the formula. But the basic idea is that the authors get more points as their self-reviews get closer to the scores given by the peer reviewers. So the function should take as inputs the scores given by peers to a particular rubric criterion, and the score given by the author(s). The result of the formula should be displayed in a conspicuous page on the score view.
Implementation Plan
Implement Requirement to Review Self before Viewing Peer Reviews
There would be no challenge in giving the same self-review scores as the peer reviewers gave if the authors could see peer-review scores before they submitted their self-reviews. The user should be required to submit their self-evaluation(s) before seeing the results of their peer evaluations.
Implementation Plan
Test Plan
Relevant Links
Our repository:
Pull request:
Video demo:
References
Scoring models for peer assessment in team-based learning projects