CSC/ECE 517 Spring 2014/oss E1402 mmb
Background
There are three different review strategies in Expertiza.
Auto Selected
Student Selected
Instructor Selected
In auto-selected reviewing, a reviewer picks the topic to review on, but not the individual submission.
Student-selected allows the reviewer to pick from a list of submissions, not topics.
Instructor-selected is where the instructor/TA assigns submissions to reviewers.
In the case of auto-selected and student-selected reviewing, the student is not allowed to pick from any topic or submission, but only to choose among those that have received the fewest reviews so far. But this strategy may be modified by selecting a non-zero threshold k as follows.
A topic is review able if the minimum number of reviews already done for the submissions on that topic is within k of the minimum number of reviews done on the least-reviewed submission on any topic.
Motivation
The goal of Expertiza is to support student-generated content through peer review and teamwork. It is a peer-review system that allows students to select a topic to work on, then submit their work and review their peers' submissions.
Design
Implementation
Objective 1
Update code in for Student Selected Reviewing to cycle through submissions and not topics.
Objective 2
Make the ‘threshold box’ on the Edit /Create assignment - Review Strategy tab to appear only when Auto-selected or Student-selected reviewing is chosen and not when Instructor-selected is chosen.
Objective 3
Allowing a student to choose any number of reviews to do, without submitting any of them, allows a student to work on multiple reviews at the same time, but it also allows students to evade the limit on number of reviews that can be done. Devise a strategy to introduce certain threshold so that the student does not evades this limit.
Objective 4
If there are no topics, Auto-selected reviewing should still work, but it should select one of the submissions that has the fewest reviews so far. Perform Testing for this.
Objective 5
If the reviewer selects his own submission for review, he is not allowed to perform the review and presented with message saying “ There are no more submissions to review on that topic.” Instead it would be better not to allow him to select his own submission for review. Also, if the user has reviewed the submission/topic with the least reviews, he should be allowed to perform review on other topics which have not reached their maximum threshold.
Objective 6
Provide a comprehensive suite of tests so that we can be sure that all review strategies are working.