CSC/ECE 517 Fall 2018 E1854 Improve self-review, Link peer review & self-review to derive grades
E1854. Improve self-review, Link peer review & self-review to derive grades
This page provides a description of the Expertiza based Semester project.
About Expertiza
Expertiza is an open source project based on Ruby on Rails framework. Expertiza allows the instructor to create new assignments and customize new or existing assignments. It also allows the instructor to create a list of topics the students can sign up for. Students can form teams in Expertiza to work on various projects and assignments. Students can also peer review other students' submissions. Expertiza supports submission across various document types, including the URLs and wiki pages.
Problem Statement
Expertiza has the ability to require self-reviews on projects, self review is basically asking each team member in the group to evaluate their project on the same criteria as peer review, these self-review scores do not have much functionality currently. This project seeks to improve upon the self-review system, and extend its functionality. The main points of this project are as follows:
- Create a method to calculate a derived score(composite score) between self and peer-reviews. The closer the self-review is to the peer-review, the greater the score. Display this score on the "View Scores" page.
- Make sure that the peer-reviews should not be visible before self-review completion. Display the correct review scores accordingly.
- Display the self-review scores in the "View Scores" and heat map of peer-reviews, denoting that they are a different type of review.
Application Flow
The instructor has to login and create an assignment by checking allow self review option. The instructor has to add the topic and assign students to the topic. Now, the student has to login and submit the assignment. The self review link is visible in the page. The student should give the self review. After giving the self review, the student should be able to see the peer review, self review and the composite score.\
Use case Diagram
http://wiki.expertiza.ncsu.edu/images/f/fa/E1854_UseCase_Diagram.png
Actors:
Instructor: This actor is responsible for creating assignments and adding students to the assignment. Student: This actor is responsible for submitting, self-reviewing and viewing the scores.
Database:
The database where all the data of Expertiza is getting stored.
All the other use cases are implemented except “View Scores with self-review column and composite score”
Use Case: View score with self-review column and composite score
PreConditions:
1.The Student should submit the assignment and self-review. 2.The other students should submit the reviews of the work submitted.
Primary Sequence:
The student should login. The student should browse and upload the assignment. The student should submit the assignment. The student should submit the self-review. The student should choose your scores to view the score. The student should be able to see the peer-review score with the self-review scores and composite score.
Post Conditions:
The self-review and composite score will be visible on the page.
Method to calculate Composite Score
The composite score is calculated using both self-review score and peer-review score (both are graded over 5 points for each criteria). The composite score is calculated as follows:
composite score = [100 -abs(self review score - peer review score)] * peer review score / 100
By using this formula for calculating composite score we are discouraging students from either exaggerating or underrating their performance. However, the composite score model penalizes students who exaggerate their performance much more compared to students who underrate their work.
For example: If someone gets an average peer review score of 3.5/5 and he reviews his project for 3.5/5, then he will get a full composite score of 5.And if the student reviews his project for 2.5/5 then the student will get a composite score of 4.5,but if the same student reviews his project for 4.5/5 then by using the formulae the student gets a composite score of 4. In this way, students are penalized more for overestimating their score than underestimating their score.
Test Plan
Test cases are as follows:
- Peer-reviews cannot be viewed before a self-review is completed.
- Self-review scores are displayed with peer-review scores.
- The composite score must be properly calculated.
- Composite score must be visible in both view scores page and Alternate view.