CSC/ECE 517 Fall 2019 - E1984. Improve self-review Link peer review & self-review to derive grades

E1984. Improve self-review Link peer review & self-review to derive grades

This page provides a description of the Expertiza-based Semester project.

Problem Statement and Overview

In Expertiza the Instructor can create assignments and check the 'Allow self-review' box for Students. When enabled, each member evaluates his/her submission with the same criteria as the peer review. Currently, these self-review scores are not used to compute the final scores for the assignment. The task here is to improve the self-review system pertaining to give it a weightage in the final scores for the submissions.

Some of the objectives we try to achieve for this project are as follows:

• Provide a formula that takes both the peer review score and self-review score into account for calculating the composite score.
• The composite score should get higher as the self-review score gets closer to the peer-review score.
• Make sure that the peer-review scores are not visible before the self-review submission.
• Display the composite score on the “View Scores” page.
• Display the self-review scores in the "View Scores" page and in the "Alternate" (heat-map) view of the peer-reviews, highlighting them as a different type of review.

The need for the self-review section is to know how well the students can judge their work and understand how to evaluate their flaws and rectify them. Also, if they can score themselves close to their peers, then it means that they have good self-assessment skills and they are being honest about what they think of their work.

Code Changes Flow

Use case

• Actors:

1. Instructor: This actor is responsible for creating assignments and adding students to the assignment.

2. Student: This actor is responsible for submitting, self-reviewing and viewing the scores.

• Actions

1. Instructor: Create Assignment, Enable Self-Review.

2. Student: Login, Add work and Submit, Submit Self-Review, View Scores.

Previous Process

Currently, Expertiza allows students to submit an assignment and provides a link to self-review their work. Once the self-reviewing is done, the self-review score gets stored in the database and it is not further used in calculating the overall score of the assignment. Thus, students can score themselves higher than what they should actually get when considering the peer-review scores. This helps students in no way. So, to make a productive use of the self-review score and to help students learn self-evaluating themselves, we will make changes in the review score calculation, explained in the section below.

New Process

We are trying to derive a new formula that takes into account the self-review score and calculates a composite score, which will be the student's final score:

1. Notes for deriving the formula

Test Plan

The following Test cases will be developed to ensure a correct implementation:

• Peer-reviews cannot be viewed before a self-review is completed.
• Peer-reviews can be viewed immediately when self-reviews are not required.
• The composite scores are saved to the database.
• Self-review scores are displayed with peer-review scores.
• Student can only see their own self-review.

Team and Resources

Team_AABD:

• Amit Mandliya (amandli@ncsu.edu)
• Ankit Manendra (amanend@ncsu.edu)
• Bharat Sinha (bsinha2@ncsu.edu)
• Daniel Mendez Lozada (bsinha2@ncsu.edu)

References

Project

• E1984 Pull Request
• E1984 Github Repository

Peer Assessment Theory

• Scoring models for peer assessment in team-based learning projects
• Tools for enabling developmental feedback and teamwork grading by peer assessment: PeerAssessPro™