CSC/ECE 517 Fall 2019 - E1979. Completion/Progress view

Introduction

• In Expertiza, peer reviews are used as a metric to evaluate someone’s project. Once someone has peer reviewed a project, the authors of the project can also provide feedback for this review, called “author feedback.” While grading peer reviews, it would be nice for the instructors to include the author feedback, since it shows how helpful the peer review actually was to the author of the project.

Current Implementation

• Currently, the instructor can only see several information, including numbers of review done, team the student which have reviewed, about author feedback. The current view report can be shown as below.

• However, the instructor has no easy way of seeing the author-feedback scores, so it would be far too much trouble to include them in grades for reviewing.
• So the aim of this project is to build more feedback information into the reviewer report.

Problem Statement

• We need to implement the integration of review performance which includes:

1. # of reviews completed
2. Length of reviews
3. [Summary of reviews]
4. Whether reviewers added a file or link to their review
5. The average ratings they received from the authors
6. An interactive visualization or table that showed this would be GREAT (We may use “HighChart” javascript library to do it.)

• After analysis the current code, we found that the number of reviews, summary of reviews have already existed in the system. So we only need to finished the following tasks.

1. Length of reviews (we can use HighChart to realize visualization)
2. Whether reviewers added a file or link to their review
3. The average ratings they received from the authors

• So that the instructor of the course to be able to grade reviewers based on author feedback and review data.

Project Design

• On the student review page, once a student saves his/her review, a pop can show be shown with the feedback - suggestion scores, problem scores and tone analysis among others.
• As an instructor, one might be able to check each student's review scores and his performance as compared with the class. These scores along with the metrics will be shown in the review report page under the metrics column.

Team Information

Mentor: Mohit Jain

Members:

• Jing Cai ()
• Yongjian Zhu ()
• Weiran Fu ()
• Dongyuan Wang ()

Related Links

1. Forked GitHub Repository