CSC/ECE 517 Fall 2019 - E1979. Completion/Progress view

From Expertiza_Wiki
Revision as of 02:21, 10 November 2019 by Jcai3 (talk | contribs) (Created page with "== ''' Introduction ''' == * In Expertiza, peer reviews are used as a metric to evaluate someone’s project. Once someone has peer reviewed a project, the authors of the project...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Introduction

  • In Expertiza, peer reviews are used as a metric to evaluate someone’s project. Once someone has peer reviewed a project, the authors of the project can also provide feedback for this review, called “author feedback.” While grading peer reviews, it would be nice for the instructors to include the author feedback, since it shows how helpful the peer review actually was to the author of the project.

Current Implementation

  • Currently, however, the instructor has no easy way of seeing the author-feedback scores, so it would be far too much trouble to include them in grades for reviewing. The aim of this project is to build this into the system.

Problem Statement

  • We need to implement following tasks according to the description.

Integration of review performance – Something that combines the author feedback data with the review data so instructors can grade reviewers based on:

  1. # of reviews completed
  2. Length of reviews
  3. [Summary of reviews]
  4. Whether reviewers added a file or link to their review
  5. The average ratings they received from the authors

An interactive visualization or table that showed this would be GREAT (You can use “HighChart” javascript library to do it.)

  • We would want the instructor of the course to be able to view how many constructive reviews were provided by a reviewer in comparison to the average number of constructive reviews provided by the other reviewers of the course.

Proposed Solutions

  • On the student review page, once a student saves his/her review, a pop can show be shown with the feedback - suggestion scores, problem scores and tone analysis among others.
  • As an instructor, one might be able to check each student's review scores and his performance as compared with the class. These scores along with the metrics will be shown in the review report page under the metrics column.

Code Changes

Test Plan

Automated Testing Using Rspec

Coverage

Manual UI Testing

Our Work

Team Information

Mentor: Mohit Jain Members:

  • Jing Cai ()
  • Yongjian Zhu ()
  • Weiran Fu ()
  • Dongyuan Wang ()

References