CSC/ECE 517 Fall 2017/E17A1

This wiki page is the description of the E17A1 semester project - Let experts as well as students do reviews - for Fall 2017, CSC/ECE 517.

Introduction

Expertiza

Expertiza is an open source project based on Ruby on Rails framework. Expertiza allows the instructor to create new assignments and customize new or existing assignments. It also allows the instructor to create a list of topics the students can sign up for. Students can form teams in Expertiza to work on various projects and assignments. Students can also peer review other students' submissions. Expertiza supports submission across various document types, including the URLs and wiki pages.

Action Items

Tasks Involved

Tasks are broken down into sub-tasks as follows:

• Refactoring:
  • a checkbox in the "General" Tab from “Calibrated peer-review for training?” to “Add expert peer review?”
  • a tab name for instructor from “Calibration” to “Expert review” on the assignment setting page
  • partial file from “_calibration.html.erb” to “_expert_review.html.erb”
  • the link title on student side from “show calibration results” to “show expert peer-review results”
  • the file “response/show_calibration_results_for_student.html.erb” to “response/show_expert_review_results_for_student.html.erb”
  • title in “response/show_calibration_results_for_student.html.erb” to start with “Expert review comparison report for”
• Functionality changes
  • Vary-rubric-by-round - Currently, the functionality of calibration is limited. It does not support varying-rubric-by-round feature
  • Both TAs and instructors could do expert reviews - need to modify “response/show_calibration_results_for_student.html.erb” to make it support multiple expert reviews

Existing Limitations

At present the calibration functionality is limited, the following points present the scenarios where the current implementation is lacking:

1. No support for varying rubric by round feature.
2. From the perspective of the student, lack of differentiation of review - whether its from an expert or otherwise.
3. A student is not notified once an expert submits a review.
4. Additionally, a student should be able to see how an expert rated his/her assignment - similar to how it's done in calibration results for calibrated assignments(As seen when Show Calibration Results is clicked.).

Affected Codebase

Database Related

A new migration file needs to written to make the following changes in the DB Schema (And across all files using these fields):

• “is_calibrated” field in assignment table to “has_expert_review”
• “calibrate_to” field in response_map table to “expert_review_to”

Front-end Related

The following files need to be modified and/or refactored based on their respective tasks:

1. student_review/_responses.html.erb
2. student_review/list.html.erb
3. assignments/edit.html.erb
4. assignments/edit/_calibration.html.erb
5. response/show_calibration_results_for_student.html.erb

Design Overview

For the purpose of this project, experts in the expertiza domain are Teaching Assistants(TAs) and Instructors.