CSC/ECE 517 Fall 2016 E1709 Visualizations for instructors

Introduction

Expertiza is an open-source web application to create re-usable learning objects through peer-reviews to facilitate incremental learning. Students can submit learning objects such as articles, wiki pages, repository links and with the help of peer reviews, improve them. The project has been developed using the Ruby on Rails framework and is supported by the National Science Foundation.

Project Description

Purpose and Scope

Expertiza assignments are based on a peer review system where the instructor creates rubrics for an assignment through questionnaires which students use to review other students' submissions. The author of the submission is given an opportunity to provide feedback about these reviews. All questions in the questionnaire have an assigned grade which is based on a pre-defined grading scale. Instructors can see a report on the scores of a student given by reviewers, on the score of feedback given to the reviewers and many other reports. Based on these reports (which are all on separate pages), the instructors grade the student. These reports are, however, on separate pages and it is difficult for an instructor to navigate to many pages before grading the student. The first requirement is meant to solve this problem by merging the review scores with the author feedbacks on the same page.

Furthermore, there is no way for an instructor to evaluate the rubric he/she has posted on assignments. Students may consistently be getting negative reviews for a rubric which might not be totally relevant to the assignment thereby reducing their scores. A report of average class scores for each rubric in the questionnaires would help instructors refactor their rubric and understand where students generally perform well and where they struggle. This new report forms the second part of the requirement.

We are not modifying any of the existing functionalities of Expertiza. Our work would involve modifying the review report and creating a new report for average class scores.

Task Description

The project requires completion of the following tasks:

• Integrate review data with author feedback data to help instructors grade the reviewers.
• Add a new column to give the length of reviews.
• Separate data from columns number of reviews and summary details.
• Create a new column to check if a reviewer added a link or a file.
• Create a new column to check the average author feedback rating per team.
• Add interactive visualization to show class performance of an assignment to an instructor.
• Create a new route/view/controller for class performance.
• Add a new link to point to the new controller created. This new link will be created per assignment.
• Create two new views, one for selecting rubric criteria and second to show the graph.
• Create graphs to show the class performance as per the rubric metrics selected dynamically.

Design

Review and Author Feedback Report

Workflow

Class Performance Report

Workflow