CSC/ECE 517 Fall 2015 E1580 Text metrics

Introduction

Expertiza is an open-source peer-review based web application which allows for incremental learning. Students can submit learning objects such as articles, wiki pages, repository links and with the help of peer reviews, improve them. The project has been developed using the Ruby on Rails framework and is supported by the National Science Foundation

Project

Purpose

The current version of The Expertiza Project has an automated meta-review system wherein the reviewer gets an e-mail containing various metrics of his review like relevance, plagiarism, number of words etc. , whenever a review is submitted. The purpose of this project is to give students some metrics on the content of the review when the automated meta reviews are disabled. This also includes the addition of new relevant metrics which can help the reviewers and instructors to gain insight into the reviews.

Scope

The scope of the project is limited creating a system where the reviewer and the instructors can view metrics for the submitted reviews.The user or the instructor need to manually visit the link to view the metrics.The instructor can view the metrics for every assignment available whereas the user can view only the metrics of the assignments relating to himself.The scope doesn't include any automated viewing of reports for the metrics.Since the project is mainly related to giving reports about the existing data, we will not be modifying the results saved by the actual peer-review mechanism.The scope also excludes any change of the actual peer review process i.e. submitting a review of an assignment or adding an assignment to a user profile.

Task Description

The project requires completion of the following tasks

1. create database table to the metrics
2. create code to calculate the values of the metrics and also ensure that the code runs fast enough (can give results within 5 seconds)
3. create views for both students and instructors that show for each assignment:
   • Total no.of words
   • average no. of words for all the reviews for the particular assignment in a particuar round
   • if suggestions are present
   • the % of peer reviews that offer any suggestions
   • if problems or errors are pointed out
   • the percentage of the peer-reviews which point out problems in this assignment in this round
   • if any offensive language is used
   • the percentages of the peer-reviews containing offensive language
   • No.of different words in a particular reviewer’s review
   • No. of questions responded to with complete sentences
4. make the code work for an assignment with and without the "vary rubric by rounds" feature
5. create tests to make sure the test coverage increases

Workflow

Details of Requirements

Hardware requirements

• Computing Power: Same as the current Expertiza system.

• Memory: Same as the current Expertiza system.

• Disk Storage: Same as the current Expertiza system.

• Peripherals: Same as the current Expertiza system.

• Network: Same as the current Expertiza system.

Software requirements

• Operating system environment : Windows/UNIX/OS X based OS

• Networking environment: Same as it is used in the current Expertiza system

• Tools: Git, Interactive Ruby