CSC/ECE 517 Fall 2017/E1789 Semester Project: Difference between revisions

From Expertiza_Wiki
Jump to navigation Jump to search
(Created page with "='''Improvements to review grader'''= =='''1.Overview'''== In expertiza, review report page and summary page give the information for instructors to view the overall review resul...")
 
Line 10: Line 10:
[[File:n2.png]]
[[File:n2.png]]
<br style="clear: left"/>
<br style="clear: left"/>
'''For now, there are several defects need to be fixed to optimize the grade procedure:'''
*Metrics column is not intuitive enough.
*The layout of “Review Report Form” in “Summary Page” is unreasonable.
*Reviewers don’t need to re-review the submissions which are not updated, so there should be a checking mechanism.
'''Therefore, our tasks are:'''
*Visualize Metrics column.
*Reasonably reorganize the  “Review Report Form” in “Summary Page”.
*Check updates of submissions for reviewers to help them decide if they need to review aga.
=='''2.Visualize Metrics column'''==
==='''2.1.Summary of problems'''===
Metrics column, which is in “Review Report Form”, displays statistic data of words used in particular student’s reviews. This helps graders to value how the student compares with the average student. For now, it displays numerical data in the literal way which is not intuitive. It would be better to have a bar or column chart showing this. Ultimately, we may be showing several metrics in this column, so the bars or charts should be resizable.
[[File:n3.png]]

Revision as of 19:21, 14 November 2017

Improvements to review grader

1.Overview

In expertiza, review report page and summary page give the information for instructors to view the overall review result. Also, they are the place where instructors grade the reviews. Review report page can be accessed via Manager -> Assignment, then click the “View review report” button (the one which has a spyglass and two people). The summary can be accessed through Review Page by clicking “summary” button of a particular student.

The appearances of the two pages are shown below:



For now, there are several defects need to be fixed to optimize the grade procedure:

  • Metrics column is not intuitive enough.
  • The layout of “Review Report Form” in “Summary Page” is unreasonable.
  • Reviewers don’t need to re-review the submissions which are not updated, so there should be a checking mechanism.

Therefore, our tasks are:

  • Visualize Metrics column.
  • Reasonably reorganize the “Review Report Form” in “Summary Page”.
  • Check updates of submissions for reviewers to help them decide if they need to review aga.

2.Visualize Metrics column

2.1.Summary of problems

Metrics column, which is in “Review Report Form”, displays statistic data of words used in particular student’s reviews. This helps graders to value how the student compares with the average student. For now, it displays numerical data in the literal way which is not intuitive. It would be better to have a bar or column chart showing this. Ultimately, we may be showing several metrics in this column, so the bars or charts should be resizable.