CSC/ECE 517 Fall 2018- Project E1865. Conflict Notification: Difference between revisions
(Created page with "== '''Introduction''' == This project aims to enhance the review mapping of the two conflicting reviews which causes an email to be sent to the instructor when there is a consid...") |
|||
| Line 1: | Line 1: | ||
== '''Introduction''' == | |||
This project aims to enhance the review mapping of the two conflicting reviews which causes an email to be sent to the instructor when there is a considerable disparity in the grading between two reviews. The goal is to help the instructors by making the process of grading reviews easier and more accurate. | |||
== '''Problem Statement''' == | |||
===Issue=== | |||
Currently, whenever two reviews for the same submission have significantly different scores, a notification is sent to the instructor any time such a conflict occurs. However, the notification email does not contain links to the particular review or submission which initiated the notification. | |||
== '''Proposed Solutions''' == | |||
== '''Introduction''' == | == '''Introduction''' == | ||
| Line 12: | Line 24: | ||
===Issue 1: Resolving the Conflict Notification=== | ===Issue 1: Resolving the Conflict Notification=== | ||
Current scenario: The function 'significant difference?' in the mode response.rb takes on the average scores of all the existing reviews and compares it with the score of the recent response. If the difference is greater than the limit specified in the Assignment Questionnaire the model, it triggers an email to the instructor with the new responses' (conflicting response's) URL. | |||
Proposed changes: Instead of taking on the average scores for existing reviews, we will loop through each review not for calculating the average but to compare the new review score with each review score. If for any iteration the limit is exceeded the review URL of that iteration will be stored and at the end of the function once all the reviews are looped an email will be triggered comprising of the new review and stored reviews URLs. | |||
== '''Test Plan''' == | |||
1) Login as an instructor | |||
2) Navigate to review grader by doing this (Manage > Assignments) | |||
3) Click on the “View review report” icon (the one with the spyglass and two people) | |||
4) Check if the visualizations are appearing in the review report. | |||
== '''References''' == | |||
Expertiza | |||
* https://expertiza.ncsu.edu/ | |||
Expertiza Github | |||
* https://github.com/expertiza/expertiza | |||
Expertiza Documentation | |||
* http://wiki.expertiza.ncsu.edu/index.php/Expertiza_documentation | |||
== '''Test Plan''' == | == '''Test Plan''' == | ||
Revision as of 00:05, 14 November 2018
Introduction
This project aims to enhance the review mapping of the two conflicting reviews which causes an email to be sent to the instructor when there is a considerable disparity in the grading between two reviews. The goal is to help the instructors by making the process of grading reviews easier and more accurate.
Problem Statement
Issue
Currently, whenever two reviews for the same submission have significantly different scores, a notification is sent to the instructor any time such a conflict occurs. However, the notification email does not contain links to the particular review or submission which initiated the notification.
Proposed Solutions
Introduction
This project aims to enhance the review mapping of the two conflicting reviews which causes an email to be sent to the instructor when there is a considerable disparity in the grading between two reviews. The goal is to help the instructors by making the process of grading reviews easier and more accurate.
Problem Statement
Issue
Currently, whenever two reviews for the same submission have significantly different scores, a notification is sent to the instructor any time such a conflict occurs. However, the notification email does not contain links to the particular review or submission which initiated the notification.
Proposed Solutions
Issue 1: Resolving the Conflict Notification
Current scenario: The function 'significant difference?' in the mode response.rb takes on the average scores of all the existing reviews and compares it with the score of the recent response. If the difference is greater than the limit specified in the Assignment Questionnaire the model, it triggers an email to the instructor with the new responses' (conflicting response's) URL. Proposed changes: Instead of taking on the average scores for existing reviews, we will loop through each review not for calculating the average but to compare the new review score with each review score. If for any iteration the limit is exceeded the review URL of that iteration will be stored and at the end of the function once all the reviews are looped an email will be triggered comprising of the new review and stored reviews URLs.
Test Plan
1) Login as an instructor
2) Navigate to review grader by doing this (Manage > Assignments)
3) Click on the “View review report” icon (the one with the spyglass and two people)
4) Check if the visualizations are appearing in the review report.
References
Expertiza
Expertiza Github
Expertiza Documentation
Test Plan
1) Login as an instructor
2) Navigate to review grader by doing this (Manage > Assignments)
3) Click on the “View review report” icon (the one with the spyglass and two people)
4) Check if the visualizations are appearing in the review report.
References
Expertiza
Expertiza Github
Expertiza Documentation