CSC/ECE 517 Fall 2020 - E2075. calibration submissions should be copied along with calibration assignments: Difference between revisions
No edit summary |
No edit summary |
||
| Line 3: | Line 3: | ||
__TOC__ | __TOC__ | ||
= Introduction = | |||
The Expertiza project allows "calibration assignments" to be performed where students are asked to review work that has also been reviewed by a member of the course staff. Calibration is the term used for rectifying, or checking or determining something. In the context of this project, a 'Calibrated review' is one which is performed by a student, so that (s)he can verify their work by comparing it with the instructor's response for the same assignment. If the student’s review “resembles” the staff-member’s review, then the student is presumed to be a competent reviewer. Since calibration reviews are meant as reference for better performance of peer reviews (which are performed later), they are not graded. | The Expertiza project allows "calibration assignments" to be performed where students are asked to review work that has also been reviewed by a member of the course staff. Calibration is the term used for rectifying, or checking or determining something. In the context of this project, a 'Calibrated review' is one which is performed by a student, so that (s)he can verify their work by comparing it with the instructor's response for the same assignment. If the student’s review “resembles” the staff-member’s review, then the student is presumed to be a competent reviewer. Since calibration reviews are meant as reference for better performance of peer reviews (which are performed later), they are not graded. | ||
= Problem Statement = | |||
== Goal == | |||
Calibration submissions should be copied along with calibration assignments. | Calibration submissions should be copied along with calibration assignments. | ||
== Issue in current implementation == | |||
On creating a copy of a previous assignment, say for example Design Exercise, <i>Fall '20</i> for the <i>Fall '21</i> semester - the calibration assignments associated with it are not copied over. The instructor is required to impersonate extra participants, and submit work on behalf of each of the extra participants. This is obviously extra trouble, and it would be a lot more convenient if an instructor didn’t have to resubmit the same calibration submissions over and over, every semester. <br><br> | On creating a copy of a previous assignment, say for example Design Exercise, <i>Fall '20</i> for the <i>Fall '21</i> semester - the calibration assignments associated with it are not copied over. The instructor is required to impersonate extra participants, and submit work on behalf of each of the extra participants. This is obviously extra trouble, and it would be a lot more convenient if an instructor didn’t have to resubmit the same calibration submissions over and over, every semester. <br><br> | ||
| Line 26: | Line 26: | ||
[[File:cali_b_2075.png]] <br><br><br> | [[File:cali_b_2075.png]] <br><br><br> | ||
= Proposed Design = | |||
The following must be added to the current implementation: | The following must be added to the current implementation: | ||
| Line 32: | Line 32: | ||
* Add test cases to maintain coverage if SLOC increases | * Add test cases to maintain coverage if SLOC increases | ||
= Implementation = | |||
== Test Plan == | == Test Plan == | ||
= Useful Links = | |||
*[https://github.com/expertiza/expertiza Expertiza on GitHub] | *[https://github.com/expertiza/expertiza Expertiza on GitHub] | ||
*[http://expertiza.ncsu.edu/ The live Expertiza website] | *[http://expertiza.ncsu.edu/ The live Expertiza website] | ||
*[http://research.csc.ncsu.edu/efg/expertiza Expertiza project Details] | *[http://research.csc.ncsu.edu/efg/expertiza Expertiza project Details] | ||
= Team Information = | |||
* Nischal Kashyap | * Nischal Kashyap | ||
* Mounika Bachu | * Mounika Bachu | ||
* Akshay Podila | * Akshay Podila | ||
* Dhanraj Raghunathan | * Dhanraj Raghunathan | ||
Revision as of 04:35, 27 October 2020
This wiki page describes the changes made under E2075, to ensure calibration submissions are copied along with calibration assignments for CSC/ECE 517, Fall 2020.
Introduction
The Expertiza project allows "calibration assignments" to be performed where students are asked to review work that has also been reviewed by a member of the course staff. Calibration is the term used for rectifying, or checking or determining something. In the context of this project, a 'Calibrated review' is one which is performed by a student, so that (s)he can verify their work by comparing it with the instructor's response for the same assignment. If the student’s review “resembles” the staff-member’s review, then the student is presumed to be a competent reviewer. Since calibration reviews are meant as reference for better performance of peer reviews (which are performed later), they are not graded.
Problem Statement
Goal
Calibration submissions should be copied along with calibration assignments.
Issue in current implementation
On creating a copy of a previous assignment, say for example Design Exercise, Fall '20 for the Fall '21 semester - the calibration assignments associated with it are not copied over. The instructor is required to impersonate extra participants, and submit work on behalf of each of the extra participants. This is obviously extra trouble, and it would be a lot more convenient if an instructor didn’t have to resubmit the same calibration submissions over and over, every semester.
The following steps were taken to test the aforementioned issues:
Step 1: On copying the Design exercise assignment
Step 2: The original file contains the following calibration reviews
Step 3: However, the copy doesn't contain any of the calibrated reviews
Proposed Design
The following must be added to the current implementation:
- Use the same extra participants as the assignment you are copying to creating the calibration used
- Add test cases to maintain coverage if SLOC increases
Implementation
Test Plan
Useful Links
Team Information
- Nischal Kashyap
- Mounika Bachu
- Akshay Podila
- Dhanraj Raghunathan