CSC/ECE 517 Fall 2021 - E2155. Calibration submissions should be copied along with calibration assignments: Difference between revisions

From Expertiza_Wiki
Jump to navigation Jump to search
(Clarify background and remove Expertiza introduction as it is implied that by being here they know what Expertiza is.)
Line 1: Line 1:
==Project Overview==
==Project Overview==
===Introduction===
===Background===
#TODO: Rephrase the sentences
To improve the experience of peer reviewing and to determine the competent reviewers amongst all the reviewers, the creation of a new form of review for assignments appeared to be a possible fix. As a result, so-called "calibration assignments" were introduced to the Expertiza system. The calibration assignments were to be assigned before peer review occurs so that students would know if they reviewed using the same rubrics as the instructor.
Expertiza is an open-source learning management system developed using Ruby on Rails framework. Expertiza supports multiple features such as course management, assignment submission, peer review, grade calculation, etc.


[https://expertiza.csc.ncsu.edu/index.php/Expertiza_documentation Expertiza Documentation]
To set up a calibration assignment that both the instructor and the students of the course can review, the instructor needs to create a new assignment, add the extra participant manually, impersonate the participant, and finally, submit the review, which is not a great experience. What's more is that currently, if an instructor wishes to do this every semester or every year with the same course, in order to copy over the calibration assignments they have to repeat this process yet again.  
 
[https://expertiza.ncsu.edu/ Expertiza] is an open-source education and classroom web-tool founded by the [http://www.nsf.gov/ National Science Foundation]. Built with Ruby on Rails, it is designed to manage complete courses and students’ work within those courses. Each course can have a collection of instructors and students, though the interaction between instructors and students is minimal. The real emphasis of Expertiza is placed on peer-to-peer interactions, fostering a student-driven learning environment. Courses are comprised of assignments which users complete individually or with a team. Assignments usually encourage or require a team to enforce practicing peer-to-peer interaction.
 
===Background===
To improve the experience of peer reviewing and to find out the competent reviewers among all the reviewers, designing a new form of review for assignments seems to be a fix. As a result, "calibration assignment" was introduced to the Expertiza system. The calibration assignment should be assigned before the peer review so that the students can know if they reviewed using the same rubrics as the instructor.
To set up the calibration assignment that allows both the instructor and the students of the course to review, the instructor needs to create a new assignment and add the extra participant manually, impersonate the participant then submit the review, which is not a great experience.


===Objectives===
===Objectives===
To fix the issue of setting up the calibration assignment repeatedly every semester, the system should be able to make a copy of the previous calibration assignment and let the instructor submit a review as the extra participant by selecting calibration training when the instructor creates the assignment.
To fix the issue of needing to set up the calibration assignment repeatedly, the system should be able to make a copy of the previous calibration assignments with all attached reviews automatically.


===Previous Implementation===
===Previous Implementation===
In the previous implementation, the calibration review was designed as part of the assignment and students should be able to participate in calibration review training before reviewing other students' work.
In the previous implementation, the calibration review was designed as part of the assignment and students were able to participate in calibration review training before reviewing other students' work.


The instructor can enable the calibration review in each assignment by checking the box before "Calibration for training?".
The instructor was able to enable the calibration review in an assignment by checking the box "Calibration for training?" prior to assignment creation.


[[File:2021-11-03 011751.png]]
[[File:2021-11-03 011751.png]]


[https://expertiza.csc.ncsu.edu/index.php/CSC/ECE_517_Fall_2017/E17A4_Allow_calibration_to_be_part_of_an_assignment CSC/ECE 517 Fall 2017/E17A4 Allow calibration to be part of an assignment]
[https://expertiza.csc.ncsu.edu/index.php/CSC/ECE_517_Fall_2017/E17A4_Allow_calibration_to_be_part_of_an_assignment CSC/ECE 517 Fall 2017/E17A4 Allow calibration to be part of an assignment]
However, their implementation introduced several assumptions about the system that need to be addressed before merging into production.


===Issues of Previous work===
===Issues of Previous work===

Revision as of 21:13, 3 November 2021

Project Overview

Background

To improve the experience of peer reviewing and to determine the competent reviewers amongst all the reviewers, the creation of a new form of review for assignments appeared to be a possible fix. As a result, so-called "calibration assignments" were introduced to the Expertiza system. The calibration assignments were to be assigned before peer review occurs so that students would know if they reviewed using the same rubrics as the instructor.

To set up a calibration assignment that both the instructor and the students of the course can review, the instructor needs to create a new assignment, add the extra participant manually, impersonate the participant, and finally, submit the review, which is not a great experience. What's more is that currently, if an instructor wishes to do this every semester or every year with the same course, in order to copy over the calibration assignments they have to repeat this process yet again.

Objectives

To fix the issue of needing to set up the calibration assignment repeatedly, the system should be able to make a copy of the previous calibration assignments with all attached reviews automatically.

Previous Implementation

In the previous implementation, the calibration review was designed as part of the assignment and students were able to participate in calibration review training before reviewing other students' work.

The instructor was able to enable the calibration review in an assignment by checking the box "Calibration for training?" prior to assignment creation.

CSC/ECE 517 Fall 2017/E17A4 Allow calibration to be part of an assignment

However, their implementation introduced several assumptions about the system that need to be addressed before merging into production.

Issues of Previous work

  1. The project assumes that the calibration starts at directory 0 which causes the wrong submission to be copied occasionally.
    1. Suggested Fix: set submitter_count to the largest directory number that was used for calibration.
      1. Allows us to keep track of the most recent calibration submission.
      2. Gives us something we can reference during copying to get the correct directory.

Design

Implementation

Retrieved from "https://wiki.expertiza.ncsu.edu/index.php?title=CSC/ECE_517_Fall_2021_-_E2155._Calibration_submissions_should_be_copied_along_with_calibration_assignments&oldid=140648"