CSC/ECE 517 Spring 2018- Project E1817: Adding Student-generated Questions to Rubric

Introduction

Overview of Project

Expertiza contains Peer-Review where in all students are asked to review the work done by their fellow classmates. The rubric for the same are created by instructors. These Rubrics contain questions that are related to the submitted topics. But sometimes students have questions which may or may not be related to the work other students are working on. So there is no option currently available to ask these questions to their peers. This project (E1817) aims to solve this problem by allowing students to add questions to the standard instructor generated rubric so that they can get specific feedback on from the reviewers.

Proposed Solution

In order to solve the above problem, we intend to add Supplementary Review Questions to the existing Review Questions already added by the instructor. These “extra” questions will not be graded. However, they will increase the benefit that each person gets because they can get feedback that is specific to their project. The rest of this document describes the design and approach for project E1817.

Implementation

In Expertiza, all rubrics and surveys are subclasses of Questionnaire. A Questionnaire has “questions” that make use of checkboxes, dropdowns, text boxes, etc. We want to add a new subclass of Questionnaire called SupplementaryReviewQuestionnaire to help us implement this project.

Design Strategy

The flowcharts below describes the design that we chose to implement for this project.

• When a student wants to create/edit Supplementary Review Questionnaire
  • If the instructor has enabled a particular assignment to have supplementary review questionnaire only then a student can create a supplementary review questionnaire. A student can click on the "Your Work" tab and see a link to the add/edit Supplementary Review Questionnaire. This link directs the student to the create review questionnaire(same as instructor).
  • When a student creates a Supplementary Review Questionnaire (SRQ), the entry in the SRQ column added to the Teams table will contain the questionnaire id to link the SRQ with the team that generated it. If the SRQ column of a team is empty it means no supplementary review questionnaire was created. If its not empty, it will indicate that a supplementary review questionnaire was created.

• When Reviewer wants to access the Review Questions.
  • When a reviewer requests for a review, first the entry of the SRQ column in the Teams table is checked to see if supplementary review questionnaire was added. If the field is not empty, the supplementary review questionnaire is appended to the existing review questionnaire created by the instructor. Otherwise the reviewer only sees the default review questionnaire.

• When responses of questionnaire need to be displayed
  • When the responses of the reviewer is recorded, the student can click on "View Scores" tab for a particular assignment which contains the responses of the reviewer. This view should contain the responses for both the default review questions as well the supplementary review questions added by the student. So if the entry of the SRQ column in the Teams table is not empty the responses of the supplementary review questions is appended to the responses of the default review questions.

NOTE: The responses of the Supplementary Review Questions will not be added to the review scores of the project. It will just be shown to the team that has asked these questions so that they can see what suggestions does the reviewer has for the questions.

Changes in the User Interface

The following changes need to be made to the User Interface.

• Assignment Page
  • An assignment will have a checkbox that the instructor can ‘check’ to enable a student to add supplementary review rubric. Once ‘checked’ a button or link will appear in the student's "Your Work" section. This link will redirect the student to the same page that an instructor lands on when creating a new rubric, which will allow the student to create a review rubric just like an instructor does.

• A link called "Supplemantary Review Questionnaire" will appear in the student's "Your Work" section when the Instructor has allowed students to create supplementary review questions. So when a student clicks the link he/she can add the desired questions.

• The page where student will be directed to when he/she clicks the Supplementary Review Questionnaire link.

• The page which allows students to add different types of questions to the Supplementary Review Questionnaire.

• Review Page
  • When a reviewer fills out a rubric, the ResponseController will display a set of rubrics, in order, on the same page. This set would normally consist of just a review rubric, which is a Response object. However, the set would now have a review rubric and a supplementary review rubric (two items in the set instead of one) if the Supplementary Review rubric has been added. Thus, now the reviewer will be able to see the Supplementary Review questions along with the existing review questions.

• Review Results Page
  • The “View” function for a rubric will display answers submitted for the SupplementaryReviewQuestionnaire as well as the ReviewQuestionnaire. We will add another column to the “View scores” page (for both instructor and students) so that the responses of the Supplementary Review Questions are also shown to student.

NOTE:The student-generated questions (Supplementary Review Questions) will not be graded to avoid encouraging students to ask “easy” questions so that their reviewers would give them a high scores.

Test Plan

Firstly, we need to add tests for the following:

1. To check the link for "Supplementary Review Questionnaire" appears in the "Your Work" section of a student.

2. To check if the link for "Supplementary Review Questionnaire" redirects to page which allows to create questionnaire.

3. To check if after creation of the supplementary questionnaire, the supplementary questionnaire column of the Teams table has a correct value (i.e not NIL).

4. To check if the reviewers can see the supplementary questions that were added by the team as part of the review questions.

5. To check if the responses of the Supplementary Review Questions have been added to the responses of the existing review questions.

NOTE: More tests may be added as we proceed through the design. The above given list is temporary.

File that will be added/modified

As of now, we have figured out that the following files need to be added/modified:

1. app/models/supplementary_review_questionnaire.rb

We need to create a subclass "SupplementaryQuestionnaire".

2. db/migrate/Add_Supplementary_Questionnaire_to_Teams.rb

We need to add a migration which will add the Supplementary Questionnaire column to the "Teams" table.

3. config/routes.rb

For correct switching between the various views

4. app/controllers/student_review_controller.rb, app/controllers/review_mapping_controller.rb, app/controllers/response_controller.rb

Files that need modification for adding Supplementary questions to the existing rubrics.

5. spec/models/assignment_spec.rb

Add additional test case to test the new functionality.

6. spec/controllers/response_controller_spec.rb

Add additional test case to test the new functionality.

7. app/views/assignments/edit/_general.html.erb

Add a checkbox called "Allow students to create supplementary review questionnaire" .

8. app/views/submitted_content/_main.html.erb

Allow a link "Supplementary Review Questionnaire" to appear in the student's "Your Work" section.

NOTE : There will be additional files that need modification and some new files may also need to be added. The above given list is temporary.

References

• Expertiza on Github: https://github.com/expertiza/expertiza
• Expertiza Documentation: http://wiki.expertiza.ncsu.edu/index.php/Expertiza_documentation
• Expertiza YouTube channel: https://www.youtube.com/channel/UCdKXzox7hrWjfOMML6FzTWg/videos