CSC/ECE 517 Fall 2019 - E1981. Student-generated questions added to rubric

Introduction

The rubrics in expertiza are created by instructors. These Rubrics only contain questions that are related to the existed topics. Now, Expertiza only supports students to pull questionnaires is specific rubrics to get some help. Even that they can ask about anything that is relevant to all the projects that will be submitted But when students encounter difficult problems which are not in the existed topics, and they want to get special advice on that new field, the demand for creating supplementary review questionnaire raises. This project (E1981) aims to solve this problem by allowing students to add questions to the standard instructor generated rubric so that they can get specific feedback on from the reviewers.

Proposed solution

We will add the Supplementary Review Questions to the current Review Questions, and show these student-generated questions under the rubric given by instructor. Even though these questions won't be graded, they will eventually provide diversity for feedback. It will increase the benefit that each team gets because they can get feedback that is specific to their project.

Implementation

Design Strategy

Goal: In Expertiza, all kinds of rubrics and surveys are subclasses of Questionnaire. A Questionnaire can contain “questions” of several types (e.g., checkboxes, dropdowns, text boxes). We'll add a new subclass of Questionnaire called, say, SupplementalReviewQuestionnaire.

1. there should be a checkbox when creating the whole questionnaire to indicate whether this questionnaire will have supplemental review questions or not.

2. there should be a button that has the content "add supplemental questions".

 a. if you click that button, it will redirect to a page that an instructor uses to create a supplemental questionnaire.

 b. when the supplemental questionnaire is created, it should append to the existed questionnaire.

3. After the reviewer finished the review, student can find the supplemental questionnaire in the review page.

How we will do this:

1. add a variable in the questionnaire class.

2. add another file for a supplemental questionnaire and save them to the database.

3. add a method to get the corresponding supplemental questionnaire and to add questions into the existed questionnaire.

4. we should add another method to show the supplemental questionnaire in the review page.

Modifications in the User Interface (Todo)

1. Assignment Creation Page in Instructor's Account

We plan to implement a check box under the column of Rubrics in the assignment creation page indicating whether the instructor allows students to add specific questionnaires with respect to their projects.

2. Your Work Page in A Student's Account

We plan to implement a link or button on the Your Work page of an assignment of a student whose assignment is enabled to create supplementary review questionnaires by the instructor, in order to redirect to the Review Rubrics Creation page.

3. Review Rubrics Creation Page

In this page, students are able to create supplementary review questions regarding the specifics of their own assignments.

4. Review Page

In the Review Page of reviewers, the supplementary review questions created by the owner of the assignment will be shown to reviewers along with the standard review questions created by the instructor.

5. Review Results Page

The Review Results Page should display the results of standard questions created by the instructor as well as the results of supplementary review questions created by the instructor.

Use Cases

Test Plan

RSpec Test

Firstly, we need to add tests to check the following basic functionalities of Supplementary Review Questionnaire:

• There should be no link for "Supplementary Review Questionnaire" for team members or reviewerss, if the instructor disables this section in Assignment Creation Page.

• If the instructor enables this section, the link for "Supplementary Review Questionnaire" should appear in the "Your Work" section of a student, and redirect to Review Rubrics Creation Page.

• After created or edited, the supplementary review questions should appear as part of the whole review question sheet in Review Page (along with the standard review questions created by the instructor), to team members, reviewers, and the instructor.

• After a reviewer saves or submits, the responses to the supplementary review questions should be stored and appear when (s)he views that review.

• After review deadline, all responses to the supplementary review questions of reviewers should appear in Review Results Page of a student.

Besides, we need to add more tests to check other relevant functionalities and possible edge-cases as following:

• After review deadline, a student should be able to mark labels on the responses to the supplementary review questions, and the labels should be successfully displayed.

• To be continued...

File which are added/modified

Note: Because the pull request contains some code irrelevant to this project which make it confusing, we post our code here for you to read clearly.

Team members

Hua Cao

Heng Yu

Chien-Yuan Wang

Benjamin Ding

Links

Expertiza on Github:https://github.com/zyczyh/expertiza

Pull Request:https://github.com/expertiza/expertiza/pull/1325

Expertiza YouTube channel:https://youtu.be/3PUNknSbU-k