CSC/ECE 517 Spring 2016/Functional tests for assignment creation function
Functional tests for assignment creation function
This page outlines the use tests for assignment creation using the Expertiza system
Structural Overview
Assignment creation in Expertiza provides a large number of options for users. Features come at the cost of complexity; this project is focused on creating testing methods to ensure that user interaction with the assignment interface remains stable and reliable.
Assignment creation is available from the Manage -> Assignments drop down on the expertiza site. Once an assignment is created it has 5 tabs for form entry. The remainder of this document will cover testing for each tab in more detail, the tabs are:
- General
- Topics
- Rubrics
- Review Strategy
Check the panxing01/expertiza repository for the current development files. Currently all tests are run in two files:
- https://github.com/panxing01/expertiza/blob/master/spec/features/assignment_create_spec.rb
- https://github.com/panxing01/expertiza/blob/master/spec/features/assignment_interface_spec.rb
Class Hierarchy
The Assignment class has many questionnaires throught the AssignmentQuestionnairs class. The Questionnaire class inherits from ActiveRecord::Base and has 8 fields plus primary key and date entries. The fields are:
- name: The name of the questionnaire row
- instructor_id: The instuctor key linked to the row
- private: True if private questionnaire
- min_question_score
- max_question_score
- type: field showing subclass
- display_type
- instruction_loc: stores URL for questionnaire instruction
The Questionnaire class has 11 sub-classes. They are:
- Rubric
- CourseEvaluationQuestionnaire
- SurveyQuestionnaire
- BookmarkRatingQuestionnaire
- AuthorFeedbackQuestionnaire
- QuizQuestionnaire
- GlobalSurveyQuestionnaire
- Metasurvey
- ReviewQuestionnaire
- MetareviewQuestionnaire
- TeammateReviewQuestionnaire
Setup
To set up functionality testing of assignment creation feature we did the following steps:
General
In this section, the functional test includes assignment name, course, submission directory, description URL, "Has team?", "Has quiz?" and "Calibrated peer-review for training".
- assignment name
it "can set assginment name" do
login_as("instructor6")
visit '/assignments/new?private=0'
expect(page).to have_content "Assignment name"
fill_in "Assignment name:", with: 'assignment for test'
click_button "Create"
expect(Assignment.where(name: "assignment for test")).to exist
end
- course
it "can select course" do
login_as("instructor6")
visit '/assignments/new?private=0'
select('5', :from => 'assignment_form_assignment_course_id')
click_button "Create"
end
- submission directory
it "can set assginment Submission directory" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in "Assignment name:", with: 'assignment for test 2'
expect(page).to have_content "Submission directory"
fill_in "Submission directory:", with: 'Submission directory for test'
click_button "Create"
expect(Assignment.find(2).directory_path).to eq 'Submission directory for test'
end
- description URL
it "can set assginment Description URL" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in "Assignment name:", with: 'assignment for test 3'
expect(page).to have_content "Description URL"
fill_in "Description URL:", with: 'Description URL for test'
click_button "Create"
expect(Assignment.find(2).spec_location).to eq 'Description URL for test'
end
- "Has team?"
it "can Has teams and set team number" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in "Assignment name:", with: 'assignment for test 5'
find('#team_assignment').set(true)
expect(page).to have_content "Maximum number of members per team"
expect(page).to have_content "Show teammate reviews"
fill_in 'assignment_form_assignment_max_team_size', with: 4
find('#assignment_form_assignment_show_teammate_reviews').set(true)
click_button "Create"
expect(Assignment.find(2).show_teammate_reviews).to eq true
end
- "Has quiz?"
it "can save the number of quiz questions" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in "Assignment name:", with: '11'
select('5', :from => 'assignment_form_assignment_course_id')
find('#assignment_form_assignment_require_quiz').set(true)
click_button "Create"
visit '/assignments/2/edit'
expect(page).to have_content "Number of Quiz questions"
end
- "Calibrated peer-review for training"
it "can set Calibrated peer-view for training" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in "Assignment name:", with: 'assignment for test 4'
find('#assignment_form_assignment_is_calibrated').set(true)
click_button "Create"
expect(Assignment.find(2).is_calibrated).to eq true
end
Topics
In this section, functionality of "Edit topics" is thoroughly tested. Below are some of the code snippets of this testing module:
- Edit topics content
it "is able to see edit topics content correctly" do
login_as("instructor6")
visit 'assignments/1/edit#tab-2'
expect(page).to have_content("Allow topic suggestions from students?")
expect(page).to have_content("Enable bidding for topics?")
expect(page).to have_content("Enable authors to review others working on same topic?")
expect(page).to have_content("Allow reviewer to choose which topic to review?")
expect(page).to have_content("Allow participants to create bookmarks? ")
expect(page).to have_content("Hide all teams")
expect(page).to have_content("New topic")
expect(page).to have_content("Import Topics")
expect(page).to have_content("Back")
expect(page).to have_content("Save")
end
- Show/hide teams
it "is able to show/hide teams" do
login_as("instructor6")
visit 'assignments/1/edit#tab-2'
click_link('Hide all teams')
expect(page).to have_content("Show all teams")
click_link("Show all teams")
expect(page).to have_content("Hide all teams")
end
Rubrics
Rubrics are arranged into 3 rows of data named "Review", "Author Feedback", and "Teammate Review". Each row is handled under separate descriptions in order to allow quick and comprehensive testing for the seperate functions. Each row updates using a subclass of the Questionnaire class for dropdown values. Classes used are the ReviewQuestionnaire, AuthorFeedbackQuestionnaire, and the TeammateReviewQuestionnaire respectively.
Testing required creation of the three questionnaire subclasses in order to populate the dropdowns. Basic code layout for testing each value change:
describe "Edit [subclass] rubric" do
it "should update [component]", js: true do
login_as("instructor6")
visit '/assignments/1/edit'
find_link('Rubrics').click
within("[table row identifier]") do
select "[subclass instance name value]", :from => '[form identifier]'
end
click_button 'Save'
expect([questionnaireinstance]).to have_attributes([attrib updated] => [new value])
end
Review Strategy
In this module we have tested the functionality of the "Teammate Review" module. Some of the tests are given below:
- Teammate Review
it "should update questionnaire", js: true do
login_as("instructor6")
visit '/assignments/1/edit'
find_link('Rubrics').click
within("tr#questionnaire_table_TeammateReviewQuestionnaire") do
select "TeammateReviewQuestionnaire2", :from => 'assignment_form[assignment_questionnaire][][questionnaire_id]'
end
click_button 'Save'
expect(get_questionnaire("TeammateReviewQuestionnaire2")).to exist
end
- Notification limit
it "should update notification limit", js: true do
login_as("instructor6")
visit '/assignments/1/edit'
find_link('Rubrics').click
within("tr#questionnaire_table_TeammateReviewQuestionnaire") do
select "TeammateReviewQuestionnaire2", :from => 'assignment_form[assignment_questionnaire][][questionnaire_id]'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', :with => '50'
end
click_button 'Save'
expect(get_questionnaire("TeammateReviewQuestionnaire2").first).to have_attributes(:notification_limit => 50)
end
Running the tests
The tests can be run on the terminal using the command:
rspec path/to/spec/file.rb
We can check if the functionality of the system is implemented properly seeing if the corresponding tests pass or fail.