Expertiza_Wiki - User contributions [en]

CSC/ECE 517 Fall 2016 E1707: Top trading cycles to exclude previous teammates

2016-12-03T15:44:38Z

Vmuruga: Added testing plan for the top trading cycles functionality

== Introduction ==
Expertiza is an open source web platform that enables students and instructors indulge in an enhanced and accelerated peer based learning milieu. It is aided by facilities like submissions of project work and reviews according to instructor approved deadlines, teaming up with other peers for various projects, reviewing other teams' and teammates' work and personalization of a project submission according to the best suited requirements. All these factors make Expertiza a valuable asset for an instructor to guide his students through the course with much more effectual results.

Expertiza source code is built using Ruby on Rails and is available on github with public access enabled repository.

== Problem Description ==
Currently, before the start of an assignment, students can be asked to form teams on their own or teams can be assigned by the instructor. As the main motive is guide students via peer based learning, thus more number of peers the student works with, better learning. So, to enable students find different people for the assignments rather than just team up with same people for every assignment in the current course, students can ask for a team to be randomly allocated by not choosing the team members before hand. After the bidding for the project topics is over, the student is allocated a team. Here, in this case it may be possible that the student is allocated a team member they have previously worked with before. Hence, to enable student circumvent this situation in case he/she prefers different people for the particular, we need to provide an option for the students to choose if they prefer different team members for the assignment before the bidding for the project topics happens.

== Project Outline ==
The main objective is to give students an option to choose whether or not they want to team up with their previous team members for a particular assignment in the current course.

If they choose the option, then when a student is added to the team, a check is performed if he/she has worked with the student before. If such is the case, then the student is swapped with some other student who hasn't worked with the same person before.

Another point to note is that if the student chooses some person to be on the team who he/she has worked with before, choosing this option would still allow the person to remain in the team.

== Approach ==
To implement top trading cycle algorithm, we would be utilizing the web service that is hosted at http://peerlogic.csc.ncsu.edu/intelligent_assignment/swap_team_members. The students, and student history would be provided to the web service and the response from the web service would be utilized to update the teams. The web service is expected to respond back with new team after swapping the team members that have teamed up before.
As part of the changes, a new flag would be introduced in the teams model. The teams do not want to be changed (swapped) would have to unset the flag. If the flag is unset, the teams would not be send to the web service for the swap operation.
Only the instructor would see the option of utilizing this feature from the view. The feature would not be present for the students.
As part of the changes a new method would be added in the lottery controller to implement this functionality. The new method would have the responsibility to utilize the webserver and update the teams according to the web service.
A new button would be added in the instructor view for the assignments for invoking this new method.
A new checkbox would be added in the students view for selecting/un-selecting the option of swap.

=== High Level Design ===

==== Populating Data For the Web Service ====
[[File:GetDataForSwap.png]]

==== Flow Diagram once the data is populated ====
[[File:SendDataToWebService.png]]

=== Detailed Workflow ===

• The first step is to include a checkbox to provide student with an option to select if he/she want to be assigned new people who were not previously team up with the student.

• An additional flag has to be introduced in the teams table that represents the value of the checkbox.

The following flow chart diagram describes this scenario at the front end:

[[File:OODD-FinalDesignDocFlow1.jpg]]

• After instructor initiates the team creation process, first check is to know whether the team members have already been chosen by the student. If yes, then the team is created as it is with the chosen members.

• If, the student doesn't have all/some team members already selected, a team is created for the student by calling the create teams method in the top trading cycle service.

• After a team is created, the flag is checked if the student wanted new team members for the assignment who were not team up before.

• Then for each team member selected to be on the team, it is checked if the he/she has been teamed up with before. If no, then we move on to the next member.

• If the team member has been teamed up with before, we call the swap method in the top trading cycle service and pass the student's team history.

• Using that information, he/she is swapped with some other team member who hasn't been on the team.

• This process repeats for each member, until we cover all the team members. At the end, we have our team ready.

The following flow chart diagram describes this scenario at the back end:

[[File:OODD-FinalDesignDocFlow2.jpg]]

== Files To Be Modified ==
*app/views/assignments/_reserve_topic.html.erb
*app/controllers/sign_up_sheet_controller.rb
*app/views/sign_up_sheet/list.html.erb
*app/controllers/lottery_controller.rb

== Testing Plan ==
1. "To check if team creation will create teams with students having put up with the teammates previously teamed up with"
:*Set max number of students per team to 3.
:*Manually make change in DB to make 3 students previously team up with 3 other students.
:*Have 6 students bid for a topic.
:*Call the team creation method
:*Check if any student is paired with a student they had already teamed up with. If no, then this test is a success.

2. "To check if the new team creation algorithm does not allocate more than the max number of people per team"
:*Set max number of students per team to 2.
:*Have 6 students bid for a topic.
:*Call the team creation method.
:*Check if any team has more than 2 students.

3. "To check if students who have chosen their own team members are not swapped even though they might have worked together before"
:*Make 2 students teammates. For convenience, let the students be 'A' and 'B'.
:*Set max number of students per team to 3.
:*Have a total of 6 students choose topics.
:*Check that in the team containing the 'A', 'B' is also present.

4. "To check if the new_members flag is not set, then the team members should be the same for that particular assignment"
:*Make four students, A,B,C and D.
:*Two teams where created, team A containing A and B, and team B containing C and D for an assignment with maximum team size 2.
:*Each team had unset the new_members option.
:*After running the method run_intelligent_assignment, the teams where checked to see if they are still the same.

5. "To verify if the student team history is returned correct: The teamed_students method is invoked there are no previous teammates"
:*Verify that the returned hash is empty

6. "To verify if the student team history is returned correct: The teamed_students method is invoked when the student has team mates."
:*The teamed_students method is invoked with name_required set to true.
:*Verify that the names of the previous teammates are returned.

7. "To verify if the student team history is returned correct: The teamed_students method is invoked when the student has team mates."
:*The teamed_students method is invoked with name_required set to false.
:*Verify that the user ids of the previous teammates are returned.

8. "To verify if the student team history is returned correct: The teamed_students method is invoked when the student has team mates."
:*The teamed_students method is invoked with exclude_assignment_id set to the current assignment id.
:*Verify that the user ids of team mates in the current assignment ids are not returned.

9. "To verify if the student team history is returned correct: The teamed_students method is invoked when the student has team mates."
:*The teamed_students method is invoked with include_assignment_id set to the current assignment id.
:*Verify that the user ids of team mates in the current assignment ids are only returned.

10. "To verify if the top trading cycles is working correctly"
:*An assignment is created which implements the intelligent bidding.
:*4 students are created, of which 2 have an history of an assignment with the other 2(these are mutually exclusive)
:*The students are added to the assignment.
:*The students set the preference to be paired with new teammates.
:*The students prioritize topics. This is the bidding process.
:*The intelligent assignment is run for this particular assignment.
:*We expect that the student who have history together not be paired again, even if they have the same priority for the topics.

CSC/ECE 517 Fall 2016 E1707: Top trading cycles to exclude previous teammates

2016-11-15T07:08:26Z

Vmuruga: Adding a few test cases

CSC/ECE 517 Fall 2016 E1707: Top trading cycles to exclude previous teammates

2016-11-10T15:50:31Z

Vmuruga: Formatting - removed extra bullet

CSC/ECE 517 Fall 2016 E1707: Top trading cycles to exclude previous teammates

2016-11-10T15:50:02Z

Vmuruga: Adding a test case

CSC/ECE 517 Fall 2016 E1707: Top trading cycles to exclude previous teammates

2016-11-09T20:01:34Z

Vmuruga: Added a section

CSC/ECE 517 Fall 2016

2016-11-09T18:40:18Z

Vmuruga: Adding link for final project document

[http://www.example.com link title]==Calibration Assignment Submissions==
*[[Calibration Assignment Submission (Firebrick JS)]]
*[[Calibration Assignment Submission (Active Job)]]
==Writing Assignments 2==
*[[CSC/ECE 517 Fall 2016/E1666. Test team functionality]]
*[[CSC/ECE 517 Fall 2016/E1643. Refactor Suggestion controller]]
*[[CSC/ECE 517 Fall 2016/E1631. Refactoring Bidding Interface]]
*[[CSC/ECE 517 Fall 2016/E1674.Refactor leaderboard.rb and write unit tests]]
*[[CSC/ECE 517 Fall 2016/E1671. Unit Tests for participants.rb Hierarchy]]
*[[CSC/ECE 517 Fall 2016/E1668.Test e-mailing functionality]]
*[[CSC/ECE 517 Fall 2016/E1658. Refractor lottery_controller.rb and write integration tests]]
*[[CSC/ECE 517 Fall 2016/E1660. Review requirements and thresholds]]
*[[CSC/ECE 517 Fall 2016/E1650. Sort instructor views alphabetically by default]]
*[[CSC/ECE 517 Fall 2016/E1644. Refactor and test Teams Controller]]
*[[CSC/ECE 517 Fall 2016/E1645. Refactoring Tree Display Controller]]
*[[CSC/ECE 517 Fall 2016/E1659. Refactor on_the_fly_calc.rb]]
*[[CSC/ECE 517 Fall 2016/E1657. Introduce a Student View for instructors]]
*[[CSC/ECE 517 Fall 2016/E1653. Fix and improve rubric criteria]]
*[[CSC/ECE 517 Fall 2016/E1642. Refactor review_response_map.rb]]
*[[CSC/ECE 517 Fall 2016/E1633. Refactor different question types from quiz feature]]
*[[CSC/ECE_517_Fall_2016/E1664:_Feature_Test_Assignment_Creation]]
*[[CSC/ECE 517 Fall 2016/E1666. Test team functionality]]
*[[CSC/ECE_517_Fall_2016/E1654. Improve_date-picker_and_deadlines]]
*[[CSC/ECE_517_Fall_2016/E1652 Fix teammate advertisements and requests to join a team ]]
*[[CSC/ECE_517_Fall_2016/E1662. UI issues/fixes]]
*[[CSC/ECE_517_Fall_2016/E1673. Refactor question_type.rb]]
*[[CSC/ECE_517_Fall_2016/E1675. Timestamp for student file & hyperlink submissions]]
*[[CSC/ECE_517_Fall_2016/E1640. Refactor response.rb and response_helper.rb]]
*[[CSC/ECE 517 Fall 2016/E1634. Refactor and write unit test of due_date.rb and deadline_helper.rb]]
*[[CSC/ECE_517_Fall_2016/M1654._Improve_network_security_features]]
*[[CSC/ECE_517_Fall_2016/E1670._Unit_tests_for_answers.rb]]
*[[CSC/ECE_517_Fall_2016/E1641. Refactor review_mapping_controller.rb]]
*[[CSC/ECE_517_Fall_2016/M1652_Implement_ImageMap_Support_Servo]]
*[[CSC/ECE_517_Fall_2016/E1648/Add_past_due_assignment]]
*[[CSC/ECE 517 Fall 2016/E1656. Improve imports]]
*[[CSC/ECE_517_Fall_2016/M1653_Implement_HTML_form_validation]]
==Final Project Design Document==
*[[CSC/ECE 517 Fall 2016 E1696 Improve Self-Review]]
*[[CSC/ECE 517 Fall 2016 E1676 Role-based reviewing]]
*[[CSC/ECE 517 Fall 2016/E1680. Improve survey functionality]]
*[[CSC/ECE 517 Fall 2016/E1693. Drag-and-drop interface for creating rubrics]]
*[[CSC/ECE 517 Fall 2016/E1701. Accelerate RSpec testing]]
*[[CSC/ECE 517 Fall 2016/E1705. Tracking the time students look at the others' submissions]]
*[[CSC/ECE 517 Fall 2016/E1688. Send feedback to support + tree display improvement]]
*[[CSC/ECE 517 Fall 2016 E1707: Top trading cycles to exclude previous teammates]]

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T01:46:35Z

Vmuruga: /* Fixes in existing broken Test Cases */

=='''Background'''==
Expertiza is an open source web-based platform for the organizing and management of student project submissions and their evaluation, that supports augmentation of subject knowledge and accelerated learning via peer reviews. The application is meant for two types of users, instructors and students to use the application. Instructor can create and manage a course, enroll students in the course, create, manage and personalize assignments, project submissions and reviews for the particular course. Students can make their project submissions for the assignments allocated to them by their instructors for a course, give peer reviews, teammate reviews, create quizzes for their project reviewers, provide feedbacks and view their grades.

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

===Files Modified===
* assignment_creation_spec.rb (Capybara spec file)
* factories.rb (FactoryGirl's factory file

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===Fixes in existing broken Test Cases===

Due to continual development of Expertiza, some of the existing test cases that were implemented with relatively older version of Expertiza were found broken at the starting of the project.
To make the assignment creation testing complete, and to avoid covering the same scenarios again by adding new working test cases unnecessarily, these test case were fixed. Some of the fixes that were provided as part of this project are as follows:

1. Some of the functionalities for which the test cases were written have been remodeled so they had to be skipped.

2. Running the test cases were giving an error in the code, when fetching a row from the deadline type table.
* We noticed that the structure of the test file was wrong. The code to populate the the "deadline types" did not run, but were supposed to run for each test case. We made this code run for all test cases.

3. Rubrics test cases were searching for links that weren't present on the page. These issues were also fixed.

===Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment'': This test will check if public assignments are getting created properly or not with proper attributes.

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment:'' This test will check if private assignments are getting created or not with proper attributes.
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team '': This test will check the creation of new private assignment for the team. The maximum size of the team is 3 and the test will check if all these features are there or not.
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz:'' This test will check the creation of new private assignment with the quiz. The maximum number of questions in the quiz is 3 and the test will check if all these features are present or not.
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with staggered deadline :''
it "is able to create with staggered deadline" do
skip('skip test on staggered deadline temporarily')
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
begin
check("assignment_form_assignment_staggered_deadline")
rescue
return
end
page.driver.browser.switch_to.alert.accept
click_button 'Create'
fill_in 'assignment_form_assignment_days_between_submissions', with: 7
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
pending(%(not sure what's broken here but the error is: #ActionController::RoutingError: No route matches [GET]
"/asset/staggered_deadline_assignment_grap/graph_1.jpg"))
expect(assignment).to have_attributes(
staggered_deadline: true
)
end

''f. Create Assignment with review visible to all reviewers:'' This test will check the creation of new private assignment with review visible to all the reviewers.
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''g. Create public micro-task assignment:'' This test will check creation of new public assignment with microtasks.
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''h. create calibrated public assignment: '' This test will check creation of new calibrated public assignment.
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students: '' This test will edit the existing assignment and enable micro tasks and calibrated options. The test will verify if all these options are updated in the assignment.
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students: '' This test will check the feature of editing the number of quizzes in the existing assignment.
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment''
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers'''
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics''
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic ''
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic ''
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. set the deadline for an assignment review''
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment ''
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants''
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course'''

it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==

=='''References'''==
1. Github Expertiza[https://github.com/expertiza/expertiza]

2. RSpec [http://rspec.info/]

3. Capybara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T01:44:34Z

Vmuruga:

=='''Background'''==
Expertiza is an open source web-based platform for the organizing and management of student project submissions and their evaluation, that supports augmentation of subject knowledge and accelerated learning via peer reviews. The application is meant for two types of users, instructors and students to use the application. Instructor can create and manage a course, enroll students in the course, create, manage and personalize assignments, project submissions and reviews for the particular course. Students can make their project submissions for the assignments allocated to them by their instructors for a course, give peer reviews, teammate reviews, create quizzes for their project reviewers, provide feedbacks and view their grades.

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

===Files Modified===
* assignment_creation_spec.rb (Capybara spec file)
* factories.rb (FactoryGirl's factory file

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===Fixes in existing broken Test Cases===

Due to continual development of Expertiza, some of the existing test cases that were implemented with relatively older version of Expertiza were found broken at the starting of the project.
To make the assignment creation testing complete, and to avoid covering the same scenarios again by adding new working test cases unnecessarily, these test case were fixed. Some of the fixes that were provided as part of this project are as follows:

1. Some of the functionalities for which the test cases were written have been remodeled so they had to be skipped.

2. Running the test cases were giving an error in the code, when fetching a row from the deadline type table.
* We noticed that the structure of the test file was wrong. The code to populate the the "deadline types" did not run, but were supposed to run for each test case. We made this code run for all test cases.

===Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment'': This test will check if public assignments are getting created properly or not with proper attributes.

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment:'' This test will check if private assignments are getting created or not with proper attributes.
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team '': This test will check the creation of new private assignment for the team. The maximum size of the team is 3 and the test will check if all these features are there or not.
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz:'' This test will check the creation of new private assignment with the quiz. The maximum number of questions in the quiz is 3 and the test will check if all these features are present or not.
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with staggered deadline :''
it "is able to create with staggered deadline" do
skip('skip test on staggered deadline temporarily')
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
begin
check("assignment_form_assignment_staggered_deadline")
rescue
return
end
page.driver.browser.switch_to.alert.accept
click_button 'Create'
fill_in 'assignment_form_assignment_days_between_submissions', with: 7
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
pending(%(not sure what's broken here but the error is: #ActionController::RoutingError: No route matches [GET]
"/asset/staggered_deadline_assignment_grap/graph_1.jpg"))
expect(assignment).to have_attributes(
staggered_deadline: true
)
end

''f. Create Assignment with review visible to all reviewers:'' This test will check the creation of new private assignment with review visible to all the reviewers.
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''g. Create public micro-task assignment:'' This test will check creation of new public assignment with microtasks.
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''h. create calibrated public assignment: '' This test will check creation of new calibrated public assignment.
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students: '' This test will edit the existing assignment and enable micro tasks and calibrated options. The test will verify if all these options are updated in the assignment.
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students: '' This test will check the feature of editing the number of quizzes in the existing assignment.
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment''
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers'''
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics''
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic ''
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic ''
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. set the deadline for an assignment review''
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment ''
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants''
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course'''

it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==

=='''References'''==
1. Github Expertiza[https://github.com/expertiza/expertiza]

2. RSpec [http://rspec.info/]

3. Capybara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T01:43:54Z

Vmuruga: Added Files modified

=='''Background'''==
Expertiza is an open source web-based platform for the organizing and management of student project submissions and their evaluation, that supports augmentation of subject knowledge and accelerated learning via peer reviews. The application is meant for two types of users, instructors and students to use the application. Instructor can create and manage a course, enroll students in the course, create, manage and personalize assignments, project submissions and reviews for the particular course. Students can make their project submissions for the assignments allocated to them by their instructors for a course, give peer reviews, teammate reviews, create quizzes for their project reviewers, provide feedbacks and view their grades.

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

===Files Modified===
* assignment_creation_spec.rb (Capybara spec file)
* factories.rb (FactoryGirl's factory file)

=='''Test Cases'''==

===Fixes in existing broken Test Cases===

Due to continual development of Expertiza, some of the existing test cases that were implemented with relatively older version of Expertiza were found broken at the starting of the project.
To make the assignment creation testing complete, and to avoid covering the same scenarios again by adding new working test cases unnecessarily, these test case were fixed. Some of the fixes that were provided as part of this project are as follows:

1. Some of the functionalities for which the test cases were written have been remodeled so they had to be skipped.

2. Running the test cases were giving an error in the code, when fetching a row from the deadline type table.
* We noticed that the structure of the test file was wrong. The code to populate the the "deadline types" did not run, but were supposed to run for each test case. We made this code run for all test cases.

===Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment'': This test will check if public assignments are getting created properly or not with proper attributes.

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment:'' This test will check if private assignments are getting created or not with proper attributes.
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team '': This test will check the creation of new private assignment for the team. The maximum size of the team is 3 and the test will check if all these features are there or not.
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz:'' This test will check the creation of new private assignment with the quiz. The maximum number of questions in the quiz is 3 and the test will check if all these features are present or not.
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with staggered deadline :''
it "is able to create with staggered deadline" do
skip('skip test on staggered deadline temporarily')
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
begin
check("assignment_form_assignment_staggered_deadline")
rescue
return
end
page.driver.browser.switch_to.alert.accept
click_button 'Create'
fill_in 'assignment_form_assignment_days_between_submissions', with: 7
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
pending(%(not sure what's broken here but the error is: #ActionController::RoutingError: No route matches [GET]
"/asset/staggered_deadline_assignment_grap/graph_1.jpg"))
expect(assignment).to have_attributes(
staggered_deadline: true
)
end

''f. Create Assignment with review visible to all reviewers:'' This test will check the creation of new private assignment with review visible to all the reviewers.
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''g. Create public micro-task assignment:'' This test will check creation of new public assignment with microtasks.
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''h. create calibrated public assignment: '' This test will check creation of new calibrated public assignment.
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students: '' This test will edit the existing assignment and enable micro tasks and calibrated options. The test will verify if all these options are updated in the assignment.
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students: '' This test will check the feature of editing the number of quizzes in the existing assignment.
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment''
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers'''
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics''
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic ''
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic ''
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. set the deadline for an assignment review''
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment ''
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants''
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course'''

it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==

=='''References'''==
1. Github Expertiza[https://github.com/expertiza/expertiza]

2. RSpec [http://rspec.info/]

3. Capybara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T01:32:46Z

Vmuruga: /* Fixes in existing broken Test Cases */

=='''Background'''==
Expertiza is an open source web-based platform for the organizing and management of student project submissions and their evaluation, that supports augmentation of subject knowledge and accelerated learning via peer reviews. The application is meant for two types of users, instructors and students to use the application. Instructor can create and manage a course, enroll students in the course, create, manage and personalize assignments, project submissions and reviews for the particular course. Students can make their project submissions for the assignments allocated to them by their instructors for a course, give peer reviews, teammate reviews, create quizzes for their project reviewers, provide feedbacks and view their grades.

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===Fixes in existing broken Test Cases===

Due to continual development of Expertiza, some of the existing test cases that were implemented with relatively older version of Expertiza were found broken at the starting of the project.
To make the assignment creation testing complete, and to avoid covering the same scenarios again by adding new working test cases unnecessarily, these test case were fixed. Some of the fixes that were provided as part of this project are as follows:

1. Some of the functionalities for which the test cases were written have been remodeled so they had to be skipped.

2. Running the test cases were giving an error in the code, when fetching a row from the deadline type table.
* We noticed that the structure of the test file was wrong. The code to populate the the "deadline types" did not run, but were supposed to run for each test case. We made this code run for all test cases.

===Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment''

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment''
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team ''
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz''
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with staggered deadline ''
it "is able to create with staggered deadline" do
skip('skip test on staggered deadline temporarily')
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
begin
check("assignment_form_assignment_staggered_deadline")
rescue
return
end
page.driver.browser.switch_to.alert.accept
click_button 'Create'
fill_in 'assignment_form_assignment_days_between_submissions', with: 7
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
pending(%(not sure what's broken here but the error is: #ActionController::RoutingError: No route matches [GET]
"/asset/staggered_deadline_assignment_grap/graph_1.jpg"))
expect(assignment).to have_attributes(
staggered_deadline: true
)
end

''f. Create Assignment with review visible to all reviewers''
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''g. Create public micro-task assignment''
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''h. create calibrated public assignment ''
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students''
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students''
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment''
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers'''
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics''
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic ''
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic ''
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. set the deadline for an assignment review''
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment ''
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants''
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course'''

it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==

=='''References'''==
1. Github Expertiza[https://github.com/expertiza/expertiza]

2. RSpec [http://rspec.info/]

3. Capybara [https://github.com/jnicklas/capybara]