Expertiza_Wiki - User contributions [en]

CSC/ECE 517 Fall 2016 E1707: Top trading cycles to exclude previous teammates

2016-11-10T13:57:36Z

Asingh26: /* Detailed Workflow */

== Introduction ==
Expertiza is an open source web platform that enables students and instructors indulge in an enhanced and accelerated peer based learning milieu. It is aided by facilities like submissions of project work and reviews according to instructor approved deadlines, teaming up with other peers for various projects, reviewing other teams' and teammates' work and personalization of a project submission according to the best suited requirements. All these factors make Expertiza a valuable asset for an instructor to guide his students through the course with much more effectual results.

Expertiza source code is built using Ruby on Rails and is available on github with public access enabled repository.

== Problem Description ==
Currently, before the start of an assignment, students can be asked to form teams on their own or teams can be assigned by the instructor. As the main motive is guide students via peer based learning, thus more number of peers the student works with, better learning. So, to enable students find different people for the assignments rather than just team up with same people for every assignment in the current course, students can ask for a team to be randomly allocated by not choosing the team members before hand. After the bidding for the project topics is over, the student is allocated a team. Here, in this case it may be possible that the student is allocated a team member they have previously worked with before. Hence, to enable student circumvent this situation in case he/she prefers different people for the particular, we need to provide an option for the students to choose if they prefer different team members for the assignment before the bidding for the project topics happens.

== Project Outline ==
The main objective is to give students an option to choose whether or not they want to team up with their previous team members for a particular assignment in the current course.

If they choose the option, then when a student is added to the team, a check is performed if he/she has worked with the student before. If such is the case, then the student is swapped with some other student who hasn't worked with the same person before.

Another point to note is that if the student chooses some person to be on the team who he/she has worked with before, choosing this option would still allow the person to remain in the team.

== Approach ==
To implement top trading cycle algorithm, we would be utilizing the web service that is hosted at http://peerlogic.csc.ncsu.edu/intelligent_assignment/swap_team_members. The students, and student history would be provided to the web service and the response from the web service would be utilized to update the teams. The web service is expected to respond back with new team after swapping the team members that have teamed up before.
As part of the changes, a new flag would be introduced in the teams model. The teams do not want to be changed (swapped) would have to unset the flag. If the flag is unset, the teams would not be send to the web service for the swap operation.
Only the instructor would see the option of utilizing this feature from the view. The feature would not be present for the students.
As part of the changes a new method would be added in the lottery controller to implement this functionality. The new method would have the responsibility to utilize the webserver and update the teams according to the web service.
A new button would be added in the instructor view for the assignments for invoking this new method.
A new checkbox would be added in the students view for selecting/un-selecting the option of swap.

=== High Level Design ===

==== Populating Data For the Web Service ====
[[File:GetDataForSwap.png]]

==== Flow Diagram once the data is populated ====
[[File:SendDataToWebService.png]]

=== Detailed Workflow ===

• The first step is to include a checkbox to provide student with an option to select if he/she want to be assigned new people who were not previously team up with the student.

• An additional flag has to be introduced in the teams table that represents the value of the checkbox.

The following flow chart diagram describes this scenario at the front end:

[[File:OODD-FinalDesignDocFlow1.jpg]]

• After instructor initiates the team creation process, first check is to know whether the team members have already been chosen by the student. If yes, then the team is created as it is with the chosen members.

• If, the student doesn't have all/some team members already selected, a team is created for the student by calling the create teams method in the top trading cycle service.

• After a team is created, the flag is checked if the student wanted new team members for the assignment who were not team up before.

• Then for each team member selected to be on the team, it is checked if the he/she has been teamed up with before. If no, then we move on to the next member.

• If the team member has been teamed up with before, we call the swap method in the top trading cycle service and pass the student's team history.

• Using that information, he/she is swapped with some other team member who hasn't been on the team.

• This process repeats for each member, until we cover all the team members. At the end, we have our team ready.

The following flow chart diagram describes this scenario at the back end:

[[File:OODD-FinalDesignDocFlow2.jpg]]

== Files To Be Modified ==
*app/views/assignments/_reserve_topic.html.erb
*app/controllers/sign_up_sheet_controller.rb
*app/views/sign_up_sheet/list.html.erb
*app/controllers/lottery_controller.rb

CSC/ECE 517 Fall 2016 E1707: Top trading cycles to exclude previous teammates

2016-11-10T13:56:42Z

Asingh26: /* High Level Design */

CSC/ECE 517 Fall 2016 E1707: Top trading cycles to exclude previous teammates

2016-11-10T13:54:24Z

Asingh26:

File:OODD-FinalDesignDocFlow2.jpg

2016-11-09T20:57:21Z

Asingh26: uploaded a new version of "File:OODD-FinalDesignDocFlow2.jpg": Resized

File:OODD-FinalDesignDocFlow2.jpg

2016-11-09T20:56:12Z

Asingh26:

CSC/ECE 517 Fall 2016 E1707: Top trading cycles to exclude previous teammates

2016-11-09T20:54:04Z

Asingh26: /* Front End */

CSC/ECE 517 Fall 2016 E1707: Top trading cycles to exclude previous teammates

2016-11-09T20:53:01Z

Asingh26:

File:OODD-FinalDesignDocFlow1.jpg

2016-11-09T20:51:52Z

Asingh26: uploaded a new version of "File:OODD-FinalDesignDocFlow1.jpg"

Changing file name

CSC/ECE 517 Fall 2016 E1707: Top trading cycles to exclude previous teammates

2016-11-09T20:49:04Z

Asingh26:

CSC/ECE 517 Fall 2016 E1707: Top trading cycles to exclude previous teammates

2016-11-09T20:48:22Z

Asingh26:

CSC/ECE 517 Fall 2016 E1707: Top trading cycles to exclude previous teammates

2016-11-09T20:46:51Z

Asingh26:

File:OODD-FinalDesignDocFlow1.jpg

2016-11-09T20:46:38Z

Asingh26: uploaded a new version of "File:OODD-FinalDesignDocFlow1.jpg"

Changing file name

File:OODD-FinalDesignDocFlow1.jpg

2016-11-09T20:44:05Z

Asingh26: Changing file name

Changing file name

File:OODD Final DesignDocFlow1.jpg

2016-11-09T20:40:19Z

Asingh26:

File:OODD Final DesignDocFlow2.png

2016-11-09T20:34:36Z

Asingh26:

File:OODD Final DesignDocFlow1.png

2016-11-09T20:34:08Z

Asingh26:

CSC/ECE 517 Fall 2016 E1707: Top trading cycles to exclude previous teammates

2016-11-09T18:37:57Z

Asingh26:

CSC/ECE 517 Fall 2016 E1707: Top trading cycles to exclude previous teammates

2016-11-09T17:29:31Z

Asingh26: Created page with "== Introduction == Expertiza is an open source web platform that enables students and instructors indulge in an enhanced and accelerated peer based learning milieu. It is aided b..."

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T01:57:16Z

Asingh26: /* Newly Added Test Cases */

=='''Background'''==
Expertiza is an open source web-based platform for the organizing and management of student project submissions and their evaluation, that supports augmentation of subject knowledge and accelerated learning via peer reviews. The application is meant for two types of users, instructors and students to use the application. Instructor can create and manage a course, enroll students in the course, create, manage and personalize assignments, project submissions and reviews for the particular course. Students can make their project submissions for the assignments allocated to them by their instructors for a course, give peer reviews, teammate reviews, create quizzes for their project reviewers, provide feedbacks and view their grades.

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

===Files Modified===
* assignment_creation_spec.rb (Capybara spec file)
* factories.rb (FactoryGirl's factory file

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===Fixes in existing broken Test Cases===

Due to continual development of Expertiza, some of the existing test cases that were implemented with relatively older version of Expertiza were found broken at the starting of the project.
To make the assignment creation testing complete, and to avoid covering the same scenarios again by adding new working test cases unnecessarily, these test case were fixed. Some of the fixes that were provided as part of this project are as follows:

1. Some of the functionalities for which the test cases were written have been remodeled so they had to be skipped.

2. Running the test cases were giving an error in the code, when fetching a row from the deadline type table.
* We noticed that the structure of the test file was wrong. The code to populate the the "deadline types" did not run, but were supposed to run for each test case. We made this code run for all test cases.

3. Rubrics test cases were searching for links that weren't present on the page. These issues were also fixed.

===Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment: ''This test will check if public assignments are getting created properly or not with proper attributes.

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment: ''This test will check if private assignments are getting created or not with proper attributes.
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team: '' This test will check the creation of new private assignment for the team. The maximum size of the team is 3 and the test will check if all these features are there or not.
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz: '' This test will check the creation of new private assignment with the quiz. The maximum number of questions in the quiz is 3 and the test will check if all these features are present or not.
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with review visible to all reviewers: '' This test will check the creation of new private assignment with review visible to all the reviewers.
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''f. Create public micro-task assignment: '' This test will check creation of new public assignment with microtasks.
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''g. Create calibrated public assignment: '' This test will check creation of new calibrated public assignment.
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students: '' This test will edit the existing assignment and enable micro tasks and calibrated options. The test will verify if all these options are updated in the assignment.
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students: '' This test will check the feature of editing the number of quizzes in the existing assignment.
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment: ''This test will check the feature of editing the maximum number of members in a team for an assignment.
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers: ''This test will verify the feature of adding/removing review visible to all the reviewers for an assignment.
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics: '' This test will verify that adding teams and team members in an assignment will create one more row of teammate review in rubrics.
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab: ''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. Edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. Edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic :'' This test will check feature of adding new topic for an assignment.
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic: ''This test will check feature of deleting new topic for an assignment.
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric: ''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. Loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. Set the deadline for an assignment review: '' This function will test if deadlines are getting assigned properly or not for the review.
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment: '' This test will verify if an instructor is able to assign new participants to an assignment.
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants: ''This test will verify if assignments are properly assigned to participants. Participants should be able to see newly assigned assignment in their page.
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course: ''' It will check an assignment can be added to the course
it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==
Activated github repository in travis. Whenever we push changes in our repository, travis will start building and run all test cases.
At the end, it will give the final result consisting of the number of test cases passed and failed and the overall build result.

=='''References'''==
1. Github Expertiza[https://github.com/expertiza/expertiza]

2. RSpec [http://rspec.info/]

3. Capybara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T01:19:09Z

Asingh26: /* Error in Test Cases */

=='''Background'''==
Expertiza is an open source web-based platform for the organizing and management of student project submissions and their evaluation, that supports augmentation of subject knowledge and accelerated learning via peer reviews. The application is meant for two types of users, instructors and students to use the application. Instructor can create and manage a course, enroll students in the course, create, manage and personalize assignments, project submissions and reviews for the particular course. Students can make their project submissions for the assignments allocated to them by their instructors for a course, give peer reviews, teammate reviews, create quizzes for their project reviewers, provide feedbacks and view their grades.

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===Fixes in existing broken Test Cases===

Due to continual development of Expertiza, some of the existing test cases that were implemented with relatively older version of Expertiza were found broken at the starting of the project.
To make the assignment creation testing complete, and to avoid covering the same scenarios again by adding new working test cases unnecessarily, these test case were fixed. Some of the fixes that were provided as part of this project are as follows:
1. Some of the functionalities for which the test cases were written have been remodeled so they had to be skipped.

===Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment''

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment''
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team ''
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz''
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with staggered deadline ''
it "is able to create with staggered deadline" do
skip('skip test on staggered deadline temporarily')
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
begin
check("assignment_form_assignment_staggered_deadline")
rescue
return
end
page.driver.browser.switch_to.alert.accept
click_button 'Create'
fill_in 'assignment_form_assignment_days_between_submissions', with: 7
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
pending(%(not sure what's broken here but the error is: #ActionController::RoutingError: No route matches [GET]
"/asset/staggered_deadline_assignment_grap/graph_1.jpg"))
expect(assignment).to have_attributes(
staggered_deadline: true
)
end

''f. Create Assignment with review visible to all reviewers''
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''g. Create public micro-task assignment''
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''h. create calibrated public assignment ''
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students''
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students''
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment''
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers'''
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics''
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic ''
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic ''
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. set the deadline for an assignment review''
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment ''
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants''
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course'''

it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==

=='''References'''==
1. Github Expertiza[https://github.com/expertiza/expertiza]

2. RSpec [http://rspec.info/]

3. Capybara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T00:57:20Z

Asingh26: /* References */

=='''Background'''==
Expertiza is an open source web-based platform for the organizing and management of student project submissions and their evaluation, that supports augmentation of subject knowledge and accelerated learning via peer reviews. The application is meant for two types of users, instructors and students to use the application. Instructor can create and manage a course, enroll students in the course, create, manage and personalize assignments, project submissions and reviews for the particular course. Students can make their project submissions for the assignments allocated to them by their instructors for a course, give peer reviews, teammate reviews, create quizzes for their project reviewers, provide feedbacks and view their grades.

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===Error in Test Cases===

===Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment''

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment''
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team ''
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz''
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with staggered deadline ''
it "is able to create with staggered deadline" do
skip('skip test on staggered deadline temporarily')
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
begin
check("assignment_form_assignment_staggered_deadline")
rescue
return
end
page.driver.browser.switch_to.alert.accept
click_button 'Create'
fill_in 'assignment_form_assignment_days_between_submissions', with: 7
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
pending(%(not sure what's broken here but the error is: #ActionController::RoutingError: No route matches [GET]
"/asset/staggered_deadline_assignment_grap/graph_1.jpg"))
expect(assignment).to have_attributes(
staggered_deadline: true
)
end

''f. Create Assignment with review visible to all reviewers''
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''g. Create public micro-task assignment''
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''h. create calibrated public assignment ''
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students''
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students''
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment''
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers'''
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics''
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic ''
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic ''
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. set the deadline for an assignment review''
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment ''
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants''
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course'''

it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==

=='''References'''==
1. Github Expertiza[https://github.com/expertiza/expertiza]

2. RSpec [http://rspec.info/]

3. Capybara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T00:57:03Z

Asingh26: /* References */

=='''Background'''==
Expertiza is an open source web-based platform for the organizing and management of student project submissions and their evaluation, that supports augmentation of subject knowledge and accelerated learning via peer reviews. The application is meant for two types of users, instructors and students to use the application. Instructor can create and manage a course, enroll students in the course, create, manage and personalize assignments, project submissions and reviews for the particular course. Students can make their project submissions for the assignments allocated to them by their instructors for a course, give peer reviews, teammate reviews, create quizzes for their project reviewers, provide feedbacks and view their grades.

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===Error in Test Cases===

===Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment''

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment''
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team ''
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz''
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with staggered deadline ''
it "is able to create with staggered deadline" do
skip('skip test on staggered deadline temporarily')
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
begin
check("assignment_form_assignment_staggered_deadline")
rescue
return
end
page.driver.browser.switch_to.alert.accept
click_button 'Create'
fill_in 'assignment_form_assignment_days_between_submissions', with: 7
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
pending(%(not sure what's broken here but the error is: #ActionController::RoutingError: No route matches [GET]
"/asset/staggered_deadline_assignment_grap/graph_1.jpg"))
expect(assignment).to have_attributes(
staggered_deadline: true
)
end

''f. Create Assignment with review visible to all reviewers''
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''g. Create public micro-task assignment''
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''h. create calibrated public assignment ''
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students''
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students''
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment''
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers'''
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics''
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic ''
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic ''
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. set the deadline for an assignment review''
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment ''
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants''
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course'''

it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==

=='''References'''==
Github Expertiza[https://github.com/expertiza/expertiza]

RSpec [http://rspec.info/]

Capybara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T00:46:57Z

Asingh26: /* Background */

=='''Background'''==
Expertiza is an open source web-based platform for the organizing and management of student project submissions and their evaluation, that supports augmentation of subject knowledge and accelerated learning via peer reviews. The application is meant for two types of users, instructors and students to use the application. Instructor can create and manage a course, enroll students in the course, create, manage and personalize assignments, project submissions and reviews for the particular course. Students can make their project submissions for the assignments allocated to them by their instructors for a course, give peer reviews, teammate reviews, create quizzes for their project reviewers, provide feedbacks and view their grades.

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===Error in Test Cases===

===Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment''

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment''
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team ''
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz''
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with staggered deadline ''
it "is able to create with staggered deadline" do
skip('skip test on staggered deadline temporarily')
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
begin
check("assignment_form_assignment_staggered_deadline")
rescue
return
end
page.driver.browser.switch_to.alert.accept
click_button 'Create'
fill_in 'assignment_form_assignment_days_between_submissions', with: 7
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
pending(%(not sure what's broken here but the error is: #ActionController::RoutingError: No route matches [GET]
"/asset/staggered_deadline_assignment_grap/graph_1.jpg"))
expect(assignment).to have_attributes(
staggered_deadline: true
)
end

''f. Create Assignment with review visible to all reviewers''
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''g. Create public micro-task assignment''
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''h. create calibrated public assignment ''
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students''
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students''
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment''
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers'''
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics''
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic ''
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic ''
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. set the deadline for an assignment review''
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment ''
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants''
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course'''

it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==

=='''References'''==

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T00:21:04Z

Asingh26: /* Capybara */

=='''Background'''==

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===Existing Test Cases===

===Newly Added Test Cases===
'''1. Test Assignment Creation'''

''a. Test Creating public Assignment''

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment''

''c. Create Assignment for Team ''
''d. Create Assignment with Quiz''
''e. Create Assignment with staggered deadline ''
''f. Create Assignment with review visible to all reviewers''
''g. Create public micro-task assignment''
''h. create calibrated public assignment ''

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students''
''b. Edit number of quizzes available to students''
''c. Edit number of members per team in an Assignment''
''d. Edit number of members per team ''
''e. Edit review visible to all other reviewers'''
''f. Should create teammate review row in rubrics''
''g. Check if checking calibration shows the tab''

'''3. Test Topic Tab of Assignment Creation'''
''a. edit topics properties''
''b. edit topics properties''
''c. Add new topic ''
''d. Delete existing topic ''

'''4. Test Rubrics Tab of Assignment Creation'''
''a. Update review questionnaire rubric''
''b. Update scored question dropdown''
''c. Updates author feedback questionnaire''
''d. Update scored question dropdown''

'''5. Test Review Strategy of Assignment Creation'''
''a. Test all auto selects feature''

'''6. Test Due dates tab of assignment Creation'''

'''7. Test Adding participants by Instructor'''
''a. Add New Participants to assignment ''
''b. Verify assignments assigned to participants''

=='''Automated Execution via Travis'''==

=='''References'''==

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T00:13:46Z

Asingh26: /* Feature Testing Tools */

=='''Background'''==

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario.

=='''Test Cases'''==

===Existing Test Cases===

===Newly Added Test Cases===
'''1. Test Assignment Creation'''

''a. Test Creating public Assignment''

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment''

''c. Create Assignment for Team ''
''d. Create Assignment with Quiz''
''e. Create Assignment with staggered deadline ''
''f. Create Assignment with review visible to all reviewers''
''g. Create public micro-task assignment''
''h. create calibrated public assignment ''

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students''
''b. Edit number of quizzes available to students''
''c. Edit number of members per team in an Assignment''
''d. Edit number of members per team ''
''e. Edit review visible to all other reviewers'''
''f. Should create teammate review row in rubrics''
''g. Check if checking calibration shows the tab''

'''3. Test Topic Tab of Assignment Creation'''
''a. edit topics properties''
''b. edit topics properties''
''c. Add new topic ''
''d. Delete existing topic ''

'''4. Test Rubrics Tab of Assignment Creation'''
''a. Update review questionnaire rubric''
''b. Update scored question dropdown''
''c. Updates author feedback questionnaire''
''d. Update scored question dropdown''

'''5. Test Review Strategy of Assignment Creation'''
''a. Test all auto selects feature''

'''6. Test Due dates tab of assignment Creation'''

'''7. Test Adding participants by Instructor'''
''a. Add New Participants to assignment ''
''b. Verify assignments assigned to participants''

=='''Automated Execution via Travis'''==

=='''References'''==

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-28T23:29:37Z

Asingh26: /* Objective */

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-28T23:20:31Z

Asingh26: /* Objective */

=='''Background'''==

=='''Objective'''==
Assignment Creation can be done by in Expertiza an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

=='''Feature Testing Tools'''==

===Rspec===

===Capybara===

=='''Test Cases'''==

===Existing Test Cases===

===Newly Added Test Cases===
'''1. Test Assignment Creation'''

''a. Test Creating public Assignment''

''b. Test Creating private Assignment''

''c. Create Assignment for Team ''
''d. Create Assignment with Quiz''
''e. Create Assignment with staggered deadline ''
''f. Create Assignment with review visible to all reviewers''
''g. Create public micro-task assignment''
''h. create calibrated public assignment ''

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students''
''b. Edit number of quizzes available to students''
''c. Edit number of members per team in an Assignment''
''d. Edit number of members per team ''
''e. Edit review visible to all other reviewers'''
''f. Should create teammate review row in rubrics''
''g. Check if checking calibration shows the tab''

'''3. Test Topic Tab of Assignment Creation'''
''a. edit topics properties''
''b. edit topics properties''
''c. Add new topic ''
''d. Delete existing topic ''

'''4. Test Rubrics Tab of Assignment Creation'''

'''5. Test Review Strategy of Assignment Creation'''

'''6. Test Due dates tab of assignment Creation'''

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment ''
''b. Verify assignments assigned to participants''

=='''Automated Execution via Travis'''==

=='''References'''==

CSC/ECE 517 Fall 2016

2016-10-28T21:47:21Z

Asingh26:

[http://www.example.com link title]==Calibration Assignment Submissions==
*[[Calibration Assignment Submission (Firebrick JS)]]
*[[Calibration Assignment Submission (Active Job)]]
==Writing Assignments 2==
*[[CSC/ECE 517 Fall 2016/E1666. Test team functionality]]
*[[CSC/ECE 517 Fall 2016/E1643. Refactor Suggestion controller]]
*[[CSC/ECE 517 Fall 2016/E1631. Refactoring Bidding Interface]]
*[[CSC/ECE 517 Fall 2016/E1674.Refactor leaderboard.rb and write unit tests]]
*[[CSC/ECE 517 Fall 2016/E1668.Test e-mailing functionality]]
*[[CSC/ECE 517 Fall 2016/E1658. Refractor lottery_controller.rb and write integration tests]]
*[[CSC/ECE 517 Fall 2016/E1660. Review requirements and thresholds]]
*[[CSC/ECE 517 Fall 2016/E1650. Sort instructor views alphabetically by default]]
*[[CSC/ECE 517 Fall 2016/E1644. Refactor and test Teams Controller]]
*[[CSC/ECE 517 Fall 2016/E1659. Refactor on_the_fly_calc.rb]]
*[[CSC/ECE 517 Fall 2016/E1657. Introduce a Student View for instructors]]
*[[CSC/ECE 517 Fall 2016/E1653. Fix and improve rubric criteria]]
*[[CSC/ECE 517 Fall 2016/E1642. Refactor review_response_map.rb]]
*[[CSC/ECE_517_Fall_2016/E1664:_Feature_Test_Assignment_Creation]]
*[[CSC/ECE 517 Fall 2016/E1666. Test team functionality]]
*[[CSC/ECE_517_Fall_2016/E1654. Improve_date-picker_and_deadlines]]
*[[CSC/ECE_517_Fall_2016/E1652 Fix teammate advertisements and requests to join a team ]]
*[[CSC/ECE_517_Fall_2016/E1662. UI issues/fixes]]
*[[CSC/ECE_517_Fall_2016/E1673. Refactor question_type.rb]]
*[[CSC/ECE_517_Fall_2016/E1675. Timestamp for student file & hyperlink submissions]]

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-28T21:43:33Z

Asingh26: Created page with "=='''Background'''== =='''Objective'''== =='''Feature Testing Tools'''== ===Rspec=== ===Capybara=== =='''Test Cases'''== ===Existing Test Cases=== ===Newly Added Test Case..."

=='''Background'''==

=='''Objective'''==

=='''Feature Testing Tools'''==

===Rspec===

===Capybara===

=='''Test Cases'''==

===Existing Test Cases===

===Newly Added Test Cases===

=='''Automated Execution via Travis'''==

=='''References'''==