Expertiza_Wiki - User contributions [en]

CSC/ECE 517 Fall 2016 E1676 Role-based reviewing

2016-12-13T21:49:05Z

Pjain12: /* Sample Test cases */

== Purpose ==
In the current version of Expertiza, members among a team can evaluate each other’s contribution and give appropriate scores based on the same questionnaire. However, in the lifetime of software development, members in a team often take on different roles whose works content are vastly differentiated. Like in an agile development environment, such as Scrum, there are typically [http://scrummethodology.com/the-scrum-team-role/ seven roles group members] can take: software engineer, architect, programmer, analyst, QA expert, tester and UI designers . Job description and evaluation entailed are vastly varied among these roles, thus a generic assessment rubric cannot hold reasonably.

The rationale of our project is that we want to give project members the option to evaluate each other's work based on the specific role or duty they take in the development process. This can ensure a reasonable assessment for different duties and can also help to improve the utility of using members-reviewing in the whole reviewing process.

== Task Description==
Task Description:
There are general three aspects we would do in order to achieve the Role-based reviewing function.

1) A new option (check box) would be added to the Review Strategy tab from the instructor view when he creates a new assignment. What’s more, the instructor can create different roles or duties available for the assignment by typing into a text filed. The instructor also has the power to allow multiple members to choose for the same duty.

2) In the Rubrics tab from the instructor view, New rubric would be generated by creating different questionnaires for different roles when adding new assignment.

3) A new option (drop box) would be added to the “Your team” page from the student view when an assignment was created to be role-based reviewing. Student can choose their roles or duties from the drop box which were generated by the instructor for this specific assignment. When the instructor enabled the multiple selection option, different members in the team can choose same duties for this assignment.

Tasks can be viewed more clearly by the graph below:

[[File:Drawing.png]]

== Design ==

=== Database Design ===
We have modified following three database tables to support role(duty) based reviewing:

1. assignment_questionnaires

2. assignments

3. teams_users

{| class="wikitable"
1] We have added following fields in '''assignment_questionnaires table'''
!Field Name !!Type !!Description
|-
!duty_name
|varchar(255)
|List of duties that students can choose in the given assignment
|}

{| class="wikitable"
2] We have added '''duty_based''', '''multiple_duty_based''' and '''all_duty_name''' into '''assignments''' table to store the duty name
!Field Name !!Type !!Description
|-
!duty_based
|boolean
|If the assignment's team is duty based, it should be '''true'''. If not, it should be '''false'''.
|-
!allow_duty_share
|boolean
|If multiple people could choose one duty in the assignment, it should be '''true'''. If not, it should be '''false'''.
|-
!duty_names
|varchar(255)
|It would save all kinds of duties in the assignment.
|}

{| class="wikitable"
3] We have added '''duty''' into '''teams_users''' table to store the duty.
!Field Name !!Type !!Description
|-
!duty
|varchar(255)
|It would save this user's duty in this team.
|}

==Updates==

Below are the key files modified:

===Controllers===
1. expertiza/app/controllers/assignments_controller.rb:
def edit
a. add "role based assignment" option to review strategy section.
b. add roles to current assignment.
c. add questionnaires to these roles separately.
end

2. expertiza/app/controllers/questionnaires_controller.rb

===Models===

See [[#Design|Database Design]] section above.

===Views===
Below are the view files that we modified
1. When logged in as instructor, we modified files below:
1.1 Add a "role based" strategy checkbox here: expertiza/app/views/assignments/edit/_review_strategy.html.erb
1.2 Add roles input fields if you check the "role based" strategy checkbox: expertiza/app/views/assignments/edit/_review_strategy.html.erb
1.3 Create rubric to assign questionnaire based on duties: expertiza-developer/expertiza/app/views/assignments/edit/_rubrics.html.erb
& expertiza-developer/expertiza/app/helpers/assignment_helper.rb

2. When logged in as a student, we modified files below:
2.1 To show "select duty" and "update duty" option: expertiza/app/views/student_teams/view.html.erb
2.2 To show the form to select duty: expertiza/app/views/teams_users/edit.html.erb

1] View showing newly added checkbox for setting duty based option and allowing duty share

[[File:111.png]]

2] View showing different questionnaire for different teammates based on their duty
[[File:222.png]]

3] Assign questionnaire to teammates based on their duty

[[File:333.png]]

4] View showing "select duty" link for teammates. Every student can select their duty in the team.
[[File:444.png]]

[[File:555.png]]

5] After selecting, students can update their duty. Also, they will get the review questionnaire based on duty.
[[File:666.png]]

6] Review questionnaire based on duty

[[File:777.png]]

== Testing Details ==
In our project, we are providing an option of adding duty for different team members in an assignment and giving review options based on their duty. We will add following functionalities:
1. How instructor create assignment with duties/roles
2. How students take duties from a given list of duties
3. How teammate evaluation rubric assign different review questionnaire based on duty.

=== UI Testing ===
UI will be tested manually. First, we will test creating an assignment as an instructor with different duties and assign different review questionnaires to each duty. Then we will login in as a student and take a duty from given list of duties. We will try covering all edge case scenarios in test cases section.

=== Test Cases ===
Following will be the test cases:

1. Login in as an Instructor:

1.a] While creating an assignment, in the Review Strategy tab provide the list of roles/duties possible for teammates. There will be one text box to add
duty. To add more duties click on "add more".
1.b] Mark the check box that says multiple team members can have the same duty.
1.c] Go to the Rubrics tab and select different questionnaires for different duty.
After creating this assignment students should be able to see different duties in "Your Team" page and should be able to select any duty. Multiple students
should be able to select same duty.

2. Login in as an Instructor:

2.a] Repeat steps 1.a and 1.b
2.b] This time do not mark the check box that says "multiple team members can have the same duty".
After creating this assignment students should be able to see different duties in "Your Team" page. This time student should not be able to select a duty if
it was already selected.

3. Login in as a Student

When you login in as a student you should be able to pick different duties assigned by the instructor. If multiple members are not allowed to have same duty
then you should not be able to pick a duty if it was already selected by some other member.

4. Login in as a Reviewer

When you login in as a reviewer you should get the questionnaire based on your duty. For example, if you are a software engineer you should get the review
questionnaire assigned to software engineer.
Different roles will be assigned different questionnaires for review.

=== RSpec ===

For functional testing, we will use RSpec. It uses Behavior Driven Development (BDD) for testing functionality of the system. It provides way to describe specific functionality of the system being tested and helps in better visualization of test cases.

=== Capybara ===
We will use Capybara for automating the manual test cases. It is a web-based automation framework and coupled with RSpec. It allow developers to write the test cases which simulate the whole scenario of manual testing.

=== Sample Test cases ===
1. Verify if instructor can select duty option

it "selects duty based option" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
check("duty_based")
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10,
duty_based: true
)
end

2. Verify if instructor can correctly set the duty
it "sets duty " do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
check("duty_based")
check("allow_duty_share")
fill_in "assignment_form_assignment_duty_names", with: "developer, tester, analyst, writer, systest"
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10,
duty_based: true,
allow_duty_share: true,
duty_names: "developer, tester, analyst, writer, systest"
)
end

3. Verify if duty share is allowed

it "selects allow duty share option" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
check("duty_based")
check("allow_duty_share")
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10,
duty_based: true,
allow_duty_share: true
)
end

4. Complete test cases are present in following files:
Student test cases: [[ https://github.com/Expertiza-Final-Project/expertiza/blob/testing/spec/features/duty_student_spec.rb]]
Instructor test cases: [[ https://github.com/Expertiza-Final-Project/expertiza/blob/testing/spec/features/assignment_creation_spec.rb]]

== Reference ==

Expertiza[https://github.com/expertiza/expertiza]

RSpec [http://rspec.info/]

ScrumRoles [http://scrummethodology.com/the-scrum-team-role]

CapyBara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016 E1676 Role-based reviewing

2016-12-13T21:46:52Z

Pjain12: /* Sample Test cases */

== Purpose ==
In the current version of Expertiza, members among a team can evaluate each other’s contribution and give appropriate scores based on the same questionnaire. However, in the lifetime of software development, members in a team often take on different roles whose works content are vastly differentiated. Like in an agile development environment, such as Scrum, there are typically [http://scrummethodology.com/the-scrum-team-role/ seven roles group members] can take: software engineer, architect, programmer, analyst, QA expert, tester and UI designers . Job description and evaluation entailed are vastly varied among these roles, thus a generic assessment rubric cannot hold reasonably.

The rationale of our project is that we want to give project members the option to evaluate each other's work based on the specific role or duty they take in the development process. This can ensure a reasonable assessment for different duties and can also help to improve the utility of using members-reviewing in the whole reviewing process.

== Task Description==
Task Description:
There are general three aspects we would do in order to achieve the Role-based reviewing function.

1) A new option (check box) would be added to the Review Strategy tab from the instructor view when he creates a new assignment. What’s more, the instructor can create different roles or duties available for the assignment by typing into a text filed. The instructor also has the power to allow multiple members to choose for the same duty.

2) In the Rubrics tab from the instructor view, New rubric would be generated by creating different questionnaires for different roles when adding new assignment.

3) A new option (drop box) would be added to the “Your team” page from the student view when an assignment was created to be role-based reviewing. Student can choose their roles or duties from the drop box which were generated by the instructor for this specific assignment. When the instructor enabled the multiple selection option, different members in the team can choose same duties for this assignment.

Tasks can be viewed more clearly by the graph below:

[[File:Drawing.png]]

== Design ==

=== Database Design ===
We have modified following three database tables to support role(duty) based reviewing:

1. assignment_questionnaires

2. assignments

3. teams_users

{| class="wikitable"
1] We have added following fields in '''assignment_questionnaires table'''
!Field Name !!Type !!Description
|-
!duty_name
|varchar(255)
|List of duties that students can choose in the given assignment
|}

{| class="wikitable"
2] We have added '''duty_based''', '''multiple_duty_based''' and '''all_duty_name''' into '''assignments''' table to store the duty name
!Field Name !!Type !!Description
|-
!duty_based
|boolean
|If the assignment's team is duty based, it should be '''true'''. If not, it should be '''false'''.
|-
!allow_duty_share
|boolean
|If multiple people could choose one duty in the assignment, it should be '''true'''. If not, it should be '''false'''.
|-
!duty_names
|varchar(255)
|It would save all kinds of duties in the assignment.
|}

{| class="wikitable"
3] We have added '''duty''' into '''teams_users''' table to store the duty.
!Field Name !!Type !!Description
|-
!duty
|varchar(255)
|It would save this user's duty in this team.
|}

==Updates==

Below are the key files modified:

===Controllers===
1. expertiza/app/controllers/assignments_controller.rb:
def edit
a. add "role based assignment" option to review strategy section.
b. add roles to current assignment.
c. add questionnaires to these roles separately.
end

2. expertiza/app/controllers/questionnaires_controller.rb

===Models===

See [[#Design|Database Design]] section above.

===Views===
Below are the view files that we modified
1. When logged in as instructor, we modified files below:
1.1 Add a "role based" strategy checkbox here: expertiza/app/views/assignments/edit/_review_strategy.html.erb
1.2 Add roles input fields if you check the "role based" strategy checkbox: expertiza/app/views/assignments/edit/_review_strategy.html.erb
1.3 Create rubric to assign questionnaire based on duties: expertiza-developer/expertiza/app/views/assignments/edit/_rubrics.html.erb
& expertiza-developer/expertiza/app/helpers/assignment_helper.rb

2. When logged in as a student, we modified files below:
2.1 To show "select duty" and "update duty" option: expertiza/app/views/student_teams/view.html.erb
2.2 To show the form to select duty: expertiza/app/views/teams_users/edit.html.erb

1] View showing newly added checkbox for setting duty based option and allowing duty share

[[File:111.png]]

2] View showing different questionnaire for different teammates based on their duty
[[File:222.png]]

3] Assign questionnaire to teammates based on their duty

[[File:333.png]]

4] View showing "select duty" link for teammates. Every student can select their duty in the team.
[[File:444.png]]

[[File:555.png]]

5] After selecting, students can update their duty. Also, they will get the review questionnaire based on duty.
[[File:666.png]]

6] Review questionnaire based on duty

[[File:777.png]]

== Testing Details ==
In our project, we are providing an option of adding duty for different team members in an assignment and giving review options based on their duty. We will add following functionalities:
1. How instructor create assignment with duties/roles
2. How students take duties from a given list of duties
3. How teammate evaluation rubric assign different review questionnaire based on duty.

=== UI Testing ===
UI will be tested manually. First, we will test creating an assignment as an instructor with different duties and assign different review questionnaires to each duty. Then we will login in as a student and take a duty from given list of duties. We will try covering all edge case scenarios in test cases section.

=== Test Cases ===
Following will be the test cases:

1. Login in as an Instructor:

1.a] While creating an assignment, in the Review Strategy tab provide the list of roles/duties possible for teammates. There will be one text box to add
duty. To add more duties click on "add more".
1.b] Mark the check box that says multiple team members can have the same duty.
1.c] Go to the Rubrics tab and select different questionnaires for different duty.
After creating this assignment students should be able to see different duties in "Your Team" page and should be able to select any duty. Multiple students
should be able to select same duty.

2. Login in as an Instructor:

2.a] Repeat steps 1.a and 1.b
2.b] This time do not mark the check box that says "multiple team members can have the same duty".
After creating this assignment students should be able to see different duties in "Your Team" page. This time student should not be able to select a duty if
it was already selected.

3. Login in as a Student

When you login in as a student you should be able to pick different duties assigned by the instructor. If multiple members are not allowed to have same duty
then you should not be able to pick a duty if it was already selected by some other member.

4. Login in as a Reviewer

When you login in as a reviewer you should get the questionnaire based on your duty. For example, if you are a software engineer you should get the review
questionnaire assigned to software engineer.
Different roles will be assigned different questionnaires for review.

=== RSpec ===

For functional testing, we will use RSpec. It uses Behavior Driven Development (BDD) for testing functionality of the system. It provides way to describe specific functionality of the system being tested and helps in better visualization of test cases.

=== Capybara ===
We will use Capybara for automating the manual test cases. It is a web-based automation framework and coupled with RSpec. It allow developers to write the test cases which simulate the whole scenario of manual testing.

=== Sample Test cases ===
1. Verify if instructor can select duty option

it "selects duty based option" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
check("duty_based")
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10,
duty_based: true
)
end

2. Verify if instructor can correctly set the duty
it "sets duty " do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
check("duty_based")
check("allow_duty_share")
fill_in "assignment_form_assignment_duty_names", with: "developer, tester, analyst, writer, systest"
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10,
duty_based: true,
allow_duty_share: true,
duty_names: "developer, tester, analyst, writer, systest"
)
end

3. Verify if duty share is allowed

it "selects allow duty share option" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
check("duty_based")
check("allow_duty_share")
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10,
duty_based: true,
allow_duty_share: true
)
end

4. Complete test cases are present in following files:
Student test cases: [[ https://github.com/Expertiza-Final-Project/expertiza/blob/testing/spec/features/duty_student_spec.rb]]
Instructor test cases: [https://github.com/Expertiza-Final-Project/expertiza/blob/testing/spec/features/assignment_creation_spec.rb
]

== Reference ==

Expertiza[https://github.com/expertiza/expertiza]

RSpec [http://rspec.info/]

ScrumRoles [http://scrummethodology.com/the-scrum-team-role]

CapyBara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016 E1676 Role-based reviewing

2016-12-13T18:32:47Z

Pjain12: /* Testing Details */

== Purpose ==
In the current version of Expertiza, members among a team can evaluate each other’s contribution and give appropriate scores based on the same questionnaire. However, in the lifetime of software development, members in a team often take on different roles whose works content are vastly differentiated. Like in an agile development environment, such as Scrum, there are typically [http://scrummethodology.com/the-scrum-team-role/ seven roles group members] can take: software engineer, architect, programmer, analyst, QA expert, tester and UI designers . Job description and evaluation entailed are vastly varied among these roles, thus a generic assessment rubric cannot hold reasonably.

The rationale of our project is that we want to give project members the option to evaluate each other's work based on the specific role or duty they take in the development process. This can ensure a reasonable assessment for different duties and can also help to improve the utility of using members-reviewing in the whole reviewing process.

== Task Description==
Task Description:
There are general three aspects we would do in order to achieve the Role-based reviewing function.

1) A new option (check box) would be added to the Review Strategy tab from the instructor view when he creates a new assignment. What’s more, the instructor can create different roles or duties available for the assignment by typing into a text filed. The instructor also has the power to allow multiple members to choose for the same duty.

2) In the Rubrics tab from the instructor view, New rubric would be generated by creating different questionnaires for different roles when adding new assignment.

3) A new option (drop box) would be added to the “Your team” page from the student view when an assignment was created to be role-based reviewing. Student can choose their roles or duties from the drop box which were generated by the instructor for this specific assignment. When the instructor enabled the multiple selection option, different members in the team can choose same duties for this assignment.

Tasks can be viewed more clearly by the graph below:

[[File:Drawing.png]]

== Design ==

=== Database Design ===
We have modified following three database tables to support role(duty) based reviewing:

1. assignment_questionnaires

2. assignments

3. teams_users

{| class="wikitable"
1] We have added following fields in '''assignment_questionnaires table'''
!Field Name !!Type !!Description
|-
!duty_name
|varchar(255)
|List of duties that students can choose in the given assignment
|}

{| class="wikitable"
2] We have added '''duty_based''', '''multiple_duty_based''' and '''all_duty_name''' into '''assignments''' table to store the duty name
!Field Name !!Type !!Description
|-
!duty_based
|boolean
|If the assignment's team is duty based, it should be '''true'''. If not, it should be '''false'''.
|-
!allow_duty_share
|boolean
|If multiple people could choose one duty in the assignment, it should be '''true'''. If not, it should be '''false'''.
|-
!duty_names
|varchar(255)
|It would save all kinds of duties in the assignment.
|}

{| class="wikitable"
3] We have added '''duty''' into '''teams_users''' table to store the duty.
!Field Name !!Type !!Description
|-
!duty
|varchar(255)
|It would save this user's duty in this team.
|}

==Updates==

Below are the key files modified:

===Controllers===
1. expertiza/app/controllers/assignments_controller.rb:
def edit
a. add "role based assignment" option to review strategy section.
b. add roles to current assignment.
c. add questionnaires to these roles separately.
end

2. expertiza/app/controllers/questionnaires_controller.rb

===Models===

See [[#Design|Database Design]] section above.

===Views===
Below are the view files that we modified
1. When logged in as instructor, we modified files below:
1.1 Add a "role based" strategy checkbox here: expertiza/app/views/assignments/edit/_review_strategy.html.erb
1.2 Add roles input fields if you check the "role based" strategy checkbox: expertiza/app/views/assignments/edit/_review_strategy.html.erb
1.3 Create rubric to assign questionnaire based on duties: expertiza-developer/expertiza/app/views/assignments/edit/_rubrics.html.erb
& expertiza-developer/expertiza/app/helpers/assignment_helper.rb

2. When logged in as a student, we modified files below:
2.1 To show "select duty" and "update duty" option: expertiza/app/views/student_teams/view.html.erb
2.2 To show the form to select duty: expertiza/app/views/teams_users/edit.html.erb

1]View showing newly added checkbox for setting duty based option and allowing duty share

[[File:111.png]]

2]View showing different questionnaire for different teammates based on their duty
[[File:222.png]]

3]Assign questionnaire to teammates based on their duty

[[File:333.png]]

4]View showing "select duty" link for teammates. Every student can select their duty in the team.
[[File:444.png]]

[[File:555.png]]

5]After selecting, students can update their duty. Also, they will get the review questionnaire based on duty.
[[File:666.png]]

6]Review questionnaire based on duty

[[File:777.png]]

== Testing Details ==
In our project, we are providing an option of adding duty for different team members in an assignment and giving review options based on their duty. We will add following functionalities:
1. How instructor create assignment with duties/roles
2. How students take duties from a given list of duties
3. How teammate evaluation rubric assign different review questionnaire based on duty.

=== UI Testing ===
UI will be tested manually. First, we will test creating an assignment as an instructor with different duties and assign different review questionnaires to each duty. Then we will login in as a student and take a duty from given list of duties. We will try covering all edge case scenarios in test cases section.

=== Test Cases ===
Following will be the test cases:

1. Login in as an Instructor:

1.a] While creating an assignment, in the Review Strategy tab provide the list of roles/duties possible for teammates. There will be one text box to add
duty. To add more duties click on "add more".
1.b] Mark the check box that says multiple team members can have the same duty.
1.c] Go to the Rubrics tab and select different questionnaires for different duty.
After creating this assignment students should be able to see different duties in "Your Team" page and should be able to select any duty. Multiple students
should be able to select same duty.

2. Login in as an Instructor:

2.a] Repeat steps 1.a and 1.b
2.b] This time do not mark the check box that says "multiple team members can have the same duty".
After creating this assignment students should be able to see different duties in "Your Team" page. This time student should not be able to select a duty if
it was already selected.

3. Login in as a Student

When you login in as a student you should be able to pick different duties assigned by the instructor. If multiple members are not allowed to have same duty
then you should not be able to pick a duty if it was already selected by some other member.

4. Login in as a Reviewer

When you login in as a reviewer you should get the questionnaire based on your duty. For example, if you are a software engineer you should get the review
questionnaire assigned to software engineer.
Different roles will be assigned different questionnaires for review.

=== RSpec ===

For functional testing, we will use RSpec. It uses Behavior Driven Development (BDD) for testing functionality of the system. It provides way to describe specific functionality of the system being tested and helps in better visualization of test cases.

=== Capybara ===
We will use Capybara for automating the manual test cases. It is a web-based automation framework and coupled with RSpec. It allow developers to write the test cases which simulate the whole scenario of manual testing.

=== Sample Test cases ===
1. Verify if instructor can select duty option

it "selects duty based option" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
check("duty_based")
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10,
duty_based: true
)
end

2. Verify if instructor can correctly set the duty
it "sets duty " do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
check("duty_based")
check("allow_duty_share")
fill_in "assignment_form_assignment_duty_names", with: "developer, tester, analyst, writer, systest"
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10,
duty_based: true,
allow_duty_share: true,
duty_names: "developer, tester, analyst, writer, systest"
)
end

3. Veify if duty share is allowed

it "selects allow duty share option" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
check("duty_based")
check("allow_duty_share")
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10,
duty_based: true,
allow_duty_share: true
)
end

== Reference ==

Expertiza[https://github.com/expertiza/expertiza]

RSpec [http://rspec.info/]

ScrumRoles [http://scrummethodology.com/the-scrum-team-role]

CapyBara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016 E1676 Role-based reviewing

2016-12-13T18:32:18Z

Pjain12: /* Reference */

== Purpose ==
In the current version of Expertiza, members among a team can evaluate each other’s contribution and give appropriate scores based on the same questionnaire. However, in the lifetime of software development, members in a team often take on different roles whose works content are vastly differentiated. Like in an agile development environment, such as Scrum, there are typically [http://scrummethodology.com/the-scrum-team-role/ seven roles group members] can take: software engineer, architect, programmer, analyst, QA expert, tester and UI designers . Job description and evaluation entailed are vastly varied among these roles, thus a generic assessment rubric cannot hold reasonably.

The rationale of our project is that we want to give project members the option to evaluate each other's work based on the specific role or duty they take in the development process. This can ensure a reasonable assessment for different duties and can also help to improve the utility of using members-reviewing in the whole reviewing process.

== Task Description==
Task Description:
There are general three aspects we would do in order to achieve the Role-based reviewing function.

1) A new option (check box) would be added to the Review Strategy tab from the instructor view when he creates a new assignment. What’s more, the instructor can create different roles or duties available for the assignment by typing into a text filed. The instructor also has the power to allow multiple members to choose for the same duty.

2) In the Rubrics tab from the instructor view, New rubric would be generated by creating different questionnaires for different roles when adding new assignment.

3) A new option (drop box) would be added to the “Your team” page from the student view when an assignment was created to be role-based reviewing. Student can choose their roles or duties from the drop box which were generated by the instructor for this specific assignment. When the instructor enabled the multiple selection option, different members in the team can choose same duties for this assignment.

Tasks can be viewed more clearly by the graph below:

[[File:Drawing.png]]

== Design ==

=== Database Design ===
We have modified following three database tables to support role(duty) based reviewing:

1. assignment_questionnaires

2. assignments

3. teams_users

{| class="wikitable"
1] We have added following fields in '''assignment_questionnaires table'''
!Field Name !!Type !!Description
|-
!duty_name
|varchar(255)
|List of duties that students can choose in the given assignment
|}

{| class="wikitable"
2] We have added '''duty_based''', '''multiple_duty_based''' and '''all_duty_name''' into '''assignments''' table to store the duty name
!Field Name !!Type !!Description
|-
!duty_based
|boolean
|If the assignment's team is duty based, it should be '''true'''. If not, it should be '''false'''.
|-
!allow_duty_share
|boolean
|If multiple people could choose one duty in the assignment, it should be '''true'''. If not, it should be '''false'''.
|-
!duty_names
|varchar(255)
|It would save all kinds of duties in the assignment.
|}

{| class="wikitable"
3] We have added '''duty''' into '''teams_users''' table to store the duty.
!Field Name !!Type !!Description
|-
!duty
|varchar(255)
|It would save this user's duty in this team.
|}

==Updates==

Below are the key files modified:

===Controllers===
1. expertiza/app/controllers/assignments_controller.rb:
def edit
a. add "role based assignment" option to review strategy section.
b. add roles to current assignment.
c. add questionnaires to these roles separately.
end

2. expertiza/app/controllers/questionnaires_controller.rb

===Models===

See [[#Design|Database Design]] section above.

===Views===
Below are the view files that we modified
1. When logged in as instructor, we modified files below:
1.1 Add a "role based" strategy checkbox here: expertiza/app/views/assignments/edit/_review_strategy.html.erb
1.2 Add roles input fields if you check the "role based" strategy checkbox: expertiza/app/views/assignments/edit/_review_strategy.html.erb
1.3 Create rubric to assign questionnaire based on duties: expertiza-developer/expertiza/app/views/assignments/edit/_rubrics.html.erb
& expertiza-developer/expertiza/app/helpers/assignment_helper.rb

2. When logged in as a student, we modified files below:
2.1 To show "select duty" and "update duty" option: expertiza/app/views/student_teams/view.html.erb
2.2 To show the form to select duty: expertiza/app/views/teams_users/edit.html.erb

1]View showing newly added checkbox for setting duty based option and allowing duty share

[[File:111.png]]

2]View showing different questionnaire for different teammates based on their duty
[[File:222.png]]

3]Assign questionnaire to teammates based on their duty

[[File:333.png]]

4]View showing "select duty" link for teammates. Every student can select their duty in the team.
[[File:444.png]]

[[File:555.png]]

5]After selecting, students can update their duty. Also, they will get the review questionnaire based on duty.
[[File:666.png]]

6]Review questionnaire based on duty

[[File:777.png]]

== Testing Details ==
In our project, we are providing an option of adding duty for different team members in an assignment and giving review options based on their duty. We will add following functionalities:
1. How instructor create assignment with duties/roles
2. How students take duties from a given list of duties
3. How teammate evaluation rubric assign different review questionnaire based on duty.

=== UI Testing ===
UI will be tested manually. First, we will test creating an assignment as an instructor with different duties and assign different review questionnaires to each duty. Then we will login in as a student and take a duty from given list of duties. We will try covering all edge case scenarios in test cases section.

=== Test Cases ===
Following will be the test cases:

1. Login in as an Instructor:

1.a] While creating an assignment, in the Review Strategy tab provide the list of roles/duties possible for teammates. There will be one text box to add
duty. To add more duties click on "add more".
1.b] Mark the check box that says multiple team members can have the same duty.
1.c] Go to the Rubrics tab and select different questionnaires for different duty.
After creating this assignment students should be able to see different duties in "Your Team" page and should be able to select any duty. Multiple students
should be able to select same duty.

2. Login in as an Instructor:

2.a] Repeat steps 1.a and 1.b
2.b] This time do not mark the check box that says "multiple team members can have the same duty".
After creating this assignment students should be able to see different duties in "Your Team" page. This time student should not be able to select a duty if
it was already selected.

3. Login in as a Student

When you login in as a student you should be able to pick different duties assigned by the instructor. If multiple members are not allowed to have same duty
then you should not be able to pick a duty if it was already selected by some other member.

4. Login in as a Reviewer

When you login in as a reviewer you should get the questionnaire based on your duty. For example, if you are a software engineer you should get the review
questionnaire assigned to software engineer.
Different roles will be assigned different questionnaires for review.

=== RSpec ===

For functional testing, we will use RSpec. It uses Behavior Driven Development (BDD) for testing functionality of the system. It provides way to describe specific functionality of the system being tested and helps in better visualization of test cases.

=== Capybara ===
We will use Capybara for automating the manual test cases. It is a web-based automation framework and coupled with RSpec. It allow developers to write the test cases which simulate the whole scenario of manual testing.

===Factory Girl===
We will use Factory Girl for creating data factory. Factory Girl is a Ruby Gem that allow users to create templates for valid and re-usable objects. It allows more customization when user instantiate the objects and it aims to ensure that user have a valid object to work with.

=== Sample Test cases ===
1. Verify if instructor can select duty option

it "selects duty based option" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
check("duty_based")
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10,
duty_based: true
)
end

2. Verify if instructor can correctly set the duty
it "sets duty " do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
check("duty_based")
check("allow_duty_share")
fill_in "assignment_form_assignment_duty_names", with: "developer, tester, analyst, writer, systest"
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10,
duty_based: true,
allow_duty_share: true,
duty_names: "developer, tester, analyst, writer, systest"
)
end

3. Veify if duty share is allowed

it "selects allow duty share option" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
check("duty_based")
check("allow_duty_share")
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10,
duty_based: true,
allow_duty_share: true
)
end

== Reference ==

Expertiza[https://github.com/expertiza/expertiza]

RSpec [http://rspec.info/]

ScrumRoles [http://scrummethodology.com/the-scrum-team-role]

CapyBara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016 E1676 Role-based reviewing

2016-12-13T18:31:43Z

Pjain12: /* Views */

== Purpose ==
In the current version of Expertiza, members among a team can evaluate each other’s contribution and give appropriate scores based on the same questionnaire. However, in the lifetime of software development, members in a team often take on different roles whose works content are vastly differentiated. Like in an agile development environment, such as Scrum, there are typically [http://scrummethodology.com/the-scrum-team-role/ seven roles group members] can take: software engineer, architect, programmer, analyst, QA expert, tester and UI designers . Job description and evaluation entailed are vastly varied among these roles, thus a generic assessment rubric cannot hold reasonably.

The rationale of our project is that we want to give project members the option to evaluate each other's work based on the specific role or duty they take in the development process. This can ensure a reasonable assessment for different duties and can also help to improve the utility of using members-reviewing in the whole reviewing process.

== Task Description==
Task Description:
There are general three aspects we would do in order to achieve the Role-based reviewing function.

1) A new option (check box) would be added to the Review Strategy tab from the instructor view when he creates a new assignment. What’s more, the instructor can create different roles or duties available for the assignment by typing into a text filed. The instructor also has the power to allow multiple members to choose for the same duty.

2) In the Rubrics tab from the instructor view, New rubric would be generated by creating different questionnaires for different roles when adding new assignment.

3) A new option (drop box) would be added to the “Your team” page from the student view when an assignment was created to be role-based reviewing. Student can choose their roles or duties from the drop box which were generated by the instructor for this specific assignment. When the instructor enabled the multiple selection option, different members in the team can choose same duties for this assignment.

Tasks can be viewed more clearly by the graph below:

[[File:Drawing.png]]

== Design ==

=== Database Design ===
We have modified following three database tables to support role(duty) based reviewing:

1. assignment_questionnaires

2. assignments

3. teams_users

{| class="wikitable"
1] We have added following fields in '''assignment_questionnaires table'''
!Field Name !!Type !!Description
|-
!duty_name
|varchar(255)
|List of duties that students can choose in the given assignment
|}

{| class="wikitable"
2] We have added '''duty_based''', '''multiple_duty_based''' and '''all_duty_name''' into '''assignments''' table to store the duty name
!Field Name !!Type !!Description
|-
!duty_based
|boolean
|If the assignment's team is duty based, it should be '''true'''. If not, it should be '''false'''.
|-
!allow_duty_share
|boolean
|If multiple people could choose one duty in the assignment, it should be '''true'''. If not, it should be '''false'''.
|-
!duty_names
|varchar(255)
|It would save all kinds of duties in the assignment.
|}

{| class="wikitable"
3] We have added '''duty''' into '''teams_users''' table to store the duty.
!Field Name !!Type !!Description
|-
!duty
|varchar(255)
|It would save this user's duty in this team.
|}

==Updates==

Below are the key files modified:

===Controllers===
1. expertiza/app/controllers/assignments_controller.rb:
def edit
a. add "role based assignment" option to review strategy section.
b. add roles to current assignment.
c. add questionnaires to these roles separately.
end

2. expertiza/app/controllers/questionnaires_controller.rb

===Models===

See [[#Design|Database Design]] section above.

===Views===
Below are the view files that we modified
1. When logged in as instructor, we modified files below:
1.1 Add a "role based" strategy checkbox here: expertiza/app/views/assignments/edit/_review_strategy.html.erb
1.2 Add roles input fields if you check the "role based" strategy checkbox: expertiza/app/views/assignments/edit/_review_strategy.html.erb
1.3 Create rubric to assign questionnaire based on duties: expertiza-developer/expertiza/app/views/assignments/edit/_rubrics.html.erb
& expertiza-developer/expertiza/app/helpers/assignment_helper.rb

2. When logged in as a student, we modified files below:
2.1 To show "select duty" and "update duty" option: expertiza/app/views/student_teams/view.html.erb
2.2 To show the form to select duty: expertiza/app/views/teams_users/edit.html.erb

1]View showing newly added checkbox for setting duty based option and allowing duty share

[[File:111.png]]

2]View showing different questionnaire for different teammates based on their duty
[[File:222.png]]

3]Assign questionnaire to teammates based on their duty

[[File:333.png]]

4]View showing "select duty" link for teammates. Every student can select their duty in the team.
[[File:444.png]]

[[File:555.png]]

5]After selecting, students can update their duty. Also, they will get the review questionnaire based on duty.
[[File:666.png]]

6]Review questionnaire based on duty

[[File:777.png]]

== Testing Details ==
In our project, we are providing an option of adding duty for different team members in an assignment and giving review options based on their duty. We will add following functionalities:
1. How instructor create assignment with duties/roles
2. How students take duties from a given list of duties
3. How teammate evaluation rubric assign different review questionnaire based on duty.

=== UI Testing ===
UI will be tested manually. First, we will test creating an assignment as an instructor with different duties and assign different review questionnaires to each duty. Then we will login in as a student and take a duty from given list of duties. We will try covering all edge case scenarios in test cases section.

=== Test Cases ===
Following will be the test cases:

1. Login in as an Instructor:

1.a] While creating an assignment, in the Review Strategy tab provide the list of roles/duties possible for teammates. There will be one text box to add
duty. To add more duties click on "add more".
1.b] Mark the check box that says multiple team members can have the same duty.
1.c] Go to the Rubrics tab and select different questionnaires for different duty.
After creating this assignment students should be able to see different duties in "Your Team" page and should be able to select any duty. Multiple students
should be able to select same duty.

2. Login in as an Instructor:

2.a] Repeat steps 1.a and 1.b
2.b] This time do not mark the check box that says "multiple team members can have the same duty".
After creating this assignment students should be able to see different duties in "Your Team" page. This time student should not be able to select a duty if
it was already selected.

3. Login in as a Student

When you login in as a student you should be able to pick different duties assigned by the instructor. If multiple members are not allowed to have same duty
then you should not be able to pick a duty if it was already selected by some other member.

4. Login in as a Reviewer

When you login in as a reviewer you should get the questionnaire based on your duty. For example, if you are a software engineer you should get the review
questionnaire assigned to software engineer.
Different roles will be assigned different questionnaires for review.

=== RSpec ===

For functional testing, we will use RSpec. It uses Behavior Driven Development (BDD) for testing functionality of the system. It provides way to describe specific functionality of the system being tested and helps in better visualization of test cases.

=== Capybara ===
We will use Capybara for automating the manual test cases. It is a web-based automation framework and coupled with RSpec. It allow developers to write the test cases which simulate the whole scenario of manual testing.

===Factory Girl===
We will use Factory Girl for creating data factory. Factory Girl is a Ruby Gem that allow users to create templates for valid and re-usable objects. It allows more customization when user instantiate the objects and it aims to ensure that user have a valid object to work with.

=== Sample Test cases ===
1. Verify if instructor can select duty option

it "selects duty based option" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
check("duty_based")
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10,
duty_based: true
)
end

2. Verify if instructor can correctly set the duty
it "sets duty " do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
check("duty_based")
check("allow_duty_share")
fill_in "assignment_form_assignment_duty_names", with: "developer, tester, analyst, writer, systest"
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10,
duty_based: true,
allow_duty_share: true,
duty_names: "developer, tester, analyst, writer, systest"
)
end

3. Veify if duty share is allowed

it "selects allow duty share option" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
check("duty_based")
check("allow_duty_share")
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10,
duty_based: true,
allow_duty_share: true
)
end

== Reference ==

Expertiza[https://github.com/expertiza/expertiza]

RSpec [http://rspec.info/]

ScrumRoles [http://scrummethodology.com/the-scrum-team-role]

CapyBara [https://github.com/jnicklas/capybara]

FactoryGirl [https://github.com/thoughtbot/factory_girl]

CSC/ECE 517 Fall 2016 E1676 Role-based reviewing

2016-12-13T18:22:12Z

Pjain12: /* Testing Details */

== Purpose ==
In the current version of Expertiza, members among a team can evaluate each other’s contribution and give appropriate scores based on the same questionnaire. However, in the lifetime of software development, members in a team often take on different roles whose works content are vastly differentiated. Like in an agile development environment, such as Scrum, there are typically [http://scrummethodology.com/the-scrum-team-role/ seven roles group members] can take: software engineer, architect, programmer, analyst, QA expert, tester and UI designers . Job description and evaluation entailed are vastly varied among these roles, thus a generic assessment rubric cannot hold reasonably.

The rationale of our project is that we want to give project members the option to evaluate each other's work based on the specific role or duty they take in the development process. This can ensure a reasonable assessment for different duties and can also help to improve the utility of using members-reviewing in the whole reviewing process.

== Task Description==
Task Description:
There are general three aspects we would do in order to achieve the Role-based reviewing function.

1) A new option (check box) would be added to the Review Strategy tab from the instructor view when he creates a new assignment. What’s more, the instructor can create different roles or duties available for the assignment by typing into a text filed. The instructor also has the power to allow multiple members to choose for the same duty.

2) In the Rubrics tab from the instructor view, New rubric would be generated by creating different questionnaires for different roles when adding new assignment.

3) A new option (drop box) would be added to the “Your team” page from the student view when an assignment was created to be role-based reviewing. Student can choose their roles or duties from the drop box which were generated by the instructor for this specific assignment. When the instructor enabled the multiple selection option, different members in the team can choose same duties for this assignment.

Tasks can be viewed more clearly by the graph below:

[[File:Drawing.png]]

== Design ==

=== Database Design ===
We have modified following three database tables to support role(duty) based reviewing:

1. assignment_questionnaires

2. assignments

3. teams_users

{| class="wikitable"
1] We have added following fields in '''assignment_questionnaires table'''
!Field Name !!Type !!Description
|-
!duty_name
|varchar(255)
|List of duties that students can choose in the given assignment
|}

{| class="wikitable"
2] We have added '''duty_based''', '''multiple_duty_based''' and '''all_duty_name''' into '''assignments''' table to store the duty name
!Field Name !!Type !!Description
|-
!duty_based
|boolean
|If the assignment's team is duty based, it should be '''true'''. If not, it should be '''false'''.
|-
!allow_duty_share
|boolean
|If multiple people could choose one duty in the assignment, it should be '''true'''. If not, it should be '''false'''.
|-
!duty_names
|varchar(255)
|It would save all kinds of duties in the assignment.
|}

{| class="wikitable"
3] We have added '''duty''' into '''teams_users''' table to store the duty.
!Field Name !!Type !!Description
|-
!duty
|varchar(255)
|It would save this user's duty in this team.
|}

==Updates==

Below are the key files modified:

===Controllers===
1. expertiza/app/controllers/assignments_controller.rb:
def edit
a. add "role based assignment" option to review strategy section.
b. add roles to current assignment.
c. add questionnaires to these roles separately.
end

2. expertiza/app/controllers/questionnaires_controller.rb

===Models===

See [[#Design|Database Design]] section above.

===Views===
Below are the view files that we modified
1. When logged in as instructor, we modified files below:
1.1 Add a "role based" strategy checkbox here: expertiza/app/views/assignments/edit/_review_strategy.html.erb
1.2 Add roles input fields if you check the "role based" strategy checkbox: expertiza/app/views/assignments/edit/_review_strategy.html.erb
1.3 Create rubric to assign questionnaire based on duties: expertiza-developer/expertiza/app/views/assignments/edit/_rubrics.html.erb
& expertiza-developer/expertiza/app/helpers/assignment_helper.rb

2. When logged in as a student, we modified files below:
2.1 To show "select duty" and "update duty" option: expertiza/app/views/student_teams/view.html.erb
2.2 To show the form to select duty: expertiza/app/views/teams_users/edit.html.erb

[[File:111.png]]

[[File:222.png]]

[[File:333.png]]

[[File:444.png]]

[[File:555.png]]

[[File:666.png]]

[[File:777.png]]

== Testing Details ==
In our project, we are providing an option of adding duty for different team members in an assignment and giving review options based on their duty. We will add following functionalities:
1. How instructor create assignment with duties/roles
2. How students take duties from a given list of duties
3. How teammate evaluation rubric assign different review questionnaire based on duty.

=== UI Testing ===
UI will be tested manually. First, we will test creating an assignment as an instructor with different duties and assign different review questionnaires to each duty. Then we will login in as a student and take a duty from given list of duties. We will try covering all edge case scenarios in test cases section.

=== Test Cases ===
Following will be the test cases:

1. Login in as an Instructor:

1.a] While creating an assignment, in the Review Strategy tab provide the list of roles/duties possible for teammates. There will be one text box to add
duty. To add more duties click on "add more".
1.b] Mark the check box that says multiple team members can have the same duty.
1.c] Go to the Rubrics tab and select different questionnaires for different duty.
After creating this assignment students should be able to see different duties in "Your Team" page and should be able to select any duty. Multiple students
should be able to select same duty.

2. Login in as an Instructor:

2.a] Repeat steps 1.a and 1.b
2.b] This time do not mark the check box that says "multiple team members can have the same duty".
After creating this assignment students should be able to see different duties in "Your Team" page. This time student should not be able to select a duty if
it was already selected.

3. Login in as a Student

When you login in as a student you should be able to pick different duties assigned by the instructor. If multiple members are not allowed to have same duty
then you should not be able to pick a duty if it was already selected by some other member.

4. Login in as a Reviewer

When you login in as a reviewer you should get the questionnaire based on your duty. For example, if you are a software engineer you should get the review
questionnaire assigned to software engineer.
Different roles will be assigned different questionnaires for review.

=== RSpec ===

For functional testing, we will use RSpec. It uses Behavior Driven Development (BDD) for testing functionality of the system. It provides way to describe specific functionality of the system being tested and helps in better visualization of test cases.

=== Capybara ===
We will use Capybara for automating the manual test cases. It is a web-based automation framework and coupled with RSpec. It allow developers to write the test cases which simulate the whole scenario of manual testing.

===Factory Girl===
We will use Factory Girl for creating data factory. Factory Girl is a Ruby Gem that allow users to create templates for valid and re-usable objects. It allows more customization when user instantiate the objects and it aims to ensure that user have a valid object to work with.

=== Sample Test cases ===
1. Verify if instructor can select duty option

it "selects duty based option" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
check("duty_based")
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10,
duty_based: true
)
end

2. Verify if instructor can correctly set the duty
it "sets duty " do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
check("duty_based")
check("allow_duty_share")
fill_in "assignment_form_assignment_duty_names", with: "developer, tester, analyst, writer, systest"
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10,
duty_based: true,
allow_duty_share: true,
duty_names: "developer, tester, analyst, writer, systest"
)
end

3. Veify if duty share is allowed

it "selects allow duty share option" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
check("duty_based")
check("allow_duty_share")
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10,
duty_based: true,
allow_duty_share: true
)
end

== Reference ==

Expertiza[https://github.com/expertiza/expertiza]

RSpec [http://rspec.info/]

ScrumRoles [http://scrummethodology.com/the-scrum-team-role]

CapyBara [https://github.com/jnicklas/capybara]

FactoryGirl [https://github.com/thoughtbot/factory_girl]

CSC/ECE 517 Fall 2016 E1676 Role-based reviewing

2016-12-03T02:33:36Z

Pjain12: /* Database Design */

== Purpose ==
In the current version of Expertiza, members among a team can evaluate each other’s contribution and give appropriate scores based on the same questionnaire. However, in the lifetime of software development, members in a team often take on different roles whose works content are vastly differentiated. Like in an agile development environment, such as Scrum, there are typically [http://scrummethodology.com/the-scrum-team-role/ seven roles group members] can take: software engineer, architect, programmer, analyst, QA expert, tester and UI designers . Job description and evaluation entailed are vastly varied among these roles, thus a generic assessment rubric cannot hold reasonably.

The purpose or the rationale of our project is that we want to give project members the option to evaluate each other's work based on the specific role or duty they take in the development process. This can ensure a reasonable assessment for different duties and can also help to improve the utility using members-reviewing in the whole reviewing process.

== Task Description==
Task Description:
There are general three aspects we would do in order to achieve the Role-based reviewing function.

1) A new option (check box) would be added to the Review Strategy tab from the instructor view when he creates a new assignment. What’s more, the instructor can create different roles or duties available for the assignment by typing into a text filed. The instructor also has the power to allow multiple members to choose for the same duty.

2) In the Rubrics tab from the instructor view, New rubric would be generated by creating different questionnaires for different roles when adding new assignment.

3) A new option (drop box) would be added to the “Your team” page from the student view when an assignment was created to be role-based reviewing. Student can choose their roles or duties from the drop box which were generated by the instructor for this specific assignment. When the instructor enabled the multiple selection option, different members in the team can choose same duties for this assignment.

Tasks can be viewed more clearly by the graph below:

[[File:Drawing.png]]

== Design ==

=== Database Design ===
We have modified following three database tables to support role(duty) based reviewing:

1. assignment_questionnaires

2. assignments

3. teams_users

{| class="wikitable"
1] We have added following fields in '''assignment_questionnaires table'''
!Field Name !!Type !!Description
|-
!duty_name
|varchar(255)
|List of duties that students can choose in the given assignment
|}

{| class="wikitable"
2] We have added '''duty_based''', '''multiple_duty_based''' and '''all_duty_name''' into '''assignments''' table to store the duty name
!Field Name !!Type !!Description
|-
!duty_based
|boolean
|If the assignment's team is duty based, it should be '''true'''. If not, it should be '''false'''.
|-
!allow_duty_share
|boolean
|If multiple people could choose one duty in the assignment, it should be '''true'''. If not, it should be '''false'''.
|-
!duty_names
|varchar(255)
|It would save all kinds of duties in the assignment.
|}

{| class="wikitable"
3] We have added '''duty''' into '''teams_users''' table to store the duty.
!Field Name !!Type !!Description
|-
!duty
|varchar(255)
|It would save this user's duty in this team.
|}

==Updates==

Below are the key files modified:

===Controllers===
1. expertiza/app/controllers/assignments_controller.rb:
def edit
a. add "role based assignment" option to review strategy section.
b. add roles to current assignment.
c. add questionnaires to these roles separately.
end

2. expertiza/app/controllers/questionnaires_controller.rb

===Models===

See [[#Design|Database Design]] section above.

===Views===
Below arethe files that we modified
1. When logged in as instructor, we modified below files
1.1 expertiza/app/views/assignments/edit/_review_strategy.html.erb
1.1. add a "role based" strategy checkbox here.
1.2. add roles input fields if you check the "role based" strategy checkbox.
1.32 . expertiza/app/views/assignments/edit/_rubrics.html.erb
/app/views/assignments/edit/_rubrics.html.erb

2. When logged in as a student, we modified below files:
2.1 To show "select duty" and "update duty" option: expertiza/app/views/student_teams/view.html.erb
2.2 To show the form to select duty: expertiza/app/views/teams_users/edit.html.erb

[[File:review_strategy.png]]
[[File:rubric_questionnaire.png]]

== Testing Details ==
In our project, we are providing an option of adding duty for different team members in an assignment and giving review options based on their duty. We will add following functionalities:
1. How instructor create assignment with duties/roles
2. How students take duties from a given list of duties
3. How teammate evaluation rubric assign different review questionnaire based on duty.

=== UI Testing ===
UI will be tested manually. First, we will test creating an assignment as an instructor with different duties and assign different review questionnaires to each duty. Then we will login in as a student and take a duty from given list of duties. We will try covering all edge case scenarios in test cases section.

=== Test Cases ===
Following will be the test cases:

1. Login in as an Instructor:

1.a] While creating an assignment, in the Review Strategy tab provide the list of roles/duties possible for teammates. There will be one text box to add
duty. To add more duties click on "add more".
1.b] Mark the check box that says multiple team members can have the same duty.
1.c] Go to the Rubrics tab and select different questionnaires for different duty.
After creating this assignment students should be able to see different duties in "Your Team" page and should be able to select any duty. Multiple students
should be able to select same duty.

2. Login in as an Instructor:

2.a] Repeat steps 1.a and 1.b
2.b] This time do not mark the check box that says "multiple team members can have the same duty".
After creating this assignment students should be able to see different duties in "Your Team" page. This time student should not be able to select a duty if
it was already selected.

3. Login in as a Student

When you login in as a student you should be able to pick different duties assigned by the instructor. If multiple members are not allowed to have same duty
then you should not be able to pick a duty if it was already selected by some other member.

4. Login in as a Reviewer

When you login in as a reviewer you should get the questionnaire based on your duty. For example, if you are a software engineer you should get the review
questionnaire assigned to software engineer.
Different roles will be assigned different questionnaires for review.

=== RSpec ===

For functional testing, we will use RSpec. It uses Behavior Driven Development (BDD) for testing functionality of the system. It provides way to describe specific functionality of the system being tested and helps in better visualization of test cases.

=== Capybara ===
We will use Capybara for automating the manual test cases. It is a web-based automation framework and coupled with RSpec. It allow developers to write the test cases which simulate the whole scenario of manual testing.

===Factory Girl===
We will use Factory Girl for creating data factory. Factory Girl is a Ruby Gem that allow users to create templates for valid and re-usable objects. It allows more customization when user instantiate the objects and it aims to ensure that user have a valid object to work with.

== Reference ==

Expertiza[https://github.com/expertiza/expertiza]

RSpec [http://rspec.info/]

ScrumRoles [http://scrummethodology.com/the-scrum-team-role]

CapyBara [https://github.com/jnicklas/capybara]

FactoryGirl [https://github.com/thoughtbot/factory_girl]

CSC/ECE 517 Fall 2016 E1676 Role-based reviewing

2016-12-03T02:11:00Z

Pjain12: /* Views */

== Purpose ==
In the current version of Expertiza, members among a team can evaluate each other’s contribution and give appropriate scores based on the same questionnaire. However, in the lifetime of software development, members in a team often take on different roles whose works content are vastly differentiated. Like in an agile development environment, such as Scrum, there are typically [http://scrummethodology.com/the-scrum-team-role/ seven roles group members] can take: software engineer, architect, programmer, analyst, QA expert, tester and UI designers . Job description and evaluation entailed are vastly varied among these roles, thus a generic assessment rubric cannot hold reasonably.

The purpose or the rationale of our project is that we want to give project members the option to evaluate each other's work based on the specific role or duty they take in the development process. This can ensure a reasonable assessment for different duties and can also help to improve the utility using members-reviewing in the whole reviewing process.

== Task Description==
Task Description:
There are general three aspects we would do in order to achieve the Role-based reviewing function.

1) A new option (check box) would be added to the Review Strategy tab from the instructor view when he creates a new assignment. What’s more, the instructor can create different roles or duties available for the assignment by typing into a text filed. The instructor also has the power to allow multiple members to choose for the same duty.

2) In the Rubrics tab from the instructor view, New rubric would be generated by creating different questionnaires for different roles when adding new assignment.

3) A new option (drop box) would be added to the “Your team” page from the student view when an assignment was created to be role-based reviewing. Student can choose their roles or duties from the drop box which were generated by the instructor for this specific assignment. When the instructor enabled the multiple selection option, different members in the team can choose same duties for this assignment.

Tasks can be viewed more clearly by the graph below:

[[File:Drawing.png]]

== Design ==

=== Database Design ===
{| class="wikitable"
We would create a new table called '''assignment_duties'''.
!Field Name !!Type !!Description
|-
!assignment_id
|int(11)
|
|-
!duty_name
|int(11)
|
|-
!questionnaire_id
|int(11)
|
|}

{| class="wikitable"
We should add '''duty_based''', '''multiple_duty_based''' and '''all_duty_name''' into '''assignments''' table to store the duty name
!Field Name !!Type !!Description
|-
!duty_based
|boolean
|If the assignment's team is duty based, it should be '''true'''. If not, it should be '''false'''.
|-
!allow_duty_share
|boolean
|If multiple people could choose one duty in the assignment, it should be '''true'''. If not, it should be '''false'''.
|-
!duty_names
|varchar(255)
|It would save all kinds of duties in the assignment.
|}

{| class="wikitable"
We should add '''duty''' into '''teams_users''' table to store the duty.
!Field Name !!Type !!Description
|-
!duty
|varchar(255)
|It would save this user's duty in this team.
|}

==Updates==

Below are the key files modified:

===Controllers===
1. expertiza/app/controllers/assignments_controller.rb:
def edit
a. add "role based assignment" option to review strategy section.
b. add roles to current assignment.
c. add questionnaires to these roles separately.
end

2. expertiza/app/controllers/questionnaires_controller.rb

===Models===

See [[#Design|Database Design]] section above.

===Views===
Below arethe files that we modified
1. When logged in as instructor, we modified below files
1.1 expertiza/app/views/assignments/edit/_review_strategy.html.erb
1.1. add a "role based" strategy checkbox here.
1.2. add roles input fields if you check the "role based" strategy checkbox.
1.32 . expertiza/app/views/assignments/edit/_rubrics.html.erb
/app/views/assignments/edit/_rubrics.html.erb

2. When logged in as a student, we modified below files:
2.1 To show "select duty" and "update duty" option: expertiza/app/views/student_teams/view.html.erb
2.2 To show the form to select duty: expertiza/app/views/teams_users/edit.html.erb

[[File:review_strategy.png]]

== Testing Details ==
In our project, we are providing an option of adding duty for different team members in an assignment and giving review options based on their duty. We will add following functionalities:
1. How instructor create assignment with duties/roles
2. How students take duties from a given list of duties
3. How teammate evaluation rubric assign different review questionnaire based on duty.

=== UI Testing ===
UI will be tested manually. First, we will test creating an assignment as an instructor with different duties and assign different review questionnaires to each duty. Then we will login in as a student and take a duty from given list of duties. We will try covering all edge case scenarios in test cases section.

=== Test Cases ===
Following will be the test cases:

1. Login in as an Instructor:

1.a] While creating an assignment, in the Review Strategy tab provide the list of roles/duties possible for teammates. There will be one text box to add
duty. To add more duties click on "add more".
1.b] Mark the check box that says multiple team members can have the same duty.
1.c] Go to the Rubrics tab and select different questionnaires for different duty.
After creating this assignment students should be able to see different duties in "Your Team" page and should be able to select any duty. Multiple students
should be able to select same duty.

2. Login in as an Instructor:

2.a] Repeat steps 1.a and 1.b
2.b] This time do not mark the check box that says "multiple team members can have the same duty".
After creating this assignment students should be able to see different duties in "Your Team" page. This time student should not be able to select a duty if
it was already selected.

3. Login in as a Student

When you login in as a student you should be able to pick different duties assigned by the instructor. If multiple members are not allowed to have same duty
then you should not be able to pick a duty if it was already selected by some other member.

4. Login in as a Reviewer

When you login in as a reviewer you should get the questionnaire based on your duty. For example, if you are a software engineer you should get the review
questionnaire assigned to software engineer.
Different roles will be assigned different questionnaires for review.

=== RSpec ===

For functional testing, we will use RSpec. It uses Behavior Driven Development (BDD) for testing functionality of the system. It provides way to describe specific functionality of the system being tested and helps in better visualization of test cases.

=== Capybara ===
We will use Capybara for automating the manual test cases. It is a web-based automation framework and coupled with RSpec. It allow developers to write the test cases which simulate the whole scenario of manual testing.

===Factory Girl===
We will use Factory Girl for creating data factory. Factory Girl is a Ruby Gem that allow users to create templates for valid and re-usable objects. It allows more customization when user instantiate the objects and it aims to ensure that user have a valid object to work with.

== Reference ==

Expertiza[https://github.com/expertiza/expertiza]

RSpec [http://rspec.info/]

ScrumRoles [http://scrummethodology.com/the-scrum-team-role]

CapyBara [https://github.com/jnicklas/capybara]

FactoryGirl [https://github.com/thoughtbot/factory_girl]

CSC/ECE 517 Fall 2016 E1676 Role-based reviewing

2016-11-09T06:39:02Z

Pjain12: /* Reference */

CSC/ECE 517 Fall 2016 E1676 Role-based reviewing

2016-11-09T06:34:13Z

Pjain12: /* Testing Details */

CSC/ECE 517 Fall 2016 E1676 Role-based reviewing

2016-11-09T06:30:49Z

Pjain12: /* Testing Details */

CSC/ECE 517 Spring 2016 E1676 Role-based reviewing

2016-11-09T06:09:34Z

Pjain12: /* Test Cases */

== Task Description==

== Purpose ==

===Rationale of using Scrum & Role based reviewing ===

== Design ==

=== UML Diagram ===
=== Design Pattern ===
=== Database Design ===

==Updates==

Below are the key files to be modified:
===Controllers===

===Models===

===Views===

== Testing Details ==
In our project, we are providing an option of adding duty for different team members in an assignment and giving review options based on their duty. We will add following functionalities:
1. How instructor create assignment with duties/roles
2. How students take duties from a given list of duties
3. How teammate evaluation rubric assign different review questionnaire based on duty.

=== UI Testing ===
UI will be tested manually. First, we will test creating an assignment as an instructor with different duties and assign different review questionnaires to each duty. Then we will login in as a student and take a duty from given list of duties. We will try covering all edge case scenarios in test cases section.

=== Test Cases ===
Following will be the test cases:

1. Login in as an Instructor:

1.a] While creating an assignment, in the Review Strategy tab provide the list of roles/duties possible for teammates. There will be one text box to add
duty. To add more duties click on "add more".
1.b] Mark the check box that says multiple team members can have the same duty.
1.c] Go to the Rubrics tab and select different questionnaires for different duty.
After creating this assignment students should be able to see different duties in "Your Team" page and should be able to select any duty. Multiple students
should be able to select same duty.

2. Login in as an Instructor:

2.a] Repeat steps 1.a and 1.b
2.b] This time do not mark the check box that says "multiple team members can have the same duty".
After creating this assignment students should be able to see different duties in "Your Team" page. This time student should not be able to select a duty if
it was already selected.

3. Login in as a Student

When you login in as a student you should be able to pick different duties assigned by the instructor. If multiple members are not allowed to have same duty
then you should not be able to pick a duty if it was already selected by some other member.

4. Login in as a Reviewer

When you login in as a reviewer you should get the questionnaire based on your duty. For example, if you are a software engineer you should get the review
questionnaire assigned to software engineer.
Different roles will be assigned different questionnaires for review.

=== RSpec ===

For functional testing, we will use RSpec. It uses Behavior Driven Development (BDD) for testing functionality of the system. It provides way to describe specific functionality of the system being tested and helps in better visualization of test cases.

=== Capybara ===
We will use Capybara for automating the manual test cases. It is a web-based automation framework and coupled with RSpec. It allow developers to write the test cases which simulate the whole scenario of manual testing.

===Factory Girl===
We will use Factory Girl for creating data factory. Factory Girl is a Ruby Gem that allow users to create templates for valid and re-usable objects. It allows more customization when user instantiate the objects and it aims to ensure that user have a valid object to work with.

== References ==

CSC/ECE 517 Spring 2016 E1676 Role-based reviewing

2016-11-09T06:06:01Z

Pjain12: /* Testing Details */

== Task Description==

== Purpose ==

===Rationale of using Scrum & Role based reviewing ===

== Design ==

=== UML Diagram ===
=== Design Pattern ===
=== Database Design ===

==Updates==

Below are the key files to be modified:
===Controllers===

===Models===

===Views===

== Testing Details ==
In our project, we are providing an option of adding duty for different team members in an assignment and giving review options based on their duty. We will add following functionalities:
1. How instructor create assignment with duties/roles
2. How students take duties from a given list of duties
3. How teammate evaluation rubric assign different review questionnaire based on duty.

=== UI Testing ===
UI will be tested manually. First, we will test creating an assignment as an instructor with different duties and assign different review questionnaires to each duty. Then we will login in as a student and take a duty from given list of duties. We will try covering all edge case scenarios in test cases section.

=== Test Cases ===
Following will be the test cases:

1. Login in as an Instructor:

1.a] While creating an assignment, in the Review Strategy tab provide the list of roles/duties possible for teammates. There will be one text box to add
duty. To add more duties click on "add more".
1.b] Mark the check box that says multiple team members can have the same duty.
1.c] Go to the Rubrics tab and select different questionnaires for different duty.
After creating this assignment students should be able to see different duties in "Your Team" page and should be able to select any duty. Multiple students
should be able to select same duty.

2. Login in as an Instructor:

2.a] Repeat steps 1.a and 1.b
2.b] This time do not mark the check box that says "multiple team members can have the same duty".
After creating this assignment students should be able to see different duties in "Your Team" page. This time student should not be able to select a duty if
it was already selected.

3. Login in as a Student

When you login in as a student you should be able to pick different duties assigned by the instructor. If multiple members are not allowed to have same duty
then you should not be able to pick a duty if it was already selected by some other member.

4. Login in as a Review

When you login in as a reviewer you should get the questionnaire based on your duty. For example, if you are a software engineer you should get the review
questionnaire assigned to software engineer.

Different roles will be assigned different questionnaires for review.

=== RSpec ===

For functional testing, we will use RSpec. It uses Behavior Driven Development (BDD) for testing functionality of the system. It provides way to describe specific functionality of the system being tested and helps in better visualization of test cases.

=== Capybara ===
We will use Capybara for automating the manual test cases. It is a web-based automation framework and coupled with RSpec. It allow developers to write the test cases which simulate the whole scenario of manual testing.

===Factory Girl===
We will use Factory Girl for creating data factory. Factory Girl is a Ruby Gem that allow users to create templates for valid and re-usable objects. It allows more customization when user instantiate the objects and it aims to ensure that user have a valid object to work with.

== References ==

CSC/ECE 517 Spring 2016 E1676 Role-based reviewing

2016-11-08T19:28:42Z

Pjain12: /* Updates */

CSC/ECE 517 Spring 2016 E1676 Role-based reviewing

2016-11-08T19:28:10Z

Pjain12: /* Design */

CSC/ECE 517 Spring 2016 E1676 Role-based reviewing

2016-11-08T19:25:15Z

Pjain12: /* Testing Details */

== Task Description==

== Purpose ==

===Rationale of using Scrum & Role based reviewing ===

== Design ==

=== Database Design ===

==Updates==

Below are the key files modified:
===Controllers===

===Models===

===Views===

== Testing Details ==
=== UI Testing ===

=== Test Cases ===

=== RSpec ===

===Factory Girl===

===Running RSpec===

===Test Cases===

== References ==

CSC/ECE 517 Spring 2016 E1676 Role-based reviewing

2016-11-08T19:24:29Z

Pjain12: /* Testing Details */

== Task Description==

== Purpose ==

===Rationale of using Scrum & Role based reviewing ===

== Design ==

=== Database Design ===

==Updates==

Below are the key files modified:
===Controllers===

===Models===

===Views===

== Testing Details ==
=== UI Testing ====

=== Test Cases ====

=== RSpec ===

===Factory Girl===

===Running RSpec===

===Test Cases===

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-11-05T03:06:46Z

Pjain12:

=='''Background'''==
Expertiza is an open source web-based platform for the organizing and management of student project submissions and their evaluation, that supports augmentation of subject knowledge and accelerated learning via peer reviews. The application is meant for two types of users, instructors and students to use the application. Instructor can create and manage a course, enroll students in the course, create, manage and personalize assignments, project submissions and reviews for the particular course. Students can make their project submissions for the assignments allocated to them by their instructors for a course, give peer reviews, teammate reviews, create quizzes for their project reviewers, provide feedbacks and view their grades.

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

===Files Modified===
* assignment_creation_spec.rb (Capybara spec file)
* factories.rb (FactoryGirl's factory file

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===1. Fixes in existing broken Test Cases===

Due to continual development of Expertiza, some of the existing test cases that were implemented with relatively older version of Expertiza were found broken at the starting of the project.
To make the assignment creation testing complete, and to avoid covering the same scenarios again by adding new working test cases unnecessarily, these test case were fixed. Some of the fixes that were provided as part of this project are as follows:

1. Some of the functionalities for which the test cases were written have been remodeled so they had to be skipped.

2. Running the test cases were giving an error in the code, when fetching a row from the deadline type table.
* We noticed that the structure of the test file was wrong. The code to populate the the "deadline types" did not run, but were supposed to run for each test case. We made this code run for all test cases.

3. Rubrics test cases were searching for links that weren't present on the page. These issues were also fixed.

===2. Modified and Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment: ''This test will check if public assignments are getting created properly or not with proper attributes.

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment: ''This test will check if private assignments are getting created or not with proper attributes.
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team: '' This test will check the creation of new private assignment for the team. The maximum size of the team is 3 and the test will check if all these features are there or not.
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz: '' This test will check the creation of new private assignment with the quiz. The maximum number of questions in the quiz is 3 and the test will check if all these features are present or not.
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with review visible to all reviewers: '' This test will check the creation of new private assignment with review visible to all the reviewers.
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''f. Create public micro-task assignment: '' This test will check creation of new public assignment with microtasks.
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''g. Create calibrated public assignment: '' This test will check creation of new calibrated public assignment.
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students: '' This test will edit the existing assignment and enable micro tasks and calibrated options. The test will verify if all these options are updated in the assignment.
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students: '' This test will check the feature of editing the number of quizzes in the existing assignment.
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment: ''This test will check the feature of editing the maximum number of members in a team for an assignment.
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers: ''This test will verify the feature of adding/removing review visible to all the reviewers for an assignment.
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics: '' This test will verify that adding teams and team members in an assignment will create one more row of teammate review in rubrics.
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab: ''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. Edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. Edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic :'' This test will check feature of adding new topic for an assignment.
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic: ''This test will check feature of deleting new topic for an assignment.
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric: ''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. Loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. Set the deadline for an assignment review: '' This function will test if deadlines are getting assigned properly or not for the review.
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment: '' This test will verify if an instructor is able to assign new participants to an assignment.
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants: ''This test will verify if assignments are properly assigned to participants. Participants should be able to see newly assigned assignment in their page.
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course: ''' It will check an assignment can be added to the course
it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Test the new code'''==
We have uploaded video showing how the tests are run and their result.
If user wants to test the newly added feature test, please clone the master branch of our git repository
and perform following steps:

1. git clone http://github.com/dbzvishal/expertiza/

2. cd expertiza

3. rspec spec/features/assignment_creation_spec.rb

=='''Automated Execution via Travis'''==
Activated github repository in travis. Whenever we push changes in our repository, travis will start building and run all test cases.
At the end, it will give the final result consisting of the number of test cases passed and failed and the overall build result.
Travis result
[https://travis-ci.org/Jainpriyal/expertiza]

=='''References'''==
1. Github Expertiza[https://github.com/expertiza/expertiza]

2. RSpec [http://rspec.info/]

3. Capybara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T02:00:11Z

Pjain12: /* Newly Added Test Cases */

=='''Background'''==
Expertiza is an open source web-based platform for the organizing and management of student project submissions and their evaluation, that supports augmentation of subject knowledge and accelerated learning via peer reviews. The application is meant for two types of users, instructors and students to use the application. Instructor can create and manage a course, enroll students in the course, create, manage and personalize assignments, project submissions and reviews for the particular course. Students can make their project submissions for the assignments allocated to them by their instructors for a course, give peer reviews, teammate reviews, create quizzes for their project reviewers, provide feedbacks and view their grades.

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

===Files Modified===
* assignment_creation_spec.rb (Capybara spec file)
* factories.rb (FactoryGirl's factory file

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===1. Fixes in existing broken Test Cases===

Due to continual development of Expertiza, some of the existing test cases that were implemented with relatively older version of Expertiza were found broken at the starting of the project.
To make the assignment creation testing complete, and to avoid covering the same scenarios again by adding new working test cases unnecessarily, these test case were fixed. Some of the fixes that were provided as part of this project are as follows:

1. Some of the functionalities for which the test cases were written have been remodeled so they had to be skipped.

2. Running the test cases were giving an error in the code, when fetching a row from the deadline type table.
* We noticed that the structure of the test file was wrong. The code to populate the the "deadline types" did not run, but were supposed to run for each test case. We made this code run for all test cases.

3. Rubrics test cases were searching for links that weren't present on the page. These issues were also fixed.

===2. Modified and Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment: ''This test will check if public assignments are getting created properly or not with proper attributes.

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment: ''This test will check if private assignments are getting created or not with proper attributes.
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team: '' This test will check the creation of new private assignment for the team. The maximum size of the team is 3 and the test will check if all these features are there or not.
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz: '' This test will check the creation of new private assignment with the quiz. The maximum number of questions in the quiz is 3 and the test will check if all these features are present or not.
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with review visible to all reviewers: '' This test will check the creation of new private assignment with review visible to all the reviewers.
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''f. Create public micro-task assignment: '' This test will check creation of new public assignment with microtasks.
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''g. Create calibrated public assignment: '' This test will check creation of new calibrated public assignment.
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students: '' This test will edit the existing assignment and enable micro tasks and calibrated options. The test will verify if all these options are updated in the assignment.
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students: '' This test will check the feature of editing the number of quizzes in the existing assignment.
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment: ''This test will check the feature of editing the maximum number of members in a team for an assignment.
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers: ''This test will verify the feature of adding/removing review visible to all the reviewers for an assignment.
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics: '' This test will verify that adding teams and team members in an assignment will create one more row of teammate review in rubrics.
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab: ''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. Edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. Edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic :'' This test will check feature of adding new topic for an assignment.
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic: ''This test will check feature of deleting new topic for an assignment.
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric: ''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. Loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. Set the deadline for an assignment review: '' This function will test if deadlines are getting assigned properly or not for the review.
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment: '' This test will verify if an instructor is able to assign new participants to an assignment.
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants: ''This test will verify if assignments are properly assigned to participants. Participants should be able to see newly assigned assignment in their page.
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course: ''' It will check an assignment can be added to the course
it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==
Activated github repository in travis. Whenever we push changes in our repository, travis will start building and run all test cases.
At the end, it will give the final result consisting of the number of test cases passed and failed and the overall build result.
Travis result
[https://travis-ci.org/Jainpriyal/expertiza]

=='''References'''==
1. Github Expertiza[https://github.com/expertiza/expertiza]

2. RSpec [http://rspec.info/]

3. Capybara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T01:59:48Z

Pjain12: /* Fixes in existing broken Test Cases */

=='''Background'''==
Expertiza is an open source web-based platform for the organizing and management of student project submissions and their evaluation, that supports augmentation of subject knowledge and accelerated learning via peer reviews. The application is meant for two types of users, instructors and students to use the application. Instructor can create and manage a course, enroll students in the course, create, manage and personalize assignments, project submissions and reviews for the particular course. Students can make their project submissions for the assignments allocated to them by their instructors for a course, give peer reviews, teammate reviews, create quizzes for their project reviewers, provide feedbacks and view their grades.

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

===Files Modified===
* assignment_creation_spec.rb (Capybara spec file)
* factories.rb (FactoryGirl's factory file

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===1. Fixes in existing broken Test Cases===

Due to continual development of Expertiza, some of the existing test cases that were implemented with relatively older version of Expertiza were found broken at the starting of the project.
To make the assignment creation testing complete, and to avoid covering the same scenarios again by adding new working test cases unnecessarily, these test case were fixed. Some of the fixes that were provided as part of this project are as follows:

1. Some of the functionalities for which the test cases were written have been remodeled so they had to be skipped.

2. Running the test cases were giving an error in the code, when fetching a row from the deadline type table.
* We noticed that the structure of the test file was wrong. The code to populate the the "deadline types" did not run, but were supposed to run for each test case. We made this code run for all test cases.

3. Rubrics test cases were searching for links that weren't present on the page. These issues were also fixed.

===Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment: ''This test will check if public assignments are getting created properly or not with proper attributes.

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment: ''This test will check if private assignments are getting created or not with proper attributes.
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team: '' This test will check the creation of new private assignment for the team. The maximum size of the team is 3 and the test will check if all these features are there or not.
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz: '' This test will check the creation of new private assignment with the quiz. The maximum number of questions in the quiz is 3 and the test will check if all these features are present or not.
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with review visible to all reviewers: '' This test will check the creation of new private assignment with review visible to all the reviewers.
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''f. Create public micro-task assignment: '' This test will check creation of new public assignment with microtasks.
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''g. Create calibrated public assignment: '' This test will check creation of new calibrated public assignment.
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students: '' This test will edit the existing assignment and enable micro tasks and calibrated options. The test will verify if all these options are updated in the assignment.
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students: '' This test will check the feature of editing the number of quizzes in the existing assignment.
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment: ''This test will check the feature of editing the maximum number of members in a team for an assignment.
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers: ''This test will verify the feature of adding/removing review visible to all the reviewers for an assignment.
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics: '' This test will verify that adding teams and team members in an assignment will create one more row of teammate review in rubrics.
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab: ''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. Edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. Edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic :'' This test will check feature of adding new topic for an assignment.
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic: ''This test will check feature of deleting new topic for an assignment.
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric: ''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. Loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. Set the deadline for an assignment review: '' This function will test if deadlines are getting assigned properly or not for the review.
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment: '' This test will verify if an instructor is able to assign new participants to an assignment.
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants: ''This test will verify if assignments are properly assigned to participants. Participants should be able to see newly assigned assignment in their page.
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course: ''' It will check an assignment can be added to the course
it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==
Activated github repository in travis. Whenever we push changes in our repository, travis will start building and run all test cases.
At the end, it will give the final result consisting of the number of test cases passed and failed and the overall build result.
Travis result
[https://travis-ci.org/Jainpriyal/expertiza]

=='''References'''==
1. Github Expertiza[https://github.com/expertiza/expertiza]

2. RSpec [http://rspec.info/]

3. Capybara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T01:58:39Z

Pjain12: /* Automated Execution via Travis */

=='''Background'''==
Expertiza is an open source web-based platform for the organizing and management of student project submissions and their evaluation, that supports augmentation of subject knowledge and accelerated learning via peer reviews. The application is meant for two types of users, instructors and students to use the application. Instructor can create and manage a course, enroll students in the course, create, manage and personalize assignments, project submissions and reviews for the particular course. Students can make their project submissions for the assignments allocated to them by their instructors for a course, give peer reviews, teammate reviews, create quizzes for their project reviewers, provide feedbacks and view their grades.

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

===Files Modified===
* assignment_creation_spec.rb (Capybara spec file)
* factories.rb (FactoryGirl's factory file

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===Fixes in existing broken Test Cases===

Due to continual development of Expertiza, some of the existing test cases that were implemented with relatively older version of Expertiza were found broken at the starting of the project.
To make the assignment creation testing complete, and to avoid covering the same scenarios again by adding new working test cases unnecessarily, these test case were fixed. Some of the fixes that were provided as part of this project are as follows:

1. Some of the functionalities for which the test cases were written have been remodeled so they had to be skipped.

2. Running the test cases were giving an error in the code, when fetching a row from the deadline type table.
* We noticed that the structure of the test file was wrong. The code to populate the the "deadline types" did not run, but were supposed to run for each test case. We made this code run for all test cases.

3. Rubrics test cases were searching for links that weren't present on the page. These issues were also fixed.

===Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment: ''This test will check if public assignments are getting created properly or not with proper attributes.

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment: ''This test will check if private assignments are getting created or not with proper attributes.
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team: '' This test will check the creation of new private assignment for the team. The maximum size of the team is 3 and the test will check if all these features are there or not.
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz: '' This test will check the creation of new private assignment with the quiz. The maximum number of questions in the quiz is 3 and the test will check if all these features are present or not.
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with review visible to all reviewers: '' This test will check the creation of new private assignment with review visible to all the reviewers.
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''f. Create public micro-task assignment: '' This test will check creation of new public assignment with microtasks.
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''g. Create calibrated public assignment: '' This test will check creation of new calibrated public assignment.
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students: '' This test will edit the existing assignment and enable micro tasks and calibrated options. The test will verify if all these options are updated in the assignment.
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students: '' This test will check the feature of editing the number of quizzes in the existing assignment.
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment: ''This test will check the feature of editing the maximum number of members in a team for an assignment.
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers: ''This test will verify the feature of adding/removing review visible to all the reviewers for an assignment.
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics: '' This test will verify that adding teams and team members in an assignment will create one more row of teammate review in rubrics.
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab: ''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. Edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. Edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic :'' This test will check feature of adding new topic for an assignment.
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic: ''This test will check feature of deleting new topic for an assignment.
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric: ''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. Loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. Set the deadline for an assignment review: '' This function will test if deadlines are getting assigned properly or not for the review.
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment: '' This test will verify if an instructor is able to assign new participants to an assignment.
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants: ''This test will verify if assignments are properly assigned to participants. Participants should be able to see newly assigned assignment in their page.
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course: ''' It will check an assignment can be added to the course
it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==
Activated github repository in travis. Whenever we push changes in our repository, travis will start building and run all test cases.
At the end, it will give the final result consisting of the number of test cases passed and failed and the overall build result.
Travis result
[https://travis-ci.org/Jainpriyal/expertiza]

=='''References'''==
1. Github Expertiza[https://github.com/expertiza/expertiza]

2. RSpec [http://rspec.info/]

3. Capybara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T01:57:54Z

Pjain12: /* Automated Execution via Travis */

=='''Background'''==
Expertiza is an open source web-based platform for the organizing and management of student project submissions and their evaluation, that supports augmentation of subject knowledge and accelerated learning via peer reviews. The application is meant for two types of users, instructors and students to use the application. Instructor can create and manage a course, enroll students in the course, create, manage and personalize assignments, project submissions and reviews for the particular course. Students can make their project submissions for the assignments allocated to them by their instructors for a course, give peer reviews, teammate reviews, create quizzes for their project reviewers, provide feedbacks and view their grades.

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

===Files Modified===
* assignment_creation_spec.rb (Capybara spec file)
* factories.rb (FactoryGirl's factory file

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===Fixes in existing broken Test Cases===

Due to continual development of Expertiza, some of the existing test cases that were implemented with relatively older version of Expertiza were found broken at the starting of the project.
To make the assignment creation testing complete, and to avoid covering the same scenarios again by adding new working test cases unnecessarily, these test case were fixed. Some of the fixes that were provided as part of this project are as follows:

1. Some of the functionalities for which the test cases were written have been remodeled so they had to be skipped.

2. Running the test cases were giving an error in the code, when fetching a row from the deadline type table.
* We noticed that the structure of the test file was wrong. The code to populate the the "deadline types" did not run, but were supposed to run for each test case. We made this code run for all test cases.

3. Rubrics test cases were searching for links that weren't present on the page. These issues were also fixed.

===Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment: ''This test will check if public assignments are getting created properly or not with proper attributes.

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment: ''This test will check if private assignments are getting created or not with proper attributes.
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team: '' This test will check the creation of new private assignment for the team. The maximum size of the team is 3 and the test will check if all these features are there or not.
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz: '' This test will check the creation of new private assignment with the quiz. The maximum number of questions in the quiz is 3 and the test will check if all these features are present or not.
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with review visible to all reviewers: '' This test will check the creation of new private assignment with review visible to all the reviewers.
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''f. Create public micro-task assignment: '' This test will check creation of new public assignment with microtasks.
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''g. Create calibrated public assignment: '' This test will check creation of new calibrated public assignment.
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students: '' This test will edit the existing assignment and enable micro tasks and calibrated options. The test will verify if all these options are updated in the assignment.
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students: '' This test will check the feature of editing the number of quizzes in the existing assignment.
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment: ''This test will check the feature of editing the maximum number of members in a team for an assignment.
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers: ''This test will verify the feature of adding/removing review visible to all the reviewers for an assignment.
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics: '' This test will verify that adding teams and team members in an assignment will create one more row of teammate review in rubrics.
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab: ''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. Edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. Edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic :'' This test will check feature of adding new topic for an assignment.
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic: ''This test will check feature of deleting new topic for an assignment.
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric: ''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. Loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. Set the deadline for an assignment review: '' This function will test if deadlines are getting assigned properly or not for the review.
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment: '' This test will verify if an instructor is able to assign new participants to an assignment.
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants: ''This test will verify if assignments are properly assigned to participants. Participants should be able to see newly assigned assignment in their page.
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course: ''' It will check an assignment can be added to the course
it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==
Activated github repository in travis. Whenever we push changes in our repository, travis will start building and run all test cases.
At the end, it will give the final result consisting of the number of test cases passed and failed and the overall build result.
Travis result
[[https://travis-ci.org/Jainpriyal/expertiza]]

=='''References'''==
1. Github Expertiza[https://github.com/expertiza/expertiza]

2. RSpec [http://rspec.info/]

3. Capybara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T01:57:31Z

Pjain12: /* Automated Execution via Travis */

=='''Background'''==
Expertiza is an open source web-based platform for the organizing and management of student project submissions and their evaluation, that supports augmentation of subject knowledge and accelerated learning via peer reviews. The application is meant for two types of users, instructors and students to use the application. Instructor can create and manage a course, enroll students in the course, create, manage and personalize assignments, project submissions and reviews for the particular course. Students can make their project submissions for the assignments allocated to them by their instructors for a course, give peer reviews, teammate reviews, create quizzes for their project reviewers, provide feedbacks and view their grades.

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

===Files Modified===
* assignment_creation_spec.rb (Capybara spec file)
* factories.rb (FactoryGirl's factory file

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===Fixes in existing broken Test Cases===

Due to continual development of Expertiza, some of the existing test cases that were implemented with relatively older version of Expertiza were found broken at the starting of the project.
To make the assignment creation testing complete, and to avoid covering the same scenarios again by adding new working test cases unnecessarily, these test case were fixed. Some of the fixes that were provided as part of this project are as follows:

1. Some of the functionalities for which the test cases were written have been remodeled so they had to be skipped.

2. Running the test cases were giving an error in the code, when fetching a row from the deadline type table.
* We noticed that the structure of the test file was wrong. The code to populate the the "deadline types" did not run, but were supposed to run for each test case. We made this code run for all test cases.

3. Rubrics test cases were searching for links that weren't present on the page. These issues were also fixed.

===Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment: ''This test will check if public assignments are getting created properly or not with proper attributes.

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment: ''This test will check if private assignments are getting created or not with proper attributes.
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team: '' This test will check the creation of new private assignment for the team. The maximum size of the team is 3 and the test will check if all these features are there or not.
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz: '' This test will check the creation of new private assignment with the quiz. The maximum number of questions in the quiz is 3 and the test will check if all these features are present or not.
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with review visible to all reviewers: '' This test will check the creation of new private assignment with review visible to all the reviewers.
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''f. Create public micro-task assignment: '' This test will check creation of new public assignment with microtasks.
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''g. Create calibrated public assignment: '' This test will check creation of new calibrated public assignment.
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students: '' This test will edit the existing assignment and enable micro tasks and calibrated options. The test will verify if all these options are updated in the assignment.
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students: '' This test will check the feature of editing the number of quizzes in the existing assignment.
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment: ''This test will check the feature of editing the maximum number of members in a team for an assignment.
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers: ''This test will verify the feature of adding/removing review visible to all the reviewers for an assignment.
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics: '' This test will verify that adding teams and team members in an assignment will create one more row of teammate review in rubrics.
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab: ''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. Edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. Edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic :'' This test will check feature of adding new topic for an assignment.
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic: ''This test will check feature of deleting new topic for an assignment.
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric: ''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. Loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. Set the deadline for an assignment review: '' This function will test if deadlines are getting assigned properly or not for the review.
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment: '' This test will verify if an instructor is able to assign new participants to an assignment.
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants: ''This test will verify if assignments are properly assigned to participants. Participants should be able to see newly assigned assignment in their page.
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course: ''' It will check an assignment can be added to the course
it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==
Activated github repository in travis. Whenever we push changes in our repository, travis will start building and run all test cases.
At the end, it will give the final result consisting of the number of test cases passed and failed and the overall build result.
Travis result
[https://travis-ci.org/Jainpriyal/expertiza]

=='''References'''==
1. Github Expertiza[https://github.com/expertiza/expertiza]

2. RSpec [http://rspec.info/]

3. Capybara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T01:56:46Z

Pjain12: /* Automated Execution via Travis */

=='''Background'''==
Expertiza is an open source web-based platform for the organizing and management of student project submissions and their evaluation, that supports augmentation of subject knowledge and accelerated learning via peer reviews. The application is meant for two types of users, instructors and students to use the application. Instructor can create and manage a course, enroll students in the course, create, manage and personalize assignments, project submissions and reviews for the particular course. Students can make their project submissions for the assignments allocated to them by their instructors for a course, give peer reviews, teammate reviews, create quizzes for their project reviewers, provide feedbacks and view their grades.

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

===Files Modified===
* assignment_creation_spec.rb (Capybara spec file)
* factories.rb (FactoryGirl's factory file

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===Fixes in existing broken Test Cases===

Due to continual development of Expertiza, some of the existing test cases that were implemented with relatively older version of Expertiza were found broken at the starting of the project.
To make the assignment creation testing complete, and to avoid covering the same scenarios again by adding new working test cases unnecessarily, these test case were fixed. Some of the fixes that were provided as part of this project are as follows:

1. Some of the functionalities for which the test cases were written have been remodeled so they had to be skipped.

2. Running the test cases were giving an error in the code, when fetching a row from the deadline type table.
* We noticed that the structure of the test file was wrong. The code to populate the the "deadline types" did not run, but were supposed to run for each test case. We made this code run for all test cases.

3. Rubrics test cases were searching for links that weren't present on the page. These issues were also fixed.

===Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment: ''This test will check if public assignments are getting created properly or not with proper attributes.

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment: ''This test will check if private assignments are getting created or not with proper attributes.
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team: '' This test will check the creation of new private assignment for the team. The maximum size of the team is 3 and the test will check if all these features are there or not.
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz: '' This test will check the creation of new private assignment with the quiz. The maximum number of questions in the quiz is 3 and the test will check if all these features are present or not.
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with staggered deadline : ''
it "is able to create with staggered deadline" do
skip('skip test on staggered deadline temporarily')
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
begin
check("assignment_form_assignment_staggered_deadline")
rescue
return
end
page.driver.browser.switch_to.alert.accept
click_button 'Create'
fill_in 'assignment_form_assignment_days_between_submissions', with: 7
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
pending(%(not sure what's broken here but the error is: #ActionController::RoutingError: No route matches [GET]
"/asset/staggered_deadline_assignment_grap/graph_1.jpg"))
expect(assignment).to have_attributes(
staggered_deadline: true
)
end

''f. Create Assignment with review visible to all reviewers: '' This test will check the creation of new private assignment with review visible to all the reviewers.
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''g. Create public micro-task assignment: '' This test will check creation of new public assignment with microtasks.
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''h. create calibrated public assignment: '' This test will check creation of new calibrated public assignment.
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students: '' This test will edit the existing assignment and enable micro tasks and calibrated options. The test will verify if all these options are updated in the assignment.
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students: '' This test will check the feature of editing the number of quizzes in the existing assignment.
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment: ''This test will check the feature of editing the maximum number of members in a team for an assignment.
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers: ''This test will verify the feature of adding/removing review visible to all the reviewers for an assignment.
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics: '' This test will verify that adding teams and team members in an assignment will create one more row of teammate review in rubrics.
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab: ''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic :'' This test will check feature of adding new topic for an assignment.
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic: ''This test will check feature of deleting new topic for an assignment.
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric: ''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. set the deadline for an assignment review: '' This function will test if deadlines are getting assigned properly or not for the review.
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment: '' This test will verify if an instructor is able to assign new participants to an assignment.
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants: ''This test will verify if assignments are properly assigned to participants. Participants should be able to see newly assigned assignment in their page.
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course: ''' It will check an assignment can be added to the course
it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==
Activated github repository in travis. Whenever we push changes in our repository, travis will start building and run all test cases.
At the end, it will give the final result consisting of the number of test cases passed and failed and the overall build result.

=='''References'''==
1. Github Expertiza[https://github.com/expertiza/expertiza]

2. RSpec [http://rspec.info/]

3. Capybara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T01:53:27Z

Pjain12: /* Newly Added Test Cases */

=='''Background'''==
Expertiza is an open source web-based platform for the organizing and management of student project submissions and their evaluation, that supports augmentation of subject knowledge and accelerated learning via peer reviews. The application is meant for two types of users, instructors and students to use the application. Instructor can create and manage a course, enroll students in the course, create, manage and personalize assignments, project submissions and reviews for the particular course. Students can make their project submissions for the assignments allocated to them by their instructors for a course, give peer reviews, teammate reviews, create quizzes for their project reviewers, provide feedbacks and view their grades.

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

===Files Modified===
* assignment_creation_spec.rb (Capybara spec file)
* factories.rb (FactoryGirl's factory file

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===Fixes in existing broken Test Cases===

Due to continual development of Expertiza, some of the existing test cases that were implemented with relatively older version of Expertiza were found broken at the starting of the project.
To make the assignment creation testing complete, and to avoid covering the same scenarios again by adding new working test cases unnecessarily, these test case were fixed. Some of the fixes that were provided as part of this project are as follows:

1. Some of the functionalities for which the test cases were written have been remodeled so they had to be skipped.

2. Running the test cases were giving an error in the code, when fetching a row from the deadline type table.
* We noticed that the structure of the test file was wrong. The code to populate the the "deadline types" did not run, but were supposed to run for each test case. We made this code run for all test cases.

3. Rubrics test cases were searching for links that weren't present on the page. These issues were also fixed.

===Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment: ''This test will check if public assignments are getting created properly or not with proper attributes.

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment: ''This test will check if private assignments are getting created or not with proper attributes.
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team: '' This test will check the creation of new private assignment for the team. The maximum size of the team is 3 and the test will check if all these features are there or not.
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz: '' This test will check the creation of new private assignment with the quiz. The maximum number of questions in the quiz is 3 and the test will check if all these features are present or not.
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with staggered deadline : ''
it "is able to create with staggered deadline" do
skip('skip test on staggered deadline temporarily')
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
begin
check("assignment_form_assignment_staggered_deadline")
rescue
return
end
page.driver.browser.switch_to.alert.accept
click_button 'Create'
fill_in 'assignment_form_assignment_days_between_submissions', with: 7
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
pending(%(not sure what's broken here but the error is: #ActionController::RoutingError: No route matches [GET]
"/asset/staggered_deadline_assignment_grap/graph_1.jpg"))
expect(assignment).to have_attributes(
staggered_deadline: true
)
end

''f. Create Assignment with review visible to all reviewers: '' This test will check the creation of new private assignment with review visible to all the reviewers.
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''g. Create public micro-task assignment: '' This test will check creation of new public assignment with microtasks.
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''h. create calibrated public assignment: '' This test will check creation of new calibrated public assignment.
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students: '' This test will edit the existing assignment and enable micro tasks and calibrated options. The test will verify if all these options are updated in the assignment.
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students: '' This test will check the feature of editing the number of quizzes in the existing assignment.
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment: ''This test will check the feature of editing the maximum number of members in a team for an assignment.
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers: ''This test will verify the feature of adding/removing review visible to all the reviewers for an assignment.
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics: '' This test will verify that adding teams and team members in an assignment will create one more row of teammate review in rubrics.
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab: ''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic :'' This test will check feature of adding new topic for an assignment.
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic: ''This test will check feature of deleting new topic for an assignment.
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric: ''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. set the deadline for an assignment review: '' This function will test if deadlines are getting assigned properly or not for the review.
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment: '' This test will verify if an instructor is able to assign new participants to an assignment.
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants: ''This test will verify if assignments are properly assigned to participants. Participants should be able to see newly assigned assignment in their page.
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course: ''' It will check an assignment can be added to the course
it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==

=='''References'''==
1. Github Expertiza[https://github.com/expertiza/expertiza]

2. RSpec [http://rspec.info/]

3. Capybara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T01:33:50Z

Pjain12: /* Newly Added Test Cases */

=='''Background'''==
Expertiza is an open source web-based platform for the organizing and management of student project submissions and their evaluation, that supports augmentation of subject knowledge and accelerated learning via peer reviews. The application is meant for two types of users, instructors and students to use the application. Instructor can create and manage a course, enroll students in the course, create, manage and personalize assignments, project submissions and reviews for the particular course. Students can make their project submissions for the assignments allocated to them by their instructors for a course, give peer reviews, teammate reviews, create quizzes for their project reviewers, provide feedbacks and view their grades.

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===Fixes in existing broken Test Cases===

Due to continual development of Expertiza, some of the existing test cases that were implemented with relatively older version of Expertiza were found broken at the starting of the project.
To make the assignment creation testing complete, and to avoid covering the same scenarios again by adding new working test cases unnecessarily, these test case were fixed. Some of the fixes that were provided as part of this project are as follows:

1. Some of the functionalities for which the test cases were written have been remodeled so they had to be skipped.

2. Running the test cases were giving an error in the code, when fetching a row from the deadline type table.
* We noticed that the structure of the test file was wrong. The code to populate the the "deadline types" did not run, but were supposed to run for each test case. We made this code run for all test cases.

===Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment'': This test will check if public assignments are getting created properly or not with proper attributes.

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment:'' This test will check if private assignments are getting created or not with proper attributes.
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team '': This test will check the creation of new private assignment for the team. The maximum size of the team is 3 and the test will check if all these features are there or not.
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz:'' This test will check the creation of new private assignment with the quiz. The maximum number of questions in the quiz is 3 and the test will check if all these features are present or not.
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with staggered deadline :''
it "is able to create with staggered deadline" do
skip('skip test on staggered deadline temporarily')
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
begin
check("assignment_form_assignment_staggered_deadline")
rescue
return
end
page.driver.browser.switch_to.alert.accept
click_button 'Create'
fill_in 'assignment_form_assignment_days_between_submissions', with: 7
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
pending(%(not sure what's broken here but the error is: #ActionController::RoutingError: No route matches [GET]
"/asset/staggered_deadline_assignment_grap/graph_1.jpg"))
expect(assignment).to have_attributes(
staggered_deadline: true
)
end

''f. Create Assignment with review visible to all reviewers:'' This test will check the creation of new private assignment with review visible to all the reviewers.
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''g. Create public micro-task assignment:'' This test will check creation of new public assignment with microtasks.
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''h. create calibrated public assignment: '' This test will check creation of new calibrated public assignment.
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students: '' This test will edit the existing assignment and enable micro tasks and calibrated options. The test will verify if all these options are updated in the assignment.
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students: '' This test will check the feature of editing the number of quizzes in the existing assignment.
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment''
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers'''
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics''
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic ''
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic ''
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. set the deadline for an assignment review''
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment ''
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants''
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course'''

it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==

=='''References'''==
1. Github Expertiza[https://github.com/expertiza/expertiza]

2. RSpec [http://rspec.info/]

3. Capybara [https://github.com/jnicklas/capybara]

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T00:38:38Z

Pjain12: /* Test Cases */

=='''Background'''==

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===Error in Test Cases===

===Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment''

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment''
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team ''
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz''
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with staggered deadline ''
it "is able to create with staggered deadline" do
skip('skip test on staggered deadline temporarily')
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
begin
check("assignment_form_assignment_staggered_deadline")
rescue
return
end
page.driver.browser.switch_to.alert.accept
click_button 'Create'
fill_in 'assignment_form_assignment_days_between_submissions', with: 7
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
pending(%(not sure what's broken here but the error is: #ActionController::RoutingError: No route matches [GET]
"/asset/staggered_deadline_assignment_grap/graph_1.jpg"))
expect(assignment).to have_attributes(
staggered_deadline: true
)
end

''f. Create Assignment with review visible to all reviewers''
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''g. Create public micro-task assignment''
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''h. create calibrated public assignment ''
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students''
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students''
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment''
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers'''
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics''
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic ''
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic ''
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. set the deadline for an assignment review''
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment ''
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants''
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course'''

it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==

=='''References'''==

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-29T00:35:06Z

Pjain12: /* Newly Added Test Cases */

=='''Background'''==

=='''Objective'''==
Assignment Creation can be done in Expertiza by an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

=='''Feature Testing Tools'''==
Test cases have been written using RSpec and Capybara. These two combined prove to be an excellent testing tool at the developer's disposal.
===Rspec===
RSpec is a very powerful testing tool primarily used Behavior Driven Development (BDD). In RSpec, test cases are written such that they describe the specific functionality in the system being tested and helps user in better visualization of what the test cases are supposed to do.
===Capybara===
Capybara is another extremely helpful testing tool specifically used for feature testing. It is a web-based automation framework, and coupled with RSpec allows developer to write the test cases which simulate the whole scenario. It comes with a user friendly DSL as the actions specified are very intuitive and easy to understand and follow.

=='''Test Cases'''==

===Existing Test Cases===

===Newly Added Test Cases===
'''''1. Test Assignment Creation'''''

''a. Test Creating public Assignment''

it "is able to create a public assignment" do
login_as("instructor6")
visit "/assignments/new?private=0"
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
name: 'public assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation',
microtask: true,
is_calibrated: true,
availability_flag: false
)
end

''b. Test Creating private Assignment''
it "is able to create a private assignment" do
login_as("instructor6")
visit "/assignments/new?private=1"
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_reviews_visible_to_all")
check("assignment_form_assignment_is_calibrated")
uncheck("assignment_form_assignment_availability_flag")
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation'
)
end

''c. Create Assignment for Team ''
it "is able to create with teams" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 3
click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
max_team_size: 3,
show_teammate_reviews: true
)
end

''d. Create Assignment with Quiz''
it "is able to create with quiz" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_require_quiz")
click_button 'Create'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 3
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
num_quiz_questions: 3,
require_quiz: true
)
end

''e. Create Assignment with staggered deadline ''
it "is able to create with staggered deadline" do
skip('skip test on staggered deadline temporarily')
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
begin
check("assignment_form_assignment_staggered_deadline")
rescue
return
end
page.driver.browser.switch_to.alert.accept
click_button 'Create'
fill_in 'assignment_form_assignment_days_between_submissions', with: 7
click_button 'submit_btn'
assignment = Assignment.where(name: 'private assignment for test').first
pending(%(not sure what's broken here but the error is: #ActionController::RoutingError: No route matches [GET]
"/asset/staggered_deadline_assignment_grap/graph_1.jpg"))
expect(assignment).to have_attributes(
staggered_deadline: true
)
end

''f. Create Assignment with review visible to all reviewers''
it "is able to create with review visible to all reviewers" do
login_as("instructor6")
visit '/assignments/new?private=1'
fill_in 'assignment_form_assignment_name', with: 'private assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation'
check('assignment_form_assignment_reviews_visible_to_all')
click_button 'Create'
expect(page).to have_select("assignment_form[assignment][reputation_algorithm]", options: ['--', 'Hamer', 'Lauw'])
#click_button 'Create'
assignment = Assignment.where(name: 'private assignment for test').first
expect(assignment).to have_attributes(
name: 'private assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory',
spec_location: 'testLocation')
end

''g. Create public micro-task assignment''
it "is able to create public micro-task assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check('assignment_form_assignment_microtask')
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(microtask: true)
end

''h. create calibrated public assignment ''
it "is able to create calibrated public assignment" do
login_as("instructor6")
visit '/assignments/new?private=0'
fill_in 'assignment_form_assignment_name', with: 'public assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory'
check("assignment_form_assignment_is_calibrated")
click_button 'Create'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
is_calibrated: true)
end

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students''
it "should edit assignment available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_microtask")
check("assignment_form_assignment_is_calibrated")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
microtask: true,
is_calibrated: true,
)
end

''b. Edit number of quizzes available to students''
it "should edit quiz number available to students" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_require_quiz")
click_button 'Save'
fill_in 'assignment_form_assignment_num_quiz_questions', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
num_quiz_questions: 5,
require_quiz: true
)
end

''c. Edit number of members per team in an Assignment''
it "should edit number of members per team " do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1',
max_team_size: 5,
show_teammate_reviews: true
)
end

''e. Edit review visible to all other reviewers'''
it "should edit review visible to all other reviewers" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check ("assignment_form_assignment_reviews_visible_to_all")
click_button 'Save'
assignment = Assignment.where(name: 'edit assignment for test').first
expect(assignment).to have_attributes(
name: 'edit assignment for test',
course_id: Course.find_by_name('Course 2')[:id],
directory_path: 'testDirectory1',
spec_location: 'testLocation1'
)
end

''f. Should create teammate review row in rubrics''
it "should create teammate review row in rubrics" do
fill_in 'assignment_form_assignment_name', with: 'edit assignment for test'
select('Course 2', from: 'assignment_form_assignment_course_id')
fill_in 'assignment_form_assignment_directory_path', with: 'testDirectory1'
fill_in 'assignment_form_assignment_spec_location', with: 'testLocation1'
check("team_assignment")
check("assignment_form_assignment_show_teammate_reviews")
fill_in 'assignment_form_assignment_max_team_size', with: 5
click_button 'Save'
click_link 'Rubrics'
expect page.should have_css("table#assignment_questionnaire_table tr", :count=>4)
end

''g. Check if checking calibration shows the tab''
it "check if checking calibration shows the tab" do
uncheck 'assignment_form_assignment_is_calibrated'
click_button 'Save'
check 'assignment_form_assignment_is_calibrated'
click_button 'Save'
expect(page).to have_selector('#Calibration')
end

'''3. Test Topic Tab of Assignment Creation'''

''a. edit topics properties - Check all options''
it "can edit topics properties - Check" do
check("assignment_form_assignment_allow_suggestions")
check("assignment_form_assignment_is_intelligent")
check("assignment_form_assignment_can_review_same_topic")
check("assignment_form_assignment_can_choose_topic_to_review")
check("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: true,
is_intelligent: true,
can_review_same_topic: true,
can_choose_topic_to_review: true,
use_bookmark: true
)
end

''b. edit topics properties- uncheck all options''
it "can edit topics properties - unCheck" do
uncheck("assignment_form_assignment_allow_suggestions")
uncheck("assignment_form_assignment_is_intelligent")
uncheck("assignment_form_assignment_can_review_same_topic")
uncheck("assignment_form_assignment_can_choose_topic_to_review")
uncheck("assignment_form_assignment_use_bookmark")
click_button 'submit_btn'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
allow_suggestions: false,
is_intelligent: false,
can_review_same_topic: false,
can_choose_topic_to_review: false,
use_bookmark: false
)
end

''c. Add new topic ''
it "Add new topic" do
click_link 'New topic'
click_button 'OK'
fill_in 'topic_topic_identifier', with: '1'
fill_in 'topic_topic_name', with: 'Test'
fill_in 'topic_category', with: 'Test Category'
fill_in 'topic_max_choosers', with: 2
click_button 'Create'
sign_up_topics = SignUpTopic.where(topic_name: 'Test').first
expect(sign_up_topics).to have_attributes(
topic_name: 'Test',
assignment_id: 1,
max_choosers: 2,
topic_identifier: '1',
category: 'Test Category'
)
end

''d. Delete existing topic ''
it "Delete existing topic" do
create(:sign_up_topic, assignment_id: @assignment[:id])
visit "/assignments/#{@assignment[:id]}/edit"
click_link 'Topics'
all(:xpath, '//img[@title="Delete Topic"]')[0].click
click_button 'OK'
topics_exist = SignUpTopic.count(:all, assignment_id: @assignment[:id])
expect(topics_exist).to be_eql 0
end

'''4. Test Rubrics Tab of Assignment Creation'''

''a. Update review questionnaire rubric''
it "updates review questionnaire" do
within(:css, "tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
sleep 1
questionnaire = get_questionnaire("ReviewQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

''b. Update scored question dropdown''
it "should update scored question dropdown" do
within("tr#questionnaire_table_ReviewQuestionnaire") do
select "ReviewQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
end
click_button 'Save'
questionnaire = Questionnaire.where(name: "ReviewQuestionnaire2").first
assignment_questionnaire = AssignmentQuestionnaire.where(assignment_id: @assignment.id, questionnaire_id: questionnaire.id).first
expect(assignment_questionnaire.dropdown).to eq(false)
end

''c. Updates author feedback questionnaire''
it "updates author feedback questionnaire" do
within(:css, "tr#questionnaire_table_AuthorFeedbackQuestionnaire") do
select "AuthorFeedbackQuestionnaire2", from: 'assignment_form[assignment_questionnaire][][questionnaire_id]'
uncheck('dropdown')
select "Scale", from: 'assignment_form[assignment_questionnaire][][dropdown]'
fill_in 'assignment_form[assignment_questionnaire][][questionnaire_weight]', with: '50'
fill_in 'assignment_form[assignment_questionnaire][][notification_limit]', with: '50'
end
click_button 'Save'
questionnaire = get_questionnaire("AuthorFeedbackQuestionnaire2").first
expect(questionnaire).to have_attributes(
questionnaire_weight: 50,
notification_limit: 50
)
end

'''5. Test Review Strategy of Assignment Creation'''

''a. Test all auto selects feature''
it "auto selects" do
login_as("instructor6")
visit "/assignments/#{@assignment_id}/edit"
find_link('ReviewStrategy').click
select "Auto-Selected", from: 'assignment_form_assignment_review_assignment_strategy'
fill_in 'assignment_form_assignment_review_topic_threshold', with: 3
fill_in 'assignment_form_assignment_max_reviews_per_submission', with: 10
click_button 'Save'
assignment = Assignment.where(name: 'public assignment for test').first
expect(assignment).to have_attributes(
review_assignment_strategy: 'Auto-Selected',
review_topic_threshold: 3,
max_reviews_per_submission: 10
)
end

'''6. Test Due dates tab of assignment Creation'''

''a. loads the due dates page''
it "it loads the due dates page" do
expect(page).to have_content("Number of review rounds")
end

''b. set the deadline for an assignment review''
it "set the deadline for an assignment review" do
fill_in 'assignment_form_assignment_rounds_of_reviews', with: '1'
fill_in 'datetimepicker_submission_round_1', with: '2017/10/01 12:00'
fill_in 'datetimepicker_review_round_1', with: '2017/10/10 12:00'
click_button 'submit_btn'
submission_type_id = DeadlineType.where(name: 'submission')[0].id
review_type_id = DeadlineType.where(name: 'review')[0].id
submission_due_date = DueDate.find(1)
review_due_date = DueDate.find(2)
expect(submission_due_date).to have_attributes(
deadline_type_id: submission_type_id,
type: 'AssignmentDueDate'
)
expect(review_due_date).to have_attributes(
deadline_type_id: review_type_id,
type: 'AssignmentDueDate'
)
end

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment ''
it "check to see if participants can be added" do
student = create(:student)
login_as('instructor6')
assignment_id = Assignment.where(name: 'participants Assignment')[0].id
visit "/participants/list?id=#{assignment_id}&model=Assignment"
fill_in 'user_name', with: student.name
choose 'user_role_participant'
expect {
click_button 'Add'
}.to change {Participant.count}.by 1
end

''b. Verify assignments assigned to participants''
it "should display newly created assignment" do
participant = create(:participant)
login_as(participant.name)
expect(page).to have_content("participants Assignment")
end

'''8. Check if assignment can be added to a course'''

it "check to find if the assignment can be added to a course", js: true do
create(:assignment, course: nil, name: 'Test Assignment')
create(:course, name: 'Test Course')
course_id = Course.where(name: 'test Course')[0].id
assignment_id = Assignment.where(name: 'Test Assignment')[0].id
login_as('instructor6')
visit "/assignments/associate_assignment_with_course?id=#{assignment_id}"
choose "course_id_#{course_id}"
click_button 'Save'
assignment_row = Assignment.where(name: 'Test Assignment')[0]
expect(assignment_row).to have_attributes(
course_id: course_id
)
end

=='''Automated Execution via Travis'''==

=='''References'''==

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-28T23:35:47Z

Pjain12: /* Newly Added Test Cases */

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-28T23:27:32Z

Pjain12: /* Newly Added Test Cases */

=='''Background'''==

=='''Objective'''==
Assignment Creation can be done by in Expertiza an instructor for a particular course. Two types of assignments can be created, Private and Public. Further, there are various ways an assignment's attributes can be modified by personalizing reviews, deadlines, teams allocation, rubrics, calibration etc associated with the particular assignment. Each one of these in turn have many other options through which an instructor can be selected and modified. There are many functionalities within assignment creation, thus the main motive for testing of this feature is to ensure that an instructor can create an assignment without any hick-ups with all of its properties intact. And this is

=='''Feature Testing Tools'''==

===Rspec===

===Capybara===

=='''Test Cases'''==

===Existing Test Cases===

===Newly Added Test Cases===
'''1. Test Assignment Creation'''

''a. Test Creating public Assignment''

''b. Test Creating private Assignment''

''c. Create Assignment for Team ''
''d. Create Assignment with Quiz''
''e. Create Assignment with staggered deadline ''
''f. Create Assignment with review visible to all reviewers''
''g. Create public micro-task assignment''
''h. create calibrated public assignment ''

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students''
''b. Edit number of quizzes available to students''
''c. Edit number of members per team in an Assignment''
''d. Edit number of members per team ''
''e. Edit review visible to all other reviewers'''
''f. Should create teammate review row in rubrics''
''g. Check if checking calibration shows the tab''

'''3. Test Topic Tab of Assignment Creation'''
''a. edit topics properties''
''b. edit topics properties''
''c. Add new topic ''
''d. Delete existing topic ''

'''4. Test Rubrics Tab of Assignment Creation'''
''a. Update review questionnaire rubric''
''b. Update scored question dropdown''
''c. Updates author feedback questionnaire''
''d. Update scored question dropdown''

'''5. Test Review Strategy of Assignment Creation'''
''a. Test all auto selects feature''

'''6. Test Due dates tab of assignment Creation'''

'''7. Test Adding participants by Instructor'''
''a. Add New Participants to assignment ''
''b. Verify assignments assigned to participants''

=='''Automated Execution via Travis'''==

=='''References'''==

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-28T23:16:18Z

Pjain12: /* Newly Added Test Cases */

=='''Background'''==

=='''Objective'''==

=='''Feature Testing Tools'''==

===Rspec===

===Capybara===

=='''Test Cases'''==

===Existing Test Cases===

===Newly Added Test Cases===
'''1. Test Assignment Creation'''

''a. Test Creating public Assignment''

''b. Test Creating private Assignment''

''c. Create Assignment for Team ''
''d. Create Assignment with Quiz''
''e. Create Assignment with staggered deadline ''
''f. Create Assignment with review visible to all reviewers''
''g. Create public micro-task assignment''
''h. create calibrated public assignment ''

'''2. Test General Tab of Assignment Creation'''

''a. Edit assignment available to students''
''b. Edit number of quizzes available to students''
''c. Edit number of members per team in an Assignment''
''d. Edit number of members per team ''
''e. Edit review visible to all other reviewers'''
''f. Should create teammate review row in rubrics''
''g. Check if checking calibration shows the tab''

'''3. Test Topic Tab of Assignment Creation'''
''a. edit topics properties''
''b. edit topics properties''
''c. Add new topic ''
''d. Delete existing topic ''

'''4. Test Rubrics Tab of Assignment Creation'''

'''5. Test Review Strategy of Assignment Creation'''

'''6. Test Due dates tab of assignment Creation'''

'''7. Test Adding participants by Instructor'''

''a. Add New Participants to assignment ''
''b. Verify assignments assigned to participants''

=='''Automated Execution via Travis'''==

=='''References'''==

CSC/ECE 517 Fall 2016/E1664: Feature Test Assignment Creation

2016-10-28T22:13:47Z

Pjain12: /* Newly Added Test Cases */

=='''Background'''==

=='''Objective'''==

=='''Feature Testing Tools'''==

===Rspec===

===Capybara===

=='''Test Cases'''==

===Existing Test Cases===

===Newly Added Test Cases===
'''1. Test Assignment Creation'''

'''2. Test General Tab of Assignment Creation'''

'''3. Test Topic Tab of Assignment Creation'''

'''4. Test Rubrics Tab of Assignment Creation'''

'''5. Test Review Strategy of Assignment Creation'''

'''6. Test Due dates tab of assignment Creation'''

'''7. Test Adding participants by Instructor'''

=='''Automated Execution via Travis'''==

=='''References'''==