CSC/ECE 517 Spring 2014/oss E1406 st: Difference between revisions
m (→Deployment) |
|||
(41 intermediate revisions by 3 users not shown) | |||
Line 1: | Line 1: | ||
=E1406: Improve tests & investigate regex warnings for team functionality= | =E1406: Improve tests & investigate regex warnings for team functionality= | ||
''Please be advised that we do not have deployment link, since our work are all back-end tests'' | |||
__TOC__ | __TOC__ | ||
==Classes== | ==Classes== | ||
=== app/controllers/teams_controller.rb === | === app/controllers/teams_controller.rb === | ||
Line 11: | Line 10: | ||
* create new teams | * create new teams | ||
* import/export teams | * import/export teams | ||
* delete teams | * delete all teams/delete specified team | ||
* copy existing teams from a course down to an assignment(inherit) | |||
* update team's information | |||
=== app/controllers/student_team_controller.rb === | === app/controllers/student_team_controller.rb === | ||
Line 21: | Line 22: | ||
* remove the advertise for their team | * remove the advertise for their team | ||
* leave the team | * leave the team | ||
== Motivation == | == Motivation == | ||
Line 31: | Line 31: | ||
== Tasks == | == Tasks == | ||
Overall: contribute to the code coverage, ideally having overall coverage increase 2% | |||
===student_team_controller=== | ===student_team_controller=== | ||
* write tests | * write tests | ||
Line 36: | Line 37: | ||
* def remove # change to “remove_advertisment” | * def remove # change to “remove_advertisment” | ||
* def review # remove this method | * def review # remove this method | ||
===teams_controller=== | |||
* write tests | |||
== Deployment == | == Deployment == | ||
Line 42: | Line 46: | ||
rake test TEST=test/functional/student_team_controller.rb | rake test TEST=test/functional/student_team_controller.rb | ||
and | and | ||
rake test TEST=test/functional/teams_controller | rake test TEST=test/functional/teams_controller.rb | ||
running the whole test suite with <code>rake test</code> is not recommended, as the schema change overtime has broke some of the previous tests. | running the whole test suite with <code>rake test</code> is not recommended, as the schema change overtime has broke some of the previous tests. | ||
Line 48: | Line 52: | ||
==Testing== | ==Testing== | ||
;Framework : | ;Framework : [http://guides.rubyonrails.org/testing.html Rails default test framework] | ||
;Sample data : Fixtures (under /test/fixtures) | ;Sample data : Fixtures (under /test/fixtures) | ||
;Total Number of Tests : | ;Coverage tool: [https://rubygems.org/gems/simplecov SimpleCov] | ||
;Total Number of Tests : 37 | |||
;Previous Coverage : 22.32% | |||
;Current Coverage : 24.08% | |||
===Testing Scenarios=== | ===Testing Scenarios=== | ||
====student_team_controller==== | ====student_team_controller==== | ||
Most of the test case are straightforward. There are some of the test cases was commented out due to bug in the controller | Most of the test case are straightforward. There are some of the test cases was commented out due to bug in the controller | ||
* View student team (GET #view) | |||
* Edit team (GET #edit) | |||
* Create team with valid name (POST #create) | |||
* Create team with name in use (POST #create) | |||
* Update valid team name (POST #update) | |||
* Update team name in use (POST #update) | |||
* Update with current team name (POST #update) | |||
* Advertise (GET #advertise) | |||
''This is currently commented out in the committed code. It seems like the method is never called. It raises missing template error upon every call. '' | ''This is currently commented out in the committed code. It seems like the method is never called. It raises missing template error upon every call. '' | ||
The <code>advertise</code> method was previously named advertise_for_partners, but renamed due to ambiguity as there is another class with the same name. | The <code>advertise</code> method was previously named advertise_for_partners, but renamed due to ambiguity as there is another class with the same name. | ||
* Remove advertisement (GET #remove_advertisement ) | |||
The <code>remove_advertisement</code> method was previously named remove, but renamed to avoid ambiguity | The <code>remove_advertisement</code> method was previously named remove, but renamed to avoid ambiguity | ||
This method is never called as well, but it is functional as it do not require any template. | This method is never called as well, but it is functional as it do not require any template. | ||
* Leave student team (GET #leave) | |||
''This is currently commented out in the committed code, because it will raise error every time when called.'' | ''This is currently commented out in the committed code, because it will raise error every time when called.'' | ||
It seems like problem happens on | It seems like problem happens on | ||
Line 76: | Line 83: | ||
This will raise error due to the calling length of other_members, which is a single object but not an array. | This will raise error due to the calling length of other_members, which is a single object but not an array. | ||
Also, the related record seems to be remain undeleted in the database. | Also, the related record seems to be remain undeleted in the database. | ||
====teams_controller==== | |||
Current test cases are as following. | |||
* Create team should increase the number of teams by 1(GET #create) | |||
* Create team should increase the number of team nodes by 1(GET #create) | |||
* Create team with existing name (POST #create) | |||
* Create team should redirect to list assignments (POST #create) | |||
* Delete all teams (GET #delete_all) | |||
* Delete all teams should redirect to list (GET #delete_all) | |||
* List should receive assignment (GET #list) | |||
* List should receive course (GET #list) | |||
* New should assign parent (GET #new) | |||
* Update team should redirect (POST #update) | |||
* Update team should have validate name (POST #update) | |||
* Edit team should have time (POST #edit) | |||
* Delete team should redirect (POST #delete) | |||
* Delete team should decrease the number of teams by 1(GET #delete) | |||
* Delete team should decrease the number of team nodes by 1(GET #delete) | |||
* Inherit team should redirect (POST #inherit) | |||
* Bequeath team should redirect (POST #bequeath) | |||
The methods in the following are ignored in testing since they are never used in current codes. | |||
* create_teams_view | |||
* create_teams | |||
==Sample Test Code== | |||
We show two pieces of test code for two controllers to explain how our test works | |||
test "create_student team with name in use" do | |||
sessionVars = session_for(users(:student8)) | |||
post(:create, {'team' => { 'name' => 'IntelligentTeam2'}, 'id' => participants(:par21).id, "commit" => "Create Team"}, sessionVars, nil) | |||
assert_equal 'Team name is already in use.', flash[:notice] | |||
assert_redirected_to :controller => 'student_team', :action => 'view', :id => participants(:par21).id | |||
end | |||
test "create_should_increase_number_of_teams_course" do | |||
sessionVars = session_for(users(:instructor1)) | |||
sessionVars[:team_type] = "Course" | |||
assert_difference 'Team.count' do | |||
get :create, {'id' => @testCourse,'team' => {'name' => "Random"}},sessionVars | |||
end | |||
end | |||
The first piece of code is from student_team_controller.rb. It tests if there is already a same team name when student8 want to create a team. The second piece of code is from teams_controller_test.rb. It tests if the team number decreases when instructor1 creates a new team for a course. | |||
As we can see from the code, when we want to use <code>post</code> or <code>get</code>, several parameters are needed. Usually we use four parameters: First, the method we are requesting. Second, an hash of request parameters for the method. Third, an optional hash of session variables. Forth, an optional hash of flash values. If we do not want to pass in the optional hash, we can set it to nil as the first piece of code shows, or we can just leave it blank as the second piece of code shows. | |||
When we run the command <code>rake test TEST=test/functional/your_test_file.rb</code>, you will see if the test is passed or not. | |||
==Result== | |||
In this section, we will show the result form SimpleCov. The coverage is 24.08%. | |||
[[File:Result.png]] | |||
==Future Works== | ==Future Works== | ||
===student_team_controller=== | ===student_team_controller=== | ||
''Please note that this bug was reported fixed in the newest version of master branch of expertiza, but the fix came too late'' | |||
There are several error raised from ''leave'' method need to be fixed, as mentioned above. Future teams may need to add tests on it as soon as it fixed, since it is a crucial functionality of the student team. | There are several error raised from ''leave'' method need to be fixed, as mentioned above. Future teams may need to add tests on it as soon as it fixed, since it is a crucial functionality of the student team. | ||
Also, methods that seems like not being used, such as <code>advertise</code> and <code>remove_advertisement</code> may need to be double checked and see if they are redundant. | Also, methods that seems like not being used, such as <code>advertise</code> and <code>remove_advertisement</code> may need to be double checked and see if they are redundant. | ||
===teams_controller=== | |||
The method <code>create_teams_view</code> does not be used at all. So it is safe to delete it. | |||
The method <code>create_teams</code> calls the method <code>randomize_all_by_parent</code>, which is not correct. The developer may want to fix these bugs. | |||
It's possible that we can write more testing cases if we improve the fixture. | |||
==References== | ==References== | ||
<references/> | <references/> | ||
* http://guides.rubyonrails.org/testing.html | |||
* https://github.com/colszowka/simplecov |
Latest revision as of 19:22, 9 April 2014
E1406: Improve tests & investigate regex warnings for team functionality
Please be advised that we do not have deployment link, since our work are all back-end tests
Classes
app/controllers/teams_controller.rb
teams_controller contains functionalities for team management for instructor/TA accounts. Instructor/TA can:
- view current teams
- create new teams
- import/export teams
- delete all teams/delete specified team
- copy existing teams from a course down to an assignment(inherit)
- update team's information
app/controllers/student_team_controller.rb
The student_team_controller support team management for student account. student can
- create team
- view current team (including team invitations received and sent)
- advertise for their team
- remove the advertise for their team
- leave the team
Motivation
There were no functional tests written on the two controllers to detect bugs, as well as confirming they are functional by itself and after integration.
Our goal is to add comprehensive functional tests and integration tests to the two controllers to provide a preferable test suite for the future developers.
Also, as the classes are influenced by the changes from other, we are also responsible for fixing some of the bugs, refactoring the method names to a better ones, as well as reporting the bugs found in the testing process.
Tasks
Overall: contribute to the code coverage, ideally having overall coverage increase 2%
student_team_controller
- write tests
- def advertise_for_partners # change to “advertise”
- def remove # change to “remove_advertisment”
- def review # remove this method
teams_controller
- write tests
Deployment
Please note that all of our work will be under the /test folder, which means they will not show any change on the view. To see the result of tests, run
rake test TEST=test/functional/student_team_controller.rb
and
rake test TEST=test/functional/teams_controller.rb
running the whole test suite with rake test
is not recommended, as the schema change overtime has broke some of the previous tests.
Testing
- Framework
- Rails default test framework
- Sample data
- Fixtures (under /test/fixtures)
- Coverage tool
- SimpleCov
- Total Number of Tests
- 37
- Previous Coverage
- 22.32%
- Current Coverage
- 24.08%
Testing Scenarios
student_team_controller
Most of the test case are straightforward. There are some of the test cases was commented out due to bug in the controller
- View student team (GET #view)
- Edit team (GET #edit)
- Create team with valid name (POST #create)
- Create team with name in use (POST #create)
- Update valid team name (POST #update)
- Update team name in use (POST #update)
- Update with current team name (POST #update)
- Advertise (GET #advertise)
This is currently commented out in the committed code. It seems like the method is never called. It raises missing template error upon every call.
The advertise
method was previously named advertise_for_partners, but renamed due to ambiguity as there is another class with the same name.
- Remove advertisement (GET #remove_advertisement )
The remove_advertisement
method was previously named remove, but renamed to avoid ambiguity
This method is never called as well, but it is functional as it do not require any template.
- Leave student team (GET #leave)
This is currently commented out in the committed code, because it will raise error every time when called. It seems like problem happens on
line 96: other_members = TeamsUser.where( ['team_id = ?', params[:team_id]]).first line 97: if other_members.length == 0
This will raise error due to the calling length of other_members, which is a single object but not an array. Also, the related record seems to be remain undeleted in the database.
teams_controller
Current test cases are as following.
- Create team should increase the number of teams by 1(GET #create)
- Create team should increase the number of team nodes by 1(GET #create)
- Create team with existing name (POST #create)
- Create team should redirect to list assignments (POST #create)
- Delete all teams (GET #delete_all)
- Delete all teams should redirect to list (GET #delete_all)
- List should receive assignment (GET #list)
- List should receive course (GET #list)
- New should assign parent (GET #new)
- Update team should redirect (POST #update)
- Update team should have validate name (POST #update)
- Edit team should have time (POST #edit)
- Delete team should redirect (POST #delete)
- Delete team should decrease the number of teams by 1(GET #delete)
- Delete team should decrease the number of team nodes by 1(GET #delete)
- Inherit team should redirect (POST #inherit)
- Bequeath team should redirect (POST #bequeath)
The methods in the following are ignored in testing since they are never used in current codes.
- create_teams_view
- create_teams
Sample Test Code
We show two pieces of test code for two controllers to explain how our test works
test "create_student team with name in use" do sessionVars = session_for(users(:student8)) post(:create, {'team' => { 'name' => 'IntelligentTeam2'}, 'id' => participants(:par21).id, "commit" => "Create Team"}, sessionVars, nil) assert_equal 'Team name is already in use.', flash[:notice] assert_redirected_to :controller => 'student_team', :action => 'view', :id => participants(:par21).id end
test "create_should_increase_number_of_teams_course" do sessionVars = session_for(users(:instructor1)) sessionVars[:team_type] = "Course" assert_difference 'Team.count' do get :create, {'id' => @testCourse,'team' => {'name' => "Random"}},sessionVars end end
The first piece of code is from student_team_controller.rb. It tests if there is already a same team name when student8 want to create a team. The second piece of code is from teams_controller_test.rb. It tests if the team number decreases when instructor1 creates a new team for a course.
As we can see from the code, when we want to use post
or get
, several parameters are needed. Usually we use four parameters: First, the method we are requesting. Second, an hash of request parameters for the method. Third, an optional hash of session variables. Forth, an optional hash of flash values. If we do not want to pass in the optional hash, we can set it to nil as the first piece of code shows, or we can just leave it blank as the second piece of code shows.
When we run the command rake test TEST=test/functional/your_test_file.rb
, you will see if the test is passed or not.
Result
In this section, we will show the result form SimpleCov. The coverage is 24.08%.
Future Works
student_team_controller
Please note that this bug was reported fixed in the newest version of master branch of expertiza, but the fix came too late
There are several error raised from leave method need to be fixed, as mentioned above. Future teams may need to add tests on it as soon as it fixed, since it is a crucial functionality of the student team.
Also, methods that seems like not being used, such as advertise
and remove_advertisement
may need to be double checked and see if they are redundant.
teams_controller
The method create_teams_view
does not be used at all. So it is safe to delete it.
The method create_teams
calls the method randomize_all_by_parent
, which is not correct. The developer may want to fix these bugs.
It's possible that we can write more testing cases if we improve the fixture.
References
<references/>