CSC/ECE 517 Fall 2011/ch4 4e cl
CSC/ECE 517 Fall 2010/ch1 4e cl
Introduction
In this Wiki, we introduce the testing in Ruby Rails. We give brief introduction of different kinds of tests and give the procedure about each kind.
What is Software Test
Software testing is an investigation conducted to provide stakeholders with information about the quality of the product or service under test.[1] Software testing can also provide an objective, independent view of the software to allow the business to appreciate and understand the risks of software implementation. Test techniques include, but are not limited to, the process of executing a program or application with the intent of finding software bugs (errors or other defects). Software testing can be stated as the process of validating and verifying that a software program/application/product: 1.Meets the requirements that guided its design and development; 2.Works as expected; and 3.Can be implemented with the same characteristics.
Software testing, depending on the testing method employed, can be implemented at any time in the development process. However, most of the test effort occurs after the requirements have been defined and the coding process has been completed. As such, the methodology of the test is governed by the software development methodology adopted.<ref>http://en.wikipedia.org/wiki/Software_testing</ref>
What is Ruby on Rails
Ruby on Rails, also called Rails or RoR, is an open source web application framework for the Ruby programming language. It uses the Model-View-Controller(MVC) architecture pattern to organize the application programming. Ruby on Rails is separated into various packages, namely ActiveRecord, ActiveResource, ActionPack, ActiveSupport and ActionMailer. It is often installed using RubyGem, which is a package manager including with current versions of Ruby.<ref>http://rubyonrails.org/</ref>
The MVC Architecture
Model-View-Controller(MVC) is a software architecture, currently considered anarchitectural pattern used in software engineering. The model manages the behaviour and data of the application domain, responds to requests for information about its state (usually from the view), and responds to instructions to change state (usually from the controller). In event-driven systems, the model notifies observers (usually views) when the information changes so that they can react. The view renders the model into a form suitable for interaction, typically a user interface element. Multiple views can exist for a single model for different purposes. A viewport typically has a one to one correspondence with a display surface and knows how to render to it. The controller receives user input and initiates a response by making calls on model objects. A controller accepts input from the user and instructs the model and a viewport to perform actions based on that input. <ref>http://en.wikipedia.org/wiki/Model%E2%80%93view%E2%80%93controller</ref>
Why need Software Test for Rails Application
Ruby on Rails, often shortened to Rails or RoR, is an open source web application framework for the Ruby programming language. Rails makes it super easy to write your tests. It starts by producing skeleton test code in the background while you are creating your models and controllers. By simply running your Rails tests you can ensure your code adheres to the desired functionality even after some major code refactoring. Rails tests can also simulate browser requests and thus you can test your application’s response without having to test it through your browser. <ref>http://guides.rubyonrails.org/testing.html</ref>
Basic Introduction
The Three Environments is Production, Development and Test.
To Set Up the Environment, we may follow the next: There is a folder named "test" which is generate when create the Rail projects. To list contents of this folder $ ls -F test/ We can see: fixtures/ functional/ integration/ test_helper.rb unit/
The Low-Down on Fixtures: Test fixture refers to the fixed state used as a baseline for running tests in software testing. The purpose of a test fixture is to ensure that there is a well known and fixed environment in which tests are run so that results are repeatable.<ref>http://en.wikipedia.org/wiki/Test_fixture</ref>For good tests, you’ll need to give some thought to setting up test data. In Rails, you can handle this by defining and customizing fixtures.
Unit Testing
In Rails, unit tests aims to test the models of the application. We also called it as model tests. The code you write up for model tests are placed in the directory of test/unit. What the unit testing in Rails contains is listed as follow: • Load data from fixtures before each unit test • Multiple block syntax for setup and teardown. • The test_helper.rb file, which is a important file in your application and includes the default configuration for all tests. You can put common setup and assertion methods for all tests here. It injects some additional methods into ActiveSupport::TestCase. • A series of assertion methods. Each assertion performs the examination to make sure that things are going as expected. We will show the list of assertions later.
What is A Good Unit Testing?
Our goal for unit testing is to cover almost 100% of the code in models. We recommend writing test file for each individual model. To ensure the difference between a valid and invalid object is as expected, you need to write test to cover validations. The test-driven development advocates that any new logic should be driven by a failing test. Conversely, any new test should fail and trigger a new logic code. If you want your tests to be fewer for each method, please make sure to keep your method simpler and smaller. The following is some tips for writing a good unit testing:
• Keep each of your tests to be small. • Write at least one test for some known errors. For example, without passing arguments. • Write one test for the normal case. • For the case with different branches, write one test for each branch.
There is a tradeoff about the alignment of assertions. If you put all the assertions in single one test method, your test looks more cohesive but it does not allow the tests to run independently. If you put all the assertions in different tests, you can run the test independently but you can not observe the relationships among the tests.
Preparation for A Unit Testing
The scaffolding in Rails will create the model, controller, view and migration. The corresponding full test suite is created at the same time. For example, when you use rails to generate scaffold of “user”, the default test stub for UserTest is created in test/unit/user_post.rb file:
require "test_helper"
class UserTest < ActiveSupport::TestCase
test "the truth" do
assert true
end
end
require 'test_helper' The statement is included in all test files. It means that all the methods in this file will be available to your tests. It declare the default configuration to run the tests. class UserTest < ActiveSupport::TestCase: The UserTest class defines a test case because it inherits from ActiveSupport::TestCase.UserTest thus has all the methods available from ActiveSupport::TestCase. The naming convention for test method is starting with test.
test "the truth" do
assert true
end
The method name will be generated by replacing spaces with underscores when you run the test. So the above test method can also be written in the form of :
def test_the_truth assert true end
Before running your test, you need to use the following rake commands to make sure that the test database structure is current.
| rake db:migrate | runs any pending migrations on the development environment and updates db/schema.rb. |
| rake db:test:load | recreates the test database from the currentdb/schema.rb |
| rake db:test:clone | Recreate the test database from the current environment’s database schema |
| rake db:test:clone_structure | Recreate the test database from the development structure |
| rake db:test:load: | Recreate the test database from the current schema.rb |
| rake db:test:prepare | Check for pending migrations and load the test schema |
| rake db:test:purge | rake db:test:purge |
Assertion Methods
The following shows a complete list assertion methods for basic unit test[1]. The left side shows the assertion method names and their corresponding parameters while the right side displays the purpose of each assertion method. The parameter of [msg] is an optional string message where you could place the detailed test failure messages if you want.
| Assertion | Objective |
|---|---|
| assert_send( array, [msg] ) | Ensures that executing the method listed in array[1] on the object in array[0] with the parameters of array[2 and up] is true. |
| assert_nil( obj, [msg] ) | Ensures that obj.nil? is true. |
| assert_not_nil( obj, [msg] ) | Ensures that obj.nil? is false. |
| assert_match( regexp, string, [msg] ) | Ensures that a string matches the regular expression. |
| assert_no_match( regexp, string, [msg] ) | Ensures that a string doesn’t match the regular expression. |
| assert( boolean, [msg] ) | Ensures that the object/expression is true. |
| assert_equal( A, B, [msg] ) | Ensures that A == B is true. A/B is a object or an expression. |
| assert_not_equal( A, B, [msg] ) | Ensures that A == B is false. A/B is a object or an expression. |
| assert_same( A, B, [msg] ) | Ensures that A.equal?(B) is true. A/B is a object or an expression. |
| assert_not_same( A, B, [msg] ) | Ensures that A.equal?(B) is false. A/B is a object or an expression. |
| assert_in_delta( expecting, actual, delta, [msg] ) | Ensures that the numbers expecting and actual are within delta of each other. |
| assert_instance_of( class, obj, [msg] ) | Ensures that obj is of the class type. |
| assert_kind_of( class, obj, [msg] ) | Ensures that obj is or descends from class. |
| assert_respond_to( obj, symbol, [msg] ) | Ensures that obj has a method called symbol. |
| assert_operator( obj1, operator, obj2, [msg] ) | Ensures that obj1.operator(obj2) is true. |
| assert_operator( obj1, operator, obj2, [msg] ) | Ensures that obj1.operator(obj2) is true. |
| assert_throws( str_msg, [msg] ) { block } | Ensures that the given block throws the str_msg. |
| assert_raise( exception_1, exception_2, exception_n) { block } | Ensures that the given block raises one of the given exceptions. |
| assert_nothing_raised exception_1, exception_2, exception_n) { block } | Ensures that the given block doesn’t raise one of the given exceptions. |
| flunk( [msg] ) | Ensures failure. This is useful to explicitly mark a test that isn’t finished yet. |
Below are some custom assertions that Rails adds to the basic unit test.
| Assertion | Objective |
|---|---|
| assert_difference(expressions, difference = 1, message = nil) {...} | Test numeric difference between the return value of an expression as a result of what is evaluated in the yielded block. |
| assert_no_difference(expressions, message = nil, &block) | Asserts that the numeric result of evaluating an expression is not changed before and after invoking the passed in block. |
| assert(record.valid?) | Ensures that the passed record is valid by Active Record standards and returns any error messages if it is not. |
| assert_recognizes(expected_options, path, extras={}, message=nil) | Asserts that the routing of the given path was handled correctly and that the parsed options (given in the expected_options hash) match path. Basically, it asserts that Rails recognizes the route given by expected_options. |
| assert_generates(expected_path, options, defaults={}, extras = {}, message=nil) | Asserts that the provided options can be used to generate the provided path. This is the inverse of assert_recognizes. The extras parameter is used to tell the request the names and values of additional request parameters that would be in a query string. The message parameter allows you to specify a custom error message for assertion failures. |
| assert_response(type, message = nil) | Asserts that the response comes with a specific status code. You can specify :success to indicate 200, :redirect to indicate 300-399, :missing to indicate 404, or :error to match the 500-599 range |
| assert_redirected_to(options = {}, message=nil) | Assert that the redirection options passed in match those of the redirect called in the latest action. This match can be partial, such thatassert_redirected_to(:controller => "weblog") will also match the redirection ofredirect_to(:controller => "weblog", :action => "show") and so on. |
| assert_template(expected = nil, message=nil) | Asserts that the request was rendered with the appropriate template file. |
Example of Unit Testing
<ref>http://en.wikipedia.org/wiki/Unit_testing</ref>
Functional Testing
Functional testing is a type of black box testing that bases its test cases on the specifications of the software component under test. Functions are tested by feeding them input and examining the output, and internal program structure is rarely considered. In Rails, testing the various actions of a single controller is called writing functional tests for that controller. Controllers handle the incoming web requests to your application and eventually respond with a rendered view.
What to Include in Functional Tests
1.was the web request successful? 2.was the user redirected to the right page? 3.was the user successfully authenticated? 4.was the correct object stored in the response template? 5.was the appropriate message displayed to the user in the view? The get method kicks off the web request and populates the results into the response. It accepts 4 arguments: • The action of the controller you are requesting. This can be in the form of a string or a symbol. • An optional hash of request parameters to pass into the action (eg. query string parameters or post variables). • An optional hash of session variables to pass along with the request. • An optional hash of flash values.
Available Request Types for Functional Tests
1.get 2.post 3.put 4.head 5.delete
Integration Testing
Integration tests are used to test the interaction among any number of controllers. They are generally used to test important work flows within your application.<ref>http://en.wikipedia.org/wiki/Integration_testing</ref> Unlike Unit and Functional tests, integration tests have to be explicitly created under the ‘test/integration’ folder within your application. Rails provides a generator to create an integration test skeleton for you. $ rails generate integration_test user_flows
exists test/integration/
create test/integration/user_flows_test.rb
Here’s what a freshly-generated integration test looks like:
require 'test_helper'
class UserFlowsTest < ActionDispatch::IntegrationTest
fixtures :all
# Replace this with your real tests.
test "the truth" do
assert true
end
end
| Helper | Purpose |
|---|---|
| https? | Returns true if the session is mimicking a secure HTTPS request. |
| https! | Allows you to mimic a secure HTTPS request. |
| host! | Allows you to set the host name to use in the next request. |
| redirect? | Returns true if the last request was a redirect. |
| follow_redirect! | Follows a single redirect response. |
| request_via_redirect(http_method, path, [parameters], [headers]) | Allows you to make an HTTP request and follow any subsequent redirects. |
| post_via_redirect(path, [parameters], [headers]) | Allows you to make an HTTP POST request and follow any subsequent redirects. |
| get_via_redirect(path, [parameters], [headers]) | Allows you to make an HTTP GET request and follow any subsequent redirects. |
| put_via_redirect(path, [parameters], [headers]) | Allows you to make an HTTP PUT request and follow any subsequent redirects. |
| delete_via_redirect(path, [parameters], [headers]) | Allows you to make an HTTP DELETE request and follow any subsequent redirects. |
| open_session | Opens a new session instance. |
Example:
require 'test_helper'
class UserFlowsTest < ActionDispatch::IntegrationTest
fixtures :users
test "login and browse site" do
# login via https
https!
get "/login"
assert_response :success
post_via_redirect "/login", :username => users(:avs).username, :password => users(:avs).password
assert_equal '/welcome', path
assert_equal 'Welcome avs!', flash[:notice]
https!(false)
get "/posts/all"
assert_response :success
assert assigns(:products)
end
end
<ref>http://weblog.rubyonrails.org/2006/3/1/new-for-rails-1-1-integration-tests</ref>
Running Your Tests
You don’t need to set up and run your tests by hand on a test-by-test basis. Rails comes with a number of rake tasks to help in testing. The table below lists all rake tasks that come along in the default Rakefile when you initiate a Rails project.
| Tasks | Description |
|---|---|
| rake test | Runs all unit, functional and integration tests. You can also simply runrake as the test target is the default. |
| rake test:benchmark | Benchmark the performance tests |
| rake test:functionals | Runs all the functional tests from test/functional |
| rake test:integration | Runs all the integration tests from test/integration |
| rake test:plugins | Run all the plugin tests from vendor/plugins/*/**/test (or specify with PLUGIN=_name_) |
| rake test:profile | Profile the performance tests |
| rake test:recent | Tests recent changes |
| rake test:uncommitted | Runs all the tests which are uncommitted. Supports Subversion and Git |
| rake test:units | Runs all the unit tests from test/unit |
Setup and Teardown
Testing Routes
To set a testing route, we can write the relative codes in the controller.rb file like following:
test "should route to post" do
assert_routing '/posts/1', { :controller => "posts", :action => "show", :id => "1" }
end
Conclusion
As we can see above, to build and run a test for rails application is fairly easy because it always provide some existing framework to do that. Also we should know that it is very important of testing the rails application. There are also some other approaches and aids for testing such as NullDB, Factory Girl, Machinist, Shoulda, and RSpec, etc.
References
<references/>