CSC/ECE 517 Fall 2009/wiki1b 4 mv

Topic: Functional and integration testing and beyond

Problem Statement: We have focused mainly on unit tests in this course. But functional and integration testing are also important. How does one write good functional and integration tests? Are there any kinds of tests beyond unit, functional, and integration that one should implement to gain confidence that one's code is correct?

Different stages of Software Testing http://www.aptest.com/testtypes.html (either use reference to this place or type in our own words)

Functional Testing:

Integration Testing: Integration Testing is a process of testing the application on the whole. After going through the unit testing of the modules, these modules need to be integrated, and during this process things may go wrong, Integration process is the phase wherein these errors are captured and rectified. It is very common for modules after having successful passed all the unit test cases to fail when they are integrated with other modules.Integration testing is an important phase and sometimes there are separate teams which handle integration testing.

Integration testing is a systematic technique for constructing the program structure while at the same time conducting tests to uncover errors associated with interfacing. The objective is to take unit tested components and build a program structure that has been dictated by design.

Integration testing can be done in a variety of ways

1. Top-Down Approach. In this approach the modules higher up in the control hierarchy are integrated first and low-level modules are added later. The advantage of this approach is that the modules with high level logic are tested first and hence bugs in the crucial logic are caught early. Further this approach does not require drivers to be written. Although a number of stubs have to be written and managed
2. Bottom Up Approach. In this approach, the low level modules are integrated first and high level logic is tested late. While integrating the low level modules, the control modules are replaced by dummy modules called as drivers. Thus driver codes have to be written and managed while using this approach.
3. Another approach is called the umbrella approach. It is a hybrid of the top down and the botom up approach, ie both the bottom up and top down approaches are used.In this approach we first test along the functional and control flow paths, for this we use the bottom up approach. The results thus gathered are later integrated in a top down manner. This kind of testing allows creating early prototypes of the system with has limited functionality thereby helping is the creations of the product in an incremental manner. This types of testing also minimizes the use of stubs and drivers which are needed in the top-down and bottom up approaches.

Prerequisites before Integration Testing
The system that is being tested, all of its modules should be rigorously tested as a component, i.e they should have gone through unit tests.

Steps in writing good Integration Test Cases

1. Create a Test Plan
2. Create test cases and the sample data against which they would be tested.
3. If automated tools are being used, scripts should be created.
4. After the components have been integrated, start executing the test cases created in point 2.
5. Log the bugs found and rectify the same.
6. Retest the code.

How To write Good Integration Test Cases http://www.exforsys.com/tutorials/testing/integration-testing-whywhathow.html ... Link is very elaborate.

Functional Tests: Functioanl Test usually check whether the code is running according to what the user/client needs.

http://www.davenicolette.net/articles/ftdd.pdf