For instance, after the code has been unit tested, are there several testing phases, such as system, integration and regression testing?
Although these layers of testing do exist in agile projects, agile testing is integrated throughout the lifecycle, with each feature being fully tested as it’s developed, rather than doing most testing at the end of all the development.
Here’s how traditional test phases typically fit in with an agile testing approach:
- Unit testing is still completed by developers as usual, but ideally there’s a much stronger emphasis on automated testing at the code/unit level.
- In eXtreme Programming (XP), there is also a strong emphasis on test driven development, which is the practice of writing tests before writing code. This can start simply with tests (or ‘confirmations’) being identified when a ‘user story‘ is written, and can go as far as actually writing automated unit tests before writing any code.
- System testing and integration testing are rolled together. As there is at least a daily build, and ideally continuous integration, features can be tested as they are developed, in an integrated environment. As per waterfall, this stage of testing is ideally carried out by professional testers, as we all know developers can’t test for toffee! Importantly, though, each feature is tested as it’s developed, not at the end of the Sprint or iteration, and certainly not at the end of the project.
- Towards the end of each sprint, when all features for the iteration have been completed (i.e. developed and tested in an integrated environment), there needs to be time for a short regression test before releasing the software. Regression testing should be short because automated, test driven development, with features tested continuously in an integrated environment, should not result in many surprises. Hopefully it should be more like a ‘road test’.
- Finally, on a very large project, where a release must practically span multiple sprints to be of any value, a ‘stabilisation’ sprint may be worthwhile to make sure everything is okay before release. This should, however, be a short duration and the need for a stabilisation sprint should be avoided if at all possible, by trying to deliver releasable quality in each and every sprint along the way. If it is required, this sprint should be all about reducing any defects prior to launch, and the scope of development should at that time be frozen.
That’s a very quick summary of how traditional test phases fit in with an agile testing approach. In many ways it’s common sense, although it’s not always easy!