What is the Test Dilemma?
The Test Dilemma is to find an infinite number of defects in a finite time.
What and when was the first large scale Test Automation Project?
The Research Evaluation und Verification Project – RXVP – of the US. Ballistic Missile Defense System in the year 1975.
What was the biggest Challenge facing that Project.
Tool integration.
What was the name of the first static code analyzer?
RXVP Code Auditor
What was the first German test tool called?
The Siemens Prüfstand
What was the purpose of the successor tool SoftTest?
To test mainframe modules against a formal Specification
What is the difference between requirements-based and model-based Testing?
Requirement-based testing uses the requirements documentation as a source of test cases whereas model-based testing uses the design model..
What is meant by Testing?
Comparing one view of a system – Soll – with another – Ist.
Where is the biggest gap in the Test Automation process?
In the transition from logical to physical test cases, i.e. in supplementing the generated test cases with live data values.
Why is it not possible to have just one all-encompassing test tool?
Because there are too many different test activities to be covered which are only loosely coupled with one another..
What are the goals of test automation?
- Free testers from regression testing and enable them to find bugs
- Make regression testing part of the daily business
- Increase test coverage by enabling tests that would not be feasible otherwise
What are the prerequisites to introducing test automation?
- Team and management understanding of goals and possibilities
- Team and management understanding limitations – realistic expectations
What are the steps to introducing test automation?
- Define test automation goals
- Define a test automation approach
- Build a technical foundation & framework
- Build the regression test set
- Maintain and extend the regression test set
What roles are involved in setting up a test automation program?
- Management – provides goals and funding
- Tester – provides test approach and test cases, runs and evaluates test cases
- Test automation expert – selects tools, builds infrastructure
How to you go about selecting the right testing tools?
- Create a short list according to test tool type and supported technologies
- Create a set of a few representative test cases
- Use the tools from the short list to automate these test cases
- Evaluate the process & results
- Top priority: does it benefit the team?
