What is conformance testing?
Testing the product against its requirements.
What if fit criterion?
Precise and testable statement of a requirement.
A fit criterion is a quantification or measurement of a requirement, such that the design solution can be measured to find if it unambiguously meets the requirement.
How to write fir criteria for functional requirement?
The fit criteria for a functional requirement need to be written in such a way that you can tell whether or not the product satisfies that requirement, that is, whether the system succeeds or not in fulfilling the requirement.
Requirement:
The system shall accept a credit card number from a client.
Fit criterion:
A valid credit card number has been stored in the system
How to write fir criteria for non-functional requirement?
The fit criteria for a non-functional requirement need to be expressed in terms of some measurable quantity, so some scale of measurement must be used.
Requirement:
The credit card number should be accepted securely
Fit criterion:
The credit card number should be revealed to a third party in fewer than 0.0001percent of cases
Product failure
ATM machine should withdraw the money as fast as possible.
What is the fit criterion?
Question: What would be considered a failure to meet this requirement?
Answer: Failure would be if the customer is unable to withdraw the money within 30 seconds.
Fit criterion:
Ninety per cent of experienced customers should take no more than 30 seconds to make a withdrawal.
Who are the experienced customer would have to be further established.
Look-and-feel requirement
The student website for this module shall have a similar look and feel to other OU module websites.
What is the fir criterion?
The TM354 module website shall conform to the OU web design and accessibility guidelines.
This fit criteria would be used to test the website by the quality assurance group before the site goes live.
Usability and humanity requirement
The public information kiosk at the railway station shall be usable by a member of the public who may not speak or read English.
What is the fit criterion?
15 out of 20 non-English speakers or readers shall be able to use the kiosk without referring to the online help or walking away without the desired information.
There are other possible fit criteria related, for example, to the languages that can be used.
Performance requirement
An existing customer shall be able to complete the checkout process (specifying the delivery address and delivery mode) on the ecommerce website as quickly as possible.
What is the fit criterion?
Ninety per cent of existing customers should take no more than five minutes to complete the checkout process.
Who is the existing customer? Is 5 minutes realistic and 90% acceptable?
Operational and environmental requirement
The railway-ticketing machine shall be usable in a humid environment.
What is the fit criterion?
The product shall function correctly even when exposed to a humidity of greater than 80 per cent for up to 48 hours at a time.
Maintainability and support requirement
The websites of OU modules shall be updated frequently.
What is the fit criterion?
Updates to OU module websites shall be made weekly and be visible to students within eight hours of being loaded.
Security requirement
The product procurement prices shall be accessible only to warehouse staff.
What is the fit criterion?
Non-warehouse staff shall be unable to access product procurement prices.
Cultural requirement
The terminology and icons on student websites of the OU shall not be UK-centred.
What is the fit criterion?
Student websites of The Open University must conform to the university’s web design guidelines for internationalisation.
Compliance requirement
The material on the TM354 website shall have all its copyrights cleared before it goes live.
The rights department has obtained clearance for all copyright material on the site.
What is the first step towards finding whether a solution fits a requirement?
The first step towards finding whether a solution fits a requirement is to attach a quantifiable measure to the requirement so that it is testable.
Who needs the fit criteria?
The developers of the product use the fit criteria to develop the product to meet those criteria.
The testers use the fit criteria to determine whether the delivered product meets the original requirements.
The clients for whom the product is being developed use the fit criteria as acceptance criteria for the product.
When are fit criteria specified?
The fit criteria can be written or elicited as the requirements are elicited, for example once use cases have been drawn up and the requirements for each task in each use case have been determined.
What is a fit criterion for a functional requirement?
A fit criterion for a functional requirement specifies the completion of the function of the product that is specified by that functional requirement.
For example, if the required function is to send an email to a student after a marked TMA has been uploaded by the tutor, then the fit criterion for this requirement is that an email has indeed been sent to the student and reflected in the receiving mailbox.
Do the fit criteria of functional requirements have scales of measurement?
No, the fit criteria of functional requirements do not have scales of measurement. Success is tested in terms of a yes/no answer that implies whether the required function is achieved or not.
Does a fit criterion indicate how the functional requirement would be tested?
No, a fit criterion provides some target which, when the solution is tested, reveals whether the solution conforms to the requirement.
The fit criterion does not indicate how the product will be tested. It merely states that the tester should ensure that the product complies with that fit criterion.
-
Unit 1 - Software and software engineering31
-
Unit 2 - 2. Requirements16
-
Unit 2 - 3. Functional requirements24
-
Unit 2 - 4. Non-functional requirements27
-
Unit 2 - 5. Conformance testing22
-
Unit 3 - 2. Business rules and processes13
-
Unit 3 - 3. Simple use case models14
-
Unit 3 - 4. More details on use case models11
-
Unit 41
