Background of the question:
The issue of test sufficiency arose when projects became large and time became scarce. It became necessary to understand when to stop testing in order to use resources effectively. The tester must explain to the business that enough has been tested and the risks are minimal.
Problem:
Manual testing cannot be made absolutely complete — there are always constraints on time and resources. Insufficient coverage leads to missed defects, while excessive coverage causes budget overruns and delays.
Solution:
Key features:
Can we rely solely on coverage by test cases without considering risks?
No. It is necessary to consider the priorities of functionality: which areas are most critical to the business.
Does the number of test cases always indicate the quality of coverage?
No. A lot of unfounded or duplicate test cases do not indicate high coverage.
Should exploratory testing be included in the coverage metric?
Yes, definitely. Exploratory testing uncovers unexpected defects that formal test cases miss, and it should be part of the overall coverage picture.
The tester considers coverage solely based on the number of test cases without taking into account the impact area of bugs or user scenarios.
Pros:
Cons:
The tester, together with the analyst, clarifies risks, adjusts coverage and focuses efforts on the most important components.
Pros:
Cons: