ISTQB-ATM practice question 3 of 15

The following are the exit criteria described in the test plan of a software product: EX1. The test suite for the product must ensure that at least…

Full set: 64 questions
The following are the exit criteria described in the test plan of a software product: EX1. The test suite for the product must ensure that at least each quality risk item is covered by at least one test case (a quality risk item can be covered by more test cases). EX2. All test cases in the test suite must be run during the execution phase. EX3. Defects are classified into two categories: “C” (critical defect) and “NC” (non-critical defect). No known C defects shall exist in the product at the end of the test execution phase. Which of the following information is useless when the specified exit criteria is evaluated? K2 1 credit
Answer options
A: A traceability matrix showing the relationships between the product risk items and the test cases
B: A list of all the open defects with the associated classification information extracted from the defect tracking system
C: A chart, showing the trend in the lag time from defect reporting to resolution, extracted from the defect tracking system Correct answer
D: The execution status of all the test cases extracted from the test management tool
Correct Answer:
C. A chart, showing the trend in the lag time from defect reporting to resolution, extracted from the defect tracking system
Explanation

The specified exit criteria are concerned with test coverage of risks (EX1), test execution completeness (EX2), and the final state of defects (EX3). A chart showing the trend in lag time from defect reporting to resolution measures the efficiency of the defect management process. While this is a valuable project management metric for process improvement, it does not provide the necessary information to determine if the specific exit criteria—which focus on coverage, completion, and the number of open critical defects—have been met.

Why Incorrect

A. The traceability matrix is essential to verify that each quality risk item is covered by at least one test case, as required by criterion EX1.
B. A list of open defects with their classification is necessary to confirm that no known critical ("C") defects remain, fulfilling criterion EX3.
D. The execution status of all test cases is required to verify that the entire test suite has been run, as mandated by criterion EX2.

References

1. ISTQB® Certified Tester Advanced Level Syllabus, Test Manager, Version 2012.

Section 5.5.2, Test Control and Reporting: This section details metrics used for test reporting to stakeholders. It explicitly lists "Test coverage" (relevant to EX1 and option A), "Status of the test cases" (relevant to EX2 and option D), and "Defect information" such as the number of open defects by severity (relevant to EX3 and option B). It does not list defect resolution time as a metric for evaluating product exit criteria, but rather as a process metric.

2. Spillner, A., Linz, T., & Schaefer, H. (2014). Software Testing Foundations: A Study Guide for the Certified Tester Exam (4th ed.). Rocky Nook.

Chapter 5, Test Management: This chapter discusses test planning, monitoring, and control. It explains that exit criteria are evaluated using metrics like requirements coverage, code coverage, and defect density/status. The time to fix a defect is described as a process metric, not a product-readiness metric for exit criteria evaluation (p. 168-171).

3. Black, R. (2009). Managing the Testing Process: Practical Tools and Techniques for Managing Hardware and Software Testing (3rd ed.). Wiley Publishing.

Chapter 10, Measuring the Test Process: This chapter distinguishes between product metrics (e.g., defect counts, test case status) used for release decisions (exit criteria) and process metrics (e.g., defect find/fix lag time) used for evaluating process efficiency. The question's exit criteria are product-focused, making the process metric in option C irrelevant for their evaluation (p. 265-267).

Scroll to Top