You are a Test Manager working for a software organization where reviews have never been applied. After a meeting with your managers examining a…

The scenario explicitly confirms the presence of management support, participant involvement, and training. A business case was examined, and the pilot was effective. However, a critical success factor for the long-term institutionalization of a new process is the ongoing measurement of its value. The scenario does not mention the definition and systematic use of metrics to calculate and demonstrate the Return on Investment (ROI). While the pilot was successful, sustaining management support and optimizing the process requires quantitative proof of its benefits, which is achieved through metrics.

A. Management support is explicitly stated in the scenario ("the management finally decides to adopt formal reviews").

B. Participant support is clearly described as being present ("positive involvement from all the participants").

D. Training is explicitly mentioned as having been provided ("spent to provide training in the review process").

---

1. ISTQB Advanced Level Syllabus, Test Manager (Version 2012): Section 3.4, "Introducing Reviews," lists critical success factors for implementing a review process. It states, "The following are critical success factors for a review program... Management support... A pilot project... Training for participants... The definition and use of metrics for the review process to measure the return on investment (ROI)." The scenario covers all listed factors except the ongoing definition and use of metrics to measure ROI.

2. Black, R. (2014). Advanced Software Testing - Vol. 2: Guide to the ISTQB Advanced Certification as an Advanced Test Manager (2nd ed.). Rocky Nook. In Chapter 2, "Reviews," the section on "Implementing Reviews" emphasizes creating a business case. It details the importance of gathering metrics to calculate ROI, stating, "To make the business case for reviews, you should gather metrics on the costs and benefits of reviews... These metrics can be used to calculate the return on investment (ROI) for reviews." This highlights that measuring ROI is a distinct and crucial step beyond simply getting initial approval.

3. van Veenendaal, E. (Ed.). (2012). The Little Black Book on Test Process Improvement. TMap. Chapter 4, "Implementing Improvements," discusses the importance of measurement to anchor changes within an organization. It explains that after a pilot, "measurement is essential to show the results and benefits of the improvement." This supports the idea that without formal metrics, the success of the pilot cannot be translated into a sustained, organization-wide practice.