CT-PT practice question 3 of 10

What is an advantage of aggregating the results of performance testing?

Full set: 40 questions
Answer options
A: Aggregated results provide more detail and allow for a more complete analysis of the test.
B: Testing is expedited when the results are aggregated.
C: It is easier for stakeholders to draw a correct conclusion from aggregated results. Correct answer
D: Aggregated results show when testing has been completed.
Correct Answer:
C. It is easier for stakeholders to draw a correct conclusion from aggregated results.
Explanation

The primary advantage of aggregating performance test results is to distill vast quantities of raw data into concise, understandable metrics (e.g., average response time, 95th percentile, error rate). This summarization makes it significantly easier for stakeholders, who may not be performance experts, to interpret the results, compare them against performance goals and Service Level Agreements (SLAs), and draw correct conclusions about the system's behavior under load. The goal is to facilitate clear communication and informed decision-making.

Why Incorrect

A: This is incorrect. Aggregation is a process of summarization that inherently loses detail from the raw data, rather than providing more. Detailed analysis requires the original, non-aggregated data points. B: This is incorrect. Aggregation is a post-execution analysis activity. It occurs after the test has run and therefore does not expedite the testing process itself. D: This is incorrect. While aggregated results are generated after a test is complete, they are a product of the test, not the primary indicator of its completion status.

References

1. ISTQB® Certified Tester Performance Tester Syllabus (2018): Section 4.3, "Analyze Results and Report," emphasizes that a key task is to "Consolidate, analyze, and report the performance test results" and that "The report should be understandable to the intended audience... The report should summarize the findings and provide conclusions and recommendations." This directly supports that aggregation (consolidation/summarization) is done to help stakeholders draw conclusions. (URL: https://www.istqb.org/certifications/performance-tester - link to syllabus download page).

2. Jain, R. (1991). The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling. Wiley. Chapter 10, "The Art of Data Presentation," explains that raw data is often unsuitable for presentation and must be summarized into indices of performance. Section 12.2, "Summarizing Measured Data," states, "The purpose of a summary is to characterize a set of observations with just a few numbers." This highlights the goal of making data comprehensible.

3. Microsoft Patterns & Practices (2007). Performance Testing Guidance for Web Applications. Chapter 11, "Analyzing Results and Reporting," states: "Your goal is to present the data in a format that is easy to understand and that helps the key stakeholders make the right decisions." This aligns perfectly with the purpose of aggregation for stakeholder communication. (URL: https://learn.microsoft.com/en-us/previous-versions/msp-n-p/bb924373(v=pandp.10)))

Scroll to Top