ISTQB-ATTA practice question 6 of 15

It has been suggested to organize a performance test to find out more regarding the third risk. Which of the following would you use to quantify the situation and as a basis for defining a performance exit criteria? 2 credits [K3]

Full set: 65 questions
Answer options
A: Defect analysis time
B: Change parameter success ratio
C: Number of errors made by the user
D: Time to perform the function Correct answer
Correct Answer:
D. Time to perform the function
Explanation

Performance testing aims to evaluate the non-functional quality characteristic of time behavior (efficiency). "Time to perform the function," commonly known as response time or transaction time, is a fundamental metric used to measure this characteristic. It directly quantifies the system's speed and responsiveness under load. This quantifiable data is essential for setting objective and measurable exit criteria, such as requiring a specific function to complete within a defined time threshold for a certain percentage of transactions.

Why Incorrect

A. Defect analysis time is a project management metric for the defect resolution process, not a measure of the system's performance characteristics.
B. Change parameter success ratio measures the functional correctness or reliability of configuration changes, not the system's speed or efficiency.
C. Number of errors made by the user is a primary metric for usability testing, which evaluates how easy and intuitive the system is to use.

References

1. ISTQB® Certified Tester Advanced Level Test Analyst Syllabus (Version 3.1.2, 2021): Section 3.2.2, "Non-Functional Test Types," discusses performance testing under the quality characteristic of "Efficiency." It states, "Performance testing is concerned with measuring the system's performance under a defined load... Typical measures gathered are response times..." This directly supports using time-based metrics.

2. ISTQB® Certified Tester Foundation Level Syllabus (Version 4.0, 2023): Section 2.2.2, "Non-functional testing," defines performance testing as evaluating "how a system performs under particular conditions." It lists "response times" as a key example of what is evaluated, confirming that time is a central metric.

3. Pressman, R. S., & Maxim, B. R. (2020). Software Engineering: A Practitioner's Approach (9th ed.). McGraw-Hill. In Chapter 21, "Software Testing Strategies," the text on Performance Testing highlights that its objective is to "test the run-time performance of software within the context of an integrated system." It identifies metrics such as "response time" as critical for this evaluation. (Specific reference: Chapter 21.5.4, Performance Testing).

Scroll to Top