CT-PT practice question 8 of 10

Which of the following is a general principle of performance testing?

Full set: 40 questions
Answer options
A: Tests must be executable within the project timeframe. Correct answer
B: Test results must be comparable to tester expectations.
C: Test results must vary when the tests are run repeatedly on an unchanged system.
D: Tests must align with the ideal outcome of stakeholders.
Correct Answer:
A. Tests must be executable within the project timeframe.
Explanation

A fundamental principle of any testing activity, including performance testing, is that it must be practical and provide value within the project's constraints. Performance tests must be designed, executed, and analyzed within the available project timeframe to provide timely feedback for decision-making. If tests take too long to run, the results may become irrelevant as the system under test will have already evolved, making the feedback obsolete. This aligns with the core project management aspect of testing.

Why Incorrect

B. Test results must be comparable to tester expectations. This is imprecise. Results are compared against pre-defined, objective performance requirements and criteria, not a tester's subjective expectations.
C. Test results must vary when the tests are run repeatedly on an unchanged system. This is incorrect. A key principle is repeatability; results should be consistent and reproducible on an unchanged system to be considered reliable.
D. Tests must align with the ideal outcome of stakeholders. This is too vague. Testing aligns with specific, measurable, and agreed-upon performance requirements derived from stakeholder needs, not their potentially unrealistic "ideal" outcomes.

References

1. ISTQB® Certified Tester Performance Testing Syllabus (2018): Section 2.4, "Managing a Performance Test Project," emphasizes the role of the performance test manager in "creating a realistic schedule for performance testing activities" and "tracking the progress of the performance testing activities against the schedule." This directly implies that tests must be executable within the project timeframe to be manageable and effective.

2. The Art of Software Testing, 3rd Edition (G. J. Myers, C. Sandler, T. Badgett): While a general testing book, it establishes the universal principle that testing operates under constraints. Chapter 2 discusses the economics of testing, noting that "you can't test everything" and that testing efforts must be planned and budgeted, which inherently includes time constraints. This principle applies directly to specialized testing like performance testing.

3. A Practical Guide to Testing in DevOps (K. E. Block): In the context of modern development, this guide emphasizes the need for fast feedback loops. Chapter 5, "Performance Testing," discusses integrating performance tests into the CI/CD pipeline, which requires tests to be "fast enough to provide timely feedback." This reinforces the principle that test execution time is a critical constraint.

Scroll to Top