ASTQB practice question 13 of 15

You are testing an application that will allow users to scan the bar code from a package mailing label and then receive emails from the package…

Full set: 76 questions
You are testing an application that will allow users to scan the bar code from a package mailing label and then receive emails from the package shipper as the package moves through the various stages of its delivery (e.g., pickup, receipt at central processing, routing, delivery). If requested, the user can also receive a picture of the signature of the recipient of the package. This is a web browser-based application. It is expected that this application will have wide usage across a large set of devices and networks with varying speeds and reliability. Your company has several competitors who are working on similar products although your company’s product has some new innovations and a very attractive user interface. As a result, once it is released, your company expects to grab that majority market share. Given this information, what would be the best approach for doing your testing to ensure the capabilities of the product are tested as well as the range of environments and networks?
Answer options
A: Use a remote device lab that is provided by a device manufacturer to ensure your application works across the whole family of devices.
B: Use crowd sourcing to get the widest distribution of device locations and types with minimal cost.
C: Use a set of simulators that can simulate the various capabilities of a wide variety of devices.
D: Use a cloud-based virtual test environment to simulate various devices and networks. Correct answer
Correct Answer:
D. Use a cloud-based virtual test environment to simulate various devices and networks.
Explanation

A cloud-based virtual test environment is the best approach because it directly addresses the two primary challenges presented: testing across a "large set of devices" and "networks with varying speeds and reliability." These platforms provide on-demand access to a vast library of real mobile devices from various manufacturers, running different OS versions. Crucially, they also offer network virtualization (or simulation) capabilities, allowing testers to mimic real-world network conditions such as low bandwidth, high latency, and packet loss. This combination provides the most comprehensive, scalable, and controlled solution for ensuring both functionality and performance across the expected diverse user environments.

Why Incorrect

A. A remote device lab from a single manufacturer is too restrictive and fails to cover the required "large set of devices" from different vendors that the application will encounter in the market.
B. Crowd sourcing, while offering wide device distribution, lacks the rigorous control, repeatability, and security needed for systematic testing of new capabilities before a major product launch.
C. Simulators are inadequate as they cannot accurately replicate real device hardware, resource constraints (e.g., battery, CPU), or complex, unreliable network conditions, which are critical for this application.

References

1. ISTQB® Certified Tester Advanced Level Test Analyst Syllabus V3.1.2 (2021), Section 4.3.3, Portability Testing, p. 49. The syllabus states, "Cloud-based device farms provide access to a large number of physical devices and configurations... They may also provide the ability to simulate different network conditions." This directly supports the selection of a cloud-based environment for testing across diverse devices and networks.

2. ISTQB® Certified Tester Foundation Level - Mobile Application Testing Syllabus V1.0 (2019), Section 3.2, Test Environments and Tools for Mobile Testing, p. 15. This document notes the limitations of simulators: "Simulators and emulators are useful for certain types of testing, but they do not behave in exactly the same way as the physical device." It further highlights the advantage of cloud solutions: "Cloud-based testing provides access to a wide range of devices... They can also simulate various network conditions, which is a key advantage."

3. Gao, J., Bai, X., Tsai, W. T., & Uehara, T. (2014). Mobile application testing: a tutorial. Computer, 47(4), 46-55. DOI: 10.1109/MC.2014.43. This academic tutorial discusses testing strategies, noting on page 52 that cloud-based testing platforms "let developers test their apps on a wide range of real handsets" and can "simulate different network environments," confirming this as a superior strategy for achieving broad compatibility and performance testing.

Scroll to Top