DEA-C01 practice question 18 of 25

A car sales company maintains data about cars that are listed for sale in an are a. The company receives data about new car listings from vendors who…

A car sales company maintains data about cars that are listed for sale in an are a. The company receives data about new car listings from vendors who upload the data daily as compressed files into Amazon S3. The compressed files are up to 5 KB in size. The company wants to see the most up-to-date listings as soon as the data is uploaded to Amazon S3. A data engineer must automate and orchestrate the data processing workflow of the listings to feed a dashboard. The data engineer must also provide the ability to perform one-time queries and analytical reporting. The query solution must be scalable. Which solution will meet these requirements MOST cost-effectively?

Answer options

A: Use an Amazon EMR cluster to process incoming data. Use AWS Step Functions to orchestrate workflows. Use Apache Hive for one-time queries and analytical reporting. Use Amazon OpenSearch Service to bulk ingest the data into compute optimized instances. Use OpenSearch Dashboards in OpenSearch Service for the dashboard.

B: Use a provisioned Amazon EMR cluster to process incoming data. Use AWS Step Functions to orchestrate workflows. Use Amazon Athena for one-time queries and analytical reporting. Use Amazon QuickSight for the dashboard.

C: Use AWS Glue to process incoming data. Use AWS Step Functions to orchestrate workflows. Use Amazon Redshift Spectrum for one-time queries and analytical reporting. Use OpenSearch Dashboards in Amazon OpenSearch Service for the dashboard.

D: Use AWS Glue to process incoming data. Use AWS Lambda and S3 Event Notifications to orchestrate workflows. Use Amazon Athena for one-time queries and analytical reporting. Use Amazon QuickSight for the dashboard. Correct answer

Correct Answer:

D. Use AWS Glue to process incoming data. Use AWS Lambda and S3 Event Notifications to orchestrate workflows. Use Amazon Athena for one-time queries and analytical reporting. Use Amazon QuickSight for the dashboard.

Explanation

This solution is the most cost-effective because it is entirely serverless, meaning you only pay for the resources you consume without managing any underlying infrastructure. For small, infrequent files (5 KB), AWS Glue is a cost-effective ETL service. S3 Event Notifications triggering an AWS Lambda function is the most efficient and cheapest way to orchestrate a simple workflow. Amazon Athena is a serverless query service ideal for cost-effective ad-hoc queries, and Amazon QuickSight offers pay-per-session pricing for dashboards, which is highly cost-effective for BI.

Why Incorrect

A. Using an Amazon EMR cluster and Amazon OpenSearch Service is expensive overkill for processing small files, as both require provisioning and paying for idle compute capacity.
B. A provisioned Amazon EMR cluster is not cost-effective for this workload. While Athena and QuickSight are good choices, the processing component makes this option expensive.
C. Amazon Redshift Spectrum requires a running Redshift cluster, and OpenSearch requires a provisioned cluster, making this solution more expensive than a fully serverless approach.

References

1. Amazon Web Services. "AWS Glue". AWS Documentation. "AWS Glue is a serverless data integration service... You pay only for the time your ETL job runs." This highlights its cost-effectiveness for event-driven jobs.

2. Amazon Web Services. "Tutorial: Using an S3 trigger to invoke a Lambda function". AWS Lambda Developer Guide. This demonstrates the standard, low-cost pattern for event-driven orchestration from S3.

3. Amazon Web Services. "Amazon Athena pricing". AWS Documentation. "With Athena, you pay only for the queries that you run... making it easy to query data in a cost-effective manner."

4. Amazon Web Services. "Amazon QuickSight Pricing". AWS Documentation. The pay-per-session model is described, which is ideal for minimizing costs when dashboard usage is not constant.

Keep practicing

Take the free DEA-C01 practice test

Ten exam-style questions with answers and explanations, plus the exam facts and study guides.

Start the free practice test