DEA-C01 practice question 2 of 25
A data engineer needs to build an enterprise data catalog based on the company's Amazon S3 buckets and Amazon RDS databases. The data catalog must include storage format metadata for the data in the catalog. Which solution will meet these requirements with the LEAST effort?
Full set: 287 questionsThe most efficient way to build a data catalog from S3 and RDS with minimal effort is by using an AWS Glue crawler. A crawler can connect to various data stores, automatically infer schemas, and populate the AWS Glue Data Catalog. To specifically identify the storage format (e.g., Parquet, CSV, JSON), the crawler uses classifiers. AWS Glue provides built-in classifiers for common formats and allows for custom classifiers for more complex or non-standard data formats. This automated discovery and classification process is the core purpose of Glue crawlers and requires the least manual intervention.
A. Requiring data stewards to manually inspect and update the catalog contradicts the "LEAST effort" requirement, as this is a manual process.
C. Amazon Macie is a data security service for discovering sensitive data, not a tool for building a general-purpose data catalog with storage format metadata.
D. Writing custom scripts to scan data and assign classifications is a high-effort, manual approach that AWS Glue crawlers are designed to replace.
1. AWS Glue Developer Guide. (2023). Cataloging tables with a crawler. AWS Documentation. Retrieved from https://docs.aws.amazon.com/glue/latest/dg/add-crawler.html
2. AWS Glue Developer Guide. (2023). Working with classifiers in AWS Glue. AWS Documentation. Retrieved from https://docs.aws.amazon.com/glue/latest/dg/classifiers.html (Section: "Built-in classifiers in AWS Glue")
Keep practicing
Take the free DEA-C01 practice test
Ten exam-style questions with answers and explanations, plus the exam facts and study guides.
More questions
Other DEA-C01 practice questions
- Question 1A company hosts its applications on Amazon EC2 instances. The company must use SSL/TLS co…
- Question 3A company has an application that uses a microservice architecture. The company hosts the…
- Question 4A company stores customer records in Amazon S3. The company must not delete or modify the…
- Question 5A company uses AWS Glue Apache Spark jobs to handle extract, transform, and load (ETL) wo…
- Question 7A company has a data processing pipeline that includes several dozen steps. The data proc…
- Question 8A marketing company uses Amazon S3 to store marketing dat a. The company uses versioning …
