ASSOCIATE-DATA-PRACTITIONER practice question 17 of 25

You are working with a large dataset of customer reviews stored in Cloud Storage. The dataset contains several inconsistencies, such as missing values, incorrect data types, and duplicate entries. You need to clean the data to ensure that it is accurate and consistent before using it for analysis. What should you do?

Full set: 106 questions
Answer options
A: Use the PythonOperator in Cloud Composer to clean the data and load it into BigQuery. Use SQL for analysis.
B: Use BigQuery to batch load the data into BigQuery. Use SQL for cleaning and analysis. Correct answer
C: Use Storage Transfer Service to move the data to a different Cloud Storage bucket. Use event triggers to invoke Cloud Run functions to load the data into BigQuery. Use SQL for analysis.
D: Use Cloud Run functions to clean the data and load it into BigQuery. Use SQL for analysis.
Correct Answer:
B. Use BigQuery to batch load the data into BigQuery. Use SQL for cleaning and analysis.
Explanation

Load the raw objects directly into BigQuery using batch load jobs, then employ standard SQL DML (UPDATE, MERGE, DELETE) to correct types, fill nulls, and remove duplicates. BigQuery’s distributed engine performs these set-based cleansing operations at petabyte scale with no additional infrastructure, letting you proceed immediately to analytical queries.

Why Incorrect

A. Cloud Composer adds orchestration overhead; Python executes outside BigQuery, duplicating storage and compute.
C. Storage Transfer plus Cloud Run only moves data; data quality logic still has to be written and orchestrated.
D. Cloud Run scales per-request but requires custom code and separate compute billing; BigQuery alone is simpler and cheaper for SQL cleansing.

References

1. BigQuery Documentation – “Using DML to clean up data” (§Standard SQL DML, 2024).

2. Google Cloud Blog – “Five ways to transform data inside BigQuery” (2022), section ‘Use SQL to fix errors and deduplicate’.

Scroll to Top