ASSOCIATE-DATA-PRACTITIONER practice question 14 of 25
You need to create a data pipeline that streams event information from applications in multiple Google Cloud regions into BigQuery for near real-time analysis. The data requires transformation before loading. You want to create the pipeline using a visual interface. What should you do?
Full set: 106 questionsThis solution meets all requirements. Pub/Sub is a global, scalable messaging service ideal for ingesting streaming events from multiple regions. Dataflow provides a managed stream processing service for performing the necessary transformations. Crucially, Google Cloud provides pre-built Dataflow templates, such as "Pub/Sub Topic to BigQuery," which can be deployed and configured through a visual interface (the "Dataflow job builder" in the Google Cloud Console) without writing code. This combination provides a near real-time, transformational, and visually configured pipeline.
B. Using a Cloud Run function requires writing custom code and does not meet the requirement for creating the pipeline using a visual interface.
C. A BigQuery subscription for Pub/Sub is for simple streaming ingest with limited, SQL-based transformations, not the more complex transformations Dataflow handles.
D. This describes a batch processing pattern using Cloud Storage and scheduled jobs, which does not meet the "near real-time analysis" requirement.
1. Google Cloud Documentation, "Create a Dataflow job from a template," Dataflow. "Google Cloud provides a set of Dataflow templates that you can use to create jobs... You can run a template from the Google Cloud console, the gcloud command-line tool, or REST API calls." The console provides the visual interface.
2. Google Cloud Documentation, "Google-provided streaming templates," Dataflow. Lists the "Pub/Sub Topic to BigQuery" template, which "is a streaming pipeline that reads JSON-formatted messages from a Pub/Sub topic and writes them to a BigQuery table." It also supports a UDF for transformations.
3. Google Cloud Documentation, "Choose a data ingestion option," Analytics. This page compares different ingestion patterns, highlighting Pub/Sub and Dataflow for streaming ETL into BigQuery.
Keep practicing
Take the free ASSOCIATE-DATA-PRACTITIONER practice test
Ten exam-style questions with answers and explanations, plus the exam facts and study guides.
More questions
Other ASSOCIATE-DATA-PRACTITIONER practice questions
- Question 1You are designing a pipeline to process data files that arrive in Cloud Storage by 3:00 a…
- Question 2Your organization plans to move their on-premises environment to Google Cloud. Your organ…
- Question 3You are responsible for managing Cloud Storage buckets for a research company. Your compa…
- Question 4You are predicting customer churn for a subscription-based service. You have a 50 PB hist…
- Question 5Your retail company collects customer data from various sources:Online transactions: Stor…
- Question 6Your company has developed a website that allows users to upload and share video files. T…
