Question

Your company is building a near real-time streaming pipeline to process JSON telemetry data from small appliances. You need to process messages arriving at a Pub/Sub topic, capitalize letters in the serial number field, and write results to BigQuery. You want to use a managed service and write a minimal amount of code for underlying transformations. What should you do?

Accepted Answer

Use the “Pub/Sub to BigQuery” Dataflow template with a UDF, and write the results to BigQuery.

Answer

Use a Pub/Sub to BigQuery subscription, write results directly to BigQuery, and schedule a transformation query to run every five minutes.

Answer

Use a Pub/Sub to Cloud Storage subscription, write a Cloud Run service that is triggered when objects arrive in the bucket, performs the transformations, and writes the results to BigQuery.

Answer

Use a Pub/Sub push subscription, write a Cloud Run service that accepts the messages, performs the transformations, and writes the results to BigQuery.

Your company is building a near real-time streaming pipeline to process JSON telemetry data from small appliances. You need to process messages…

Take the free ASSOCIATE-DATA-PRACTITIONER practice test

Other ASSOCIATE-DATA-PRACTITIONER practice questions