ASSOCIATE-DATA-PRACTITIONER practice question 12 of 25

Your organization uses Dataflow pipelines to process real-time financial transactions. You discover that one of your Dataflow jobs has failed. You need to troubleshoot the issue as quickly as possible. What should you do?

Full set: 106 questions
Answer options
A: Set up a Cloud Monitoring dashboard to track key Dataflow metrics, such as data throughput, error rates, and resource utilization.
B: Create a custom script to periodically poll the Dataflow API for job status updates, and send email alerts if any errors are identified.
C: Navigate to the Dataflow Jobs page in the Google Cloud console. Use the job logs and worker logs to identify the error. Correct answer
D: Use the gcloud CLI tool to retrieve job metrics and logs, and analyze them for errors and performance bottlenecks.
Correct Answer:
C. Navigate to the Dataflow Jobs page in the Google Cloud console. Use the job logs and worker logs to identify the error.
Explanation

The most direct and quickest way to begin troubleshooting a failed Dataflow job is by using the Dataflow monitoring interface in the Google Cloud console. The "Jobs" page provides a centralized view of all pipelines, their status, and a graphical representation of the job steps. Clicking on a failed job immediately provides access to detailed job logs and worker-level logs, which contain the specific error messages, stack traces, and context needed to diagnose the root cause of the failure efficiently.

Why Incorrect

A. A Cloud Monitoring dashboard is excellent for proactive monitoring and alerting but is a secondary tool for diagnosing a failure that has already occurred. The logs contain the specific error.
B. Creating a custom script is slow, inefficient, and unnecessary. The native tools in the Google Cloud console are purpose-built for this task and provide immediate access to logs.
D. Using the gcloud CLI is a valid method, but the visual interface of the Cloud console is generally faster for initial investigation, as it aggregates information and highlights errors graphically.

References

1. Google Cloud Documentation, "Monitor your pipeline". "The Dataflow monitoring interface lets you view and interact with your Dataflow jobs... To view the logs for a specific job, go to the Jobs page in the Cloud console and click the name of the job."

2. Google Cloud Documentation, "Troubleshooting and debugging". "The first place to look when your Dataflow job fails is the job logs... The Dataflow monitoring interface provides several tools for checking the logs of your job." Section: "Finding your job logs".

3. Google Cloud Documentation, "Use the Dataflow monitoring interface". "When you select a job, you can view the job graph, job metrics, job info, job logs, and worker logs."

Scroll to Top