ASSOCIATE-DATA-PRACTITIONER practice question 20 of 25
You have a Dataflow pipeline that processes website traffic logs stored in Cloud Storage and writes the processed data to BigQuery. You noticed that the pipeline is failing intermittently. You need to troubleshoot the issue. What should you do?
Full set: 106 questionsThe most effective and standard troubleshooting process for an intermittent Dataflow pipeline failure involves a two-step approach. First, use Cloud Logging to inspect the job logs for specific error messages, which reveals what is failing. Second, use Cloud Monitoring to analyze performance metrics (e.g., CPU utilization, memory, system lag) around the time of the failures. This helps correlate the errors with potential resource constraints or bottlenecks, revealing why the failure is occurring.
A. While error grouping is useful, viewing specific error messages first is more direct. A dashboard is for ongoing monitoring, not initial troubleshooting of an unknown intermittent issue.
B. Metrics Explorer is for analyzing metrics, not for validating findings from log charts. The primary step should be to read the error messages directly.
D. Manually checking the UI is inefficient for intermittent issues. Cloud Profiler is for deep code-level performance optimization, not the first tool for general job failures.
1. Google Cloud Documentation, "Monitor a pipeline," Dataflow. "You can use Cloud Monitoring to view metrics about your Dataflow jobs... You can also use Cloud Logging to view log messages from your Dataflow workers."
2. Google Cloud Documentation, "Troubleshoot Dataflow errors," Dataflow. "To troubleshoot a failed Dataflow job, first identify the cause of the error by looking at the job logs... After you identify the error, you might need to debug your pipeline code."
3. Google Cloud Documentation, "Build observable pipelines," Dataflow. "Cloud Logging provides logs from your Dataflow pipeline... Cloud Monitoring provides visibility into the performance, uptime, and overall health of your Dataflow jobs."
Keep practicing
Take the free ASSOCIATE-DATA-PRACTITIONER practice test
Ten exam-style questions with answers and explanations, plus the exam facts and study guides.
More questions
Other ASSOCIATE-DATA-PRACTITIONER practice questions
- Question 1You are designing a pipeline to process data files that arrive in Cloud Storage by 3:00 a…
- Question 2Your organization plans to move their on-premises environment to Google Cloud. Your organ…
- Question 3You are responsible for managing Cloud Storage buckets for a research company. Your compa…
- Question 4You are predicting customer churn for a subscription-based service. You have a 50 PB hist…
- Question 5Your retail company collects customer data from various sources:Online transactions: Stor…
- Question 6Your company has developed a website that allows users to upload and share video files. T…
