PROFESSIONAL-MACHINE-LEARNING-ENGINEER practice question 1 of 35

You work for an advertising company and want to understand the effectiveness of your company's latest advertising campaign. You have streamed 500 MB of campaign data into BigQuery. You want to query the table, and then manipulate the results of that query with a pandas dataframe in an Al Platform notebook. What should you do?

Answer options

A: Use Al Platform Notebooks' BigQuery cell magic to query the data, and ingest the results as a pandas dataframe Correct answer

B: Export your table as a CSV file from BigQuery to Google Drive, and use the Google Drive API to ingest the file into your notebook instance

C: Download your table from BigQuery as a local CSV file, and upload it to your Al Platform notebook instance Use pandas. read_csv to ingest the file as a pandas dataframe

D: From a bash cell in your Al Platform notebook, use the bq extract command to export the table as a CSV file to Cloud Storage, and then use gsutii cp to copy the data into the notebook Use pandas. read_csv to ingest the file as a pandas dataframe

Correct Answer:

A. Use Al Platform Notebooks' BigQuery cell magic to query the data, and ingest the results as a pandas dataframe

Explanation

The most efficient and integrated method to query data from BigQuery and load it into a pandas DataFrame within a Vertex AI (formerly AI Platform) Notebook is to use the built-in %%bigquery cell magic. This command allows you to execute a SQL query directly against BigQuery and store the results in a specified pandas DataFrame variable in a single step. This approach avoids the overhead of exporting data to intermediate files in Cloud Storage or a local disk, streamlining the workflow significantly.

Why Incorrect

B. Exporting to Google Drive and using its API is an unnecessarily complex, multi-step process not designed for this workflow.
C. Downloading to a local machine and then uploading introduces manual steps and inefficient data transfer through an intermediary machine.
D. This is a viable but less efficient method. It requires three separate commands (bq extract, gsutil cp, pandas.readcsv) and creates unnecessary intermediate files in Cloud Storage and on the notebook's local disk.

References

1. Google Cloud Documentation for Vertex AI Workbench: The official documentation explicitly describes using the %%bigquery magic command to query data and load it into a pandas DataFrame. It states, "To run a BigQuery query and store the results in a pandas DataFrame, add the --dest argument to the %%bigquery magic."

Source: Google Cloud, Vertex AI Documentation, "Query and explore data in a user-managed notebook".

2. Google Cloud BigQuery Client Libraries for Python: The %%bigquery magic is a convenient wrapper around the BigQuery client library. The library's todataframe() method is the underlying function that converts a BigQuery query result set directly into a pandas DataFrame, demonstrating the intended direct integration.

Source: Google Cloud, Python Client for Google BigQuery Documentation, google.cloud.bigquery.job.QueryJob.todataframe().

Keep practicing

Take the free PROFESSIONAL-MACHINE-LEARNING-ENGINEER practice test

Ten exam-style questions with answers and explanations, plus the exam facts and study guides.

Start the free practice test