professional-cloud-data-engineer
Prepare and test your skills
Prepare and test your skills
Worked example. The correct answer is already marked and every option is explained below, so there is nothing to select here. To answer questions yourself, start the free trial.
Keep the momentum going with these hand-picked practice scenarios
Want more questions like this?
Get a free certification question every week.
Last updated
An enterprise analytics team needs to enrich several terabytes of unstructured customer feedback records already stored in BigQuery standard tables. The team wants to leverage a Gemini foundation model hosted on Vertex AI to perform sentiment summarization and structured entity extraction.
The solution must satisfy the following criteria:
Which architecture should the data engineering team implement?
Train an XGBoost text classification model within BigQuery ML, register it in Vertex AI Model Registry, and deploy it to a Vertex AI endpoint to execute predictions.
Create a BigQuery ML remote model referencing the Vertex AI Gemini model via a Cloud resource connection, and run queries using the ML.GENERATE_TEXT function directly on the analytical tables.
Deploy a custom Dataflow streaming pipeline that reads records, executes synchronous inline HTTP inference calls to an autoscaled Vertex AI online prediction endpoint, and writes the output back to BigQuery.
Export the BigQuery tables to Cloud Storage as JSON files, trigger an asynchronous Vertex AI Batch Prediction job with custom worker pools, and load the results back into BigQuery.
Train an XGBoost text classification model within BigQuery ML, register it in Vertex AI Model Registry, and deploy it to a Vertex AI endpoint to execute predictions.
Create a BigQuery ML remote model referencing the Vertex AI Gemini model via a Cloud resource connection, and run queries using the ML.GENERATE_TEXT function directly on the analytical tables.
BigQuery ML remote models enable BigQuery to orchestrate machine learning inference using models deployed to or hosted in Vertex AI, including foundation models like Gemini. By establishing a secure Cloud resource connection, BigQuery delegates the model execution to Vertex AI while managing query execution and output ingestion automatically.
StudyCerts
StudyCertsML.GENERATE_TEXT function directly against standard BigQuery tables, passing table columns as prompts or structured inputs.Executing inference directly inside the data warehouse via BigQuery ML remote models provides the lowest operational complexity and the highest developer productivity for analytical batch workloads. Compared to extracting data or deploying inline pipeline predictors, it avoids unnecessary data duplication and infrastructure overhead.
Deploy a custom Dataflow streaming pipeline that reads records, executes synchronous inline HTTP inference calls to an autoscaled Vertex AI online prediction endpoint, and writes the output back to BigQuery.
Export the BigQuery tables to Cloud Storage as JSON files, trigger an asynchronous Vertex AI Batch Prediction job with custom worker pools, and load the results back into BigQuery.