Prepare and test your skills
Prepare and test your skills
Free sample question, answered and explained below. The Associate Data Practitioner practice bank has 1,156 more like it. Try 10 free: instant score, no account.
An enterprise collects high-volume telemetry and application logs published to a Google Cloud Pub/Sub topic. The engineering team needs to ingest these messages in real time into BigQuery for immediate SQL analytics while minimizing operational overhead and avoiding the deployment or maintenance of intermediate data processing pipelines.
Which ingestion solution should the team implement?
Cloud Dataflow is a fully managed, serverless stream and batch data processing service based on Apache Beam. It allows developers to define complex data transformation pipelines that read from sources like Pub/Sub and write to sinks like BigQuery.
The scenario required in-flight transformations, such as aggregating events across sliding 5-minute windows, joining telemetry data with external reference datasets, or executing machine learning inference before storing records in BigQuery.
This pattern uses a Pub/Sub Cloud Storage subscription to batch and write incoming messages to Cloud Storage buckets as files (e.g., AVRO, text, or Parquet), followed by scheduled batch load jobs into BigQuery.
The organization required long-term, low-cost raw data archiving in Cloud Storage for compliance or machine learning training, and sub-hour query latency was not a requirement.
A Pub/Sub BigQuery subscription is a specialized, fully managed subscription type in Google Cloud Pub/Sub that automatically writes messages directly to an existing BigQuery table as they are received, completely eliminating the need to write subscriber code or deploy an intermediary pipeline.

When messages already conform to the destination BigQuery table schema (or when simple ingestion of raw payloads and metadata is sufficient), using a BigQuery subscription provides the simplest, lowest-latency, and most cost-effective architecture available in Google Cloud.
Cloud Composer is a managed workflow orchestration service built on Apache Airflow. In this pattern, an Airflow Directed Acyclic Graph (DAG) is scheduled periodically to pull messages from a Pub/Sub topic and load them into BigQuery.
The business needed to coordinate complex, dependency-driven batch processing tasks (e.g., waiting for an external database export, triggering an SQL transformation, and generating downstream daily summary tables).
Answer them yourself and get your score the moment you finish. No account needed.
Full access includes
Keep the momentum going with these hand-picked practice scenarios
Last updated