Prepare and test your skills
Prepare and test your skills
Free sample question, answered and explained below. The Associate Data Practitioner practice bank has 1,156 more like it. Try 10 free: instant score, no account.
A financial analytics company needs to modernize its data pipeline to process high-volume, real-time streaming transaction records. The solution must support continuous stream ingestion, execute in-flight transformations with sub-second latency, scale automatically during unpredictable traffic spikes, and load the enriched output into BigQuery without requiring manual cluster management.
Which Google Cloud service should the company select to meet these business and technical requirements?
Dataflow is a fully managed, serverless stream and batch data processing service built on the open-source Apache Beam SDK. It enables unified pipeline development for both real-time streaming and high-volume batch workloads, abstracting away operational overhead such as cluster provisioning, scaling, and fault tolerance.
ParDo, GroupByKey, Combine).Dataflow is Google Cloud's premier solution for continuous, serverless streaming transformations. Unlike cluster-based solutions that require capacity sizing or workflow orchestrators that operate primarily on batch schedules, Dataflow delivers sub-second event-driven processing with zero operational overhead.
Cloud Composer is a fully managed workflow orchestration service built on Apache Airflow. It is designed to author, schedule, monitor, and coordinate complex multi-service data workflows using Directed Acyclic Graphs (DAGs) written in Python.
The business requirement called for scheduling recurring batch workflows and managing dependencies across distinct services (such as triggering an ingestion task, running a transformation job, and kicking off a machine learning pipeline sequentially).
Cloud Composer frequently acts alongside Dataflow by triggering and monitoring Dataflow batch jobs, but it cannot replace Dataflow's real-time stream execution engine.
Dataform is a fully managed service that enables data analysts and engineers to develop, test, version-control, and schedule complex SQL-based data transformations directly inside BigQuery using an ELT (Extract, Load, Transform) paradigm.
The scenario required building a modular, version-controlled SQL data modeling layer inside BigQuery to transform raw relational staging tables into clean analytics marts using scheduled batch queries.
A typical enterprise pattern uses Dataflow to ingest and clean real-time streaming data into raw BigQuery tables, followed by Dataform to structure and curate analytical data models within the warehouse.
Dataproc is a managed service for running open-source big data processing engines within the Apache Hadoop, Apache Spark, Presto, and Flink ecosystems. It simplifies the deployment, management, and resizing of compute clusters in the cloud.
The business requirement specified migrating legacy on-premises Apache Spark or Hadoop workloads to Google Cloud with existing code and custom configurations, rather than adopting a native serverless stream processing framework.
Although Dataproc Serverless exists for Spark batch workloads, Dataflow remains the standard Google Cloud architecture for real-time streaming transformations.
Answer them yourself and get your score the moment you finish. No account needed.
Full access includes
Keep the momentum going with these hand-picked practice scenarios
Last updated