Prepare and test your skills
Prepare and test your skills
Free sample question, answered and explained below. The Associate Data Practitioner practice bank has 1,132 more like it. Try 10 free: instant score, no account.
An enterprise data team is designing an orchestration architecture for their cross-cloud ETL pipelines. The pipeline requires defining complex task dependencies using Python-based Directed Acyclic Graphs (DAGs) within a fully managed open-source Apache Airflow environment.
Which Google Cloud orchestration service should the team select?
BigQuery Scheduled Queries is a built-in scheduling feature within BigQuery that allows users to run recurring SQL queries on a defined cadence (e.g., hourly, daily, or custom intervals).
The scenario described a simple requirement to execute a recurring SQL transformation query every morning inside BigQuery without external service dependencies.
For enterprise data pipelines requiring cross-service dependencies and complex branching, scheduled queries are often replaced by or invoked from Cloud Composer Airflow tasks.
Cloud Composer is a fully managed workflow orchestration service built on the open-source Apache Airflow platform. It provides a managed environment to author, schedule, and monitor complex data pipelines spanning Google Cloud, on-premises systems, and multiple third-party cloud environments.
Cloud Composer is specifically engineered for data-driven batch workflows and complex ETL/ELT orchestration requiring an open-source, DAG-based framework. Unlike lightweight serverless tools or query schedulers, it provides the full feature set of Apache Airflow in a managed Google Cloud architecture.
Workflows is a fully serverless orchestration engine designed to link and coordinate HTTP-based microservices, Cloud Run services, Cloud Functions, and external APIs with sub-second execution latency.
The scenario required a serverless, low-latency orchestrator to coordinate event-driven HTTP services, Cloud Functions, or automated infrastructure operations defined in YAML/JSON.
Workflows excels at microservice coordination, whereas Cloud Composer is purpose-built for data engineering pipelines and batch ETL flows.
Dataproc Workflow Templates provide a lightweight mechanism for orchestrating jobs (such as Spark, PySpark, Pig, or Hive) specifically within the Google Cloud Dataproc ecosystem.
The requirement called for automatically spinning up a temporary Dataproc cluster, running a series of Spark and Hive jobs with basic dependencies, and terminating the cluster upon job completion.
In complex architectures, Dataproc jobs or templates are frequently triggered as single task operators inside a broader Cloud Composer DAG.
Answer them yourself and get your score the moment you finish. No account needed.
Full access includes
Keep the momentum going with these hand-picked practice scenarios
Last updated