Prepare and test your skills
Prepare and test your skills
Free sample question, answered and explained below. The Associate Data Practitioner practice bank has 1,156 more like it. Try 10 free: instant score, no account.
A data analytics team has loaded raw event tables into BigQuery. The team needs to develop a data transformation pipeline directly inside the data warehouse using standard SQL, establish table dependencies, implement automated data quality assertions, and track changes using Git-based version control without managing compute clusters or writing code in Java or Python.
Which Google Cloud service should the team choose for this data transformation workload?
Cloud Data Fusion is a fully managed, visual data integration service based on the open-source CDAP framework. It provides a graphical drag-and-drop web interface for building ETL and ELT data pipelines.
The team required a no-code visual ETL interface to extract data from multiple external sources (such as an on-premises Oracle database and Salesforce) and transform it visually before writing it to a data warehouse.
Cloud Data Fusion is focused on visual data integration and movement between varied external data stores, whereas Dataform focuses specifically on code-driven SQL transformations inside BigQuery.
Dataproc is a managed service for running open-source big data processing frameworks such as Apache Spark, Apache Hadoop, Presto, and Hive on Google Cloud compute infrastructure.
The team needed to migrate existing on-premises Apache Spark or Hadoop jobs to Google Cloud to perform heavy distributed machine learning or unstructured data processing using Scala or Python.
Dataproc is an ETL processing engine for large-scale external computing, whereas Dataform is an ELT data modeling tool tailored specifically for relational SQL workloads inside BigQuery.
Dataform is a fully managed service in Google Cloud that enables data practitioners to develop, test, version control, and execute SQL-based transformation workflows directly inside BigQuery. It provides an in-warehouse ELT (Extract, Load, Transform) framework using SQL and SQLX to model data pipelines without provisioning infrastructure.
ref() statements.Compared to external processing frameworks like Dataproc or Dataflow, Dataform operates directly where the data already resides (in BigQuery). It minimizes architectural overhead, eliminates network egress costs, and empowers SQL-focused analysts to manage end-to-end data pipelines reliably.
Cloud Composer is a fully managed workflow orchestration service built on Apache Airflow. It is designed to schedule, trigger, and monitor complex multi-service pipelines across hybrid and multi-cloud environments.
The scenario required enterprise-wide orchestration across multiple disjoint services (for example, triggering an external API download, loading data into Cloud Storage, triggering a Dataform execution, and publishing a Pub/Sub alert).
Cloud Composer can be used to schedule and trigger Dataform workflows, but it is not the tool used by data analysts to write the underlying SQL transformations and test assertions.
Answer them yourself and get your score the moment you finish. No account needed.
Full access includes
Keep the momentum going with these hand-picked practice scenarios
Last updated