professional-cloud-data-engineer
Prepare and test your skills
Prepare and test your skills
Worked example. The correct answer is already marked and every option is explained below, so there is nothing to select here. To answer questions yourself, start the free trial.
An enterprise analytics team manages batch Spark workloads for multiple internal business units. The workloads have the following operational requirements and constraints:
Which architecture and orchestration strategy should the team implement?
Cloud Composer acts as an orchestration engine using Apache Airflow Directed Acyclic Graphs (DAGs) to programmatically manage the lifecycle of ephemeral (job-scoped) Dataproc clusters. In this pattern, the cluster is dynamically provisioned just before job execution and deleted immediately following completion, while all persistent input and output data resides externally in Cloud Storage.
StudyCerts
StudyCerts--image-version) do not conflict across different teams.DataprocCreateClusterOperator, DataprocSubmitJobOperator, DataprocDeleteClusterOperator) fully automate workflow execution.For intermittent, scheduled batch workloads with heterogeneous dependencies and multi-tenant billing requirements, ephemeral Dataproc clusters orchestrated via Cloud Composer offer the best balance of cost efficiency, fault tolerance, and security boundary isolation.
Keep the momentum going with these hand-picked practice scenarios
Want more questions like this?
Get a free certification question every week.