Prepare and test your skills

Prepare and test your skills

Free sample question, answered and explained below. The Professional Data Engineer practice bank has 1,353 more like it. Try 10 free: instant score, no account.
An enterprise analytics team orchestrates daily data pipeline workflows in Cloud Composer to refresh BigQuery datasets and publish operational dashboards. The data engineering team needs to operationalize these reporting pipelines under strict governance requirements:
Which solution should the team implement?
roles/cloudsql.admin access.This approach attempts to manually record custom metadata by writing records directly into the Cloud SQL instance that hosts the Apache Airflow backend database.
roles/cloudsql.admin provides dangerous administrative database privileges and fails the least-privilege security mandate.You were managing a self-hosted Apache Airflow deployment on Compute Engine virtual machines where custom relational schema tables were used for internal application auditing.
roles/editor basic role to the Cloud Composer service account.This approach configures Airflow's generic lineage backend configuration to write unstructured logs to Cloud Logging, using a reactive Cloud Functions trigger to parse raw SQL queries and infer lineage relationships.
roles/editor) basic role exposes broad permissions across cloud resources rather than limiting access to the environment's actual operational boundaries.You were ingesting workflow logs into a third-party non-Google monitoring engine that strictly required syslog forwarding rather than Google Cloud metadata catalogs.
BashOperator invoking the bq CLI tool, configure Airflow task execution settings with execute_tasks_new_python_interpreter = True, and assign roles/owner to the default Compute Engine service account.This option implements pipeline steps through bash-level CLI wrappers and forces the Airflow worker to spawn a new sub-interpreter process for each task while executing under the default Compute Engine service account.
bq command-line utility through BashOperator does not emit automated BigQuery lineage events unless explicit inlets and outlets are manually configured.execute_tasks_new_python_interpreter = True is a known configuration incompatibility in Cloud Composer that prevents Airflow task logs from being collected and routed properly to Cloud Logging.roles/owner) role gives unbounded administrative access across the entire Google Cloud project.You were running legacy standalone Bash scripts on unmanaged infrastructure without requirements for centralized metadata governance or IAM isolation.
inlets and outlets with BigQueryTable entities for custom PythonOperator tasks, and assign the roles/composer.worker role to the environment's user-managed service account.This solution establishes automated metadata tracking, governance, and secure pipeline orchestration by combining Cloud Composer, Dataplex Universal Catalog, and the Data Lineage API using native OpenLineage integration.
--enable-cloud-data-lineage-integration) automatically activates the preinstalled apache-airflow-providers-openlineage library. Standard operators like BigQueryInsertJobOperator automatically generate and emit lineage events to Dataplex without requiring custom code.inlets and outlets attributes of PythonOperator tasks with BigQueryTable objects (or AUTO for upstream dependencies), custom execution code explicitly registers lineage relations in the catalog.roles/composer.worker) role to a dedicated user-managed service account provides the minimum IAM permissions required for environment operation, PyPI package handling, and Data Lineage API write operations.This architecture leverages fully managed Google Cloud services to achieve automated pipeline tracking with zero custom backend maintenance. It guarantees strict governance while maintaining robust operational SLAs for analytical reporting.
Answer them yourself and get your score the moment you finish. No account needed.
Full access includes
Keep the momentum going with these hand-picked practice scenarios
Last updated Validated