Prepare and test your skills

Prepare and test your skills

Free sample question, answered and explained below. The Professional Data Engineer practice bank has 1,353 more like it. Try 10 free: instant score, no account.
A data platform team is managing an enterprise data lake on Google Cloud where petabyte-scale datasets in BigQuery and Cloud Storage receive continuous updates. The team needs to implement an automated data quality and monitoring framework to meet the following requirements:
Which architecture should the data platform team deploy to satisfy these requirements?
This approach uses BigQuery scheduled queries to compare complete tables, triggers Sensitive Data Protection inspection templates via event-driven Cloud Functions, and monitors Dataflow worker compute utilization.
You needed to monitor underlying compute infrastructure load for auto-scaling capacity planning and trigger isolated inspection scans on discrete uploaded files.
This architecture executes custom Spark validation scripts on ephemeral Dataproc clusters against the entire dataset, invokes synchronous content.deidentify API calls during batch runs, and routes pipeline execution logs through Cloud Logging sinks into BigQuery.
You needed to perform complex distributed transformations in Apache Spark and programmatically de-identify sensitive fields inline within custom application code before writing output files to storage.
This solution relies on Cloud Composer orchestrating Dataflow batch jobs with Join transforms to compare datasets, leverages Security Command Center (SCC) posture detectors for encryption compliance, and calculates pipeline execution duration in Cloud Logging.
Join pipelines introduces significant pipeline development overhead and compute expense compared to managed Dataplex auto data quality rules.You were performing a one-time database migration verification between disparate storage backends and auditing project infrastructure for ISO/NIST compliance controls.
This architecture combines Dataplex auto data quality scans, Sensitive Data Protection (Cloud DLP) discovery, and Cloud Monitoring with Dataflow metrics to establish an automated, scalable data lake monitoring framework.
DATE or TIMESTAMP column to evaluate only newly appended data records. This avoids scanning entire multi-terabyte or petabyte tables, drastically reducing compute query costs and processing time.data_freshness metric (measuring the age of the oldest unprocessed element) directly into Cloud Monitoring, enabling threshold-based alerting against defined freshness SLOs.This solution relies entirely on native, fully managed Google Cloud services designed for data governance, automated scanning, and streaming observability, avoiding custom script maintenance while ensuring minimal compute overhead.
Answer them yourself and get your score the moment you finish. No account needed.
Full access includes
Keep the momentum going with these hand-picked practice scenarios
Last updated Validated