Prepare and test your skills

Prepare and test your skills

Free sample question, answered and explained below. The Professional Data Engineer practice bank has 1,353 more like it. Try 10 free: instant score, no account.
An enterprise data lake ingests several terabytes of transactional logs daily into Cloud Storage before loading them into BigQuery for analytics. The engineering team has established the following operational and cost requirements:
event_timestamp) and slicing by merchant identifier (merchant_id).Which architectural strategy should you implement to optimize storage and query costs?
maximum_bytes_billed limit across all user sessions.This approach delays transition to Nearline storage until 90 days, provisions BigQuery BI Engine in-memory compute reservations, and relies on client-side or session-level maximum_bytes_billed settings to mitigate high query costs.
maximum_bytes_billed requires client-side or per-job enforcement and does not enforce structural partition requirements at the table schema level.event_timestamp, leading to inaccurate partition pruning during backfills or delayed log arrivals.The workload consisted purely of real-time interactive business intelligence dashboards operating over newly streamed data where log arrival latency equals event time.
Table-level constraints such as require_partition_filter guarantee cost governance regardless of the client tool or query generator used.
This option deletes raw files from Cloud Storage after 30 days under the assumption that BigQuery Time Travel will preserve historical data for regulatory compliance, while using search indexes on an unpartitioned table and project-level query quotas for cost control.
The requirement was to build a short-term logging search engine where records are discarded within a week and point lookups on random text strings are frequent.
Deleting data from object storage when downstream compliance mandates multi-year retention creates unrecoverable compliance breaches.
event_timestamp, clustered by merchant_id, and configure the require_partition_filter option to true.This solution combines Cloud Storage Object Lifecycle Management for automated storage class tiering with BigQuery table partitioning, clustering, and partition filter enforcement to minimize both storage and query compute expenditures across data lake environments.
event_timestamp prunes scanned partitions to specific days, while clustering by merchant_id colocates related records within those partitions, significantly reducing scanned byte volume.require_partition_filter = true enforces a mandatory predicate on the partition column at the table level, causing any ad-hoc query without a partition filter to fail immediately before scanning data.This design precisely aligns each storage lifecycle stage to access frequency thresholds while using native BigQuery features to minimize byte scans and enforce query governance directly at the storage schema boundary.
merchant_id and cluster by event_timestamp, setting require_partition_filter to false.This option relies on Storage Batch Operations to place newly created objects into Coldline storage immediately and structures the BigQuery table using integer range partitioning on merchant_id with clustering on event_timestamp, leaving partition filtering optional.
merchant_id (an identifier) rather than time is inefficient for date-range analytics. Furthermore, integer range partitioning requires integer keys with discrete ranges, which does not fit categorical or non-continuous merchant IDs as effectively as date partitioning.require_partition_filter to false allows ad-hoc queries to scan the entire table without restriction.Objects were write-once archives queried once every few months, and queries filtered primarily by distinct integer customer account tiers rather than calendar dates.
Partitioning by date aligns with natural log ingestion patterns and enables automated partition expiration.
Answer them yourself and get your score the moment you finish. No account needed.
Full access includes
Keep the momentum going with these hand-picked practice scenarios
Last updated Validated