Prepare and test your skills

Prepare and test your skills

Free sample question, answered and explained below. The Professional Data Engineer practice bank has 1,353 more like it. Try 10 free: instant score, no account.
A media and analytics organization needs to ingest large volumes (over 150 TiB) of raw video assets and recurring batch exports stored across on-premises POSIX file systems into Google Cloud Storage. The organization has an active high-bandwidth Cloud Interconnect connection and requires a solution that:
Which batch transfer solution should the organization implement?
Parallel composite uploads are a feature of the Google Cloud CLI (gcloud storage and legacy gsutil) where large individual files are split into component chunks locally, uploaded simultaneously in parallel over multiple threads/connections to Cloud Storage, and recombined into a single composite object on the server side.
An engineer needed to perform an ad-hoc, one-time upload of a few exceptionally large files (e.g., individual multi-terabyte disk images) from a single powerful server directly from the command line.
For enterprise-grade, recurring migrations and synchronizations of hundreds of terabytes across distributed systems, managed services like Storage Transfer Service are preferred over custom CLI scripts.
Storage Transfer Service is a fully managed, scalable Google Cloud service designed for large-scale data movement between on-premises storage systems, other cloud providers, and Cloud Storage. When transferring from local POSIX file systems, it utilizes lightweight on-premises transfer agents packaged as containerized services deployed within your local infrastructure.
Storage Transfer Service is purpose-built for bulk and batch file synchronization from on-premises file systems to Cloud Storage. When sufficient network bandwidth is present, software-driven parallel agent transfers completely bypass the physical logistical turnaround of hardware appliances while ensuring enterprise-grade verification and orchestration.
Transfer Appliance is a high-capacity physical storage device provided by Google Cloud that is securely shipped to a customer's data center, loaded with local data over high-speed network interfaces (such as 10GbE/40GbE), and shipped back to a Google facility to be uploaded directly into Cloud Storage.
The organization had hundreds of terabytes or petabytes of data located in a facility with limited or no internet connectivity (such as remote edge facilities, ships, or data centers with <100 Mbps uplink), making over-the-network migration technically impossible within required timeframes.
For recurring online synchronization, software-based orchestration such as Storage Transfer Service over Cloud Interconnect is the recommended Google Cloud architecture.
BigQuery Data Transfer Service (BQ DTS) is a managed data ingestion service designed to automate data movement directly into BigQuery on a scheduled, managed basis from software-as-a-service (SaaS) applications (such as Google Ads, Salesforce, YouTube Channel Reports) or Google Cloud storage services (such as Cloud Storage buckets and Amazon S3).
The organization needed to schedule automated daily ingests of structured marketing data from SaaS applications or load pre-processed CSV/Parquet files already staged inside Cloud Storage directly into BigQuery tables.
BQ DTS cannot replace Storage Transfer Service when dealing with on-premises file system sources or unstructured object data.
Answer them yourself and get your score the moment you finish. No account needed.
Full access includes
Keep the momentum going with these hand-picked practice scenarios
Last updated Validated