Diagram
A left-to-right process flow showing streaming analytics: event producers send events to Pub/Sub for durable handover, Dataflow runs Apache Beam transforms, and results are written to BigQuery for analysis, with CDC updates applied continuously.
Evolving Storage and Analytics from Archive to Real Time
Transformation of data strategy moves from storing data only for archiving to using data continuously for analytics and machine learning. Early stages favor durable low-cost storage for backups and compliance, while mature stages add pipelines, warehouses, and models for real-time decisions. An evolving storage strategy matches each dataset to access frequency and retention. Cloud Storage holds everything from frequently read analytics data to regulatory archives in buckets accessible from inside and outside Google Cloud. Frequently read data can be served faster with Cloud CDN caching near clients or Rapid Cache for read-heavy ML training and analytics. Data reaches Google Cloud by Storage Transfer Service for large online transfers, Transfer Appliance for large offline transfers with limited bandwidth, or direct upload with console, gcloud CLI, APIs, or client libraries.
Domain 5 of 5
70 practice questions
Practice this DomainLast updated