Diagram
A decision tree branching on simplicity, nesting, analytics, and streaming needs to choose CSV, JSON, Parquet, Avro, or structured tables.
Choosing a Format for Google Cloud Storage and Analytics
Choosing a Format for Google Cloud Storage and Analytics means comparing structure, schema handling, and best-fit workload before loading. Data typically lands first in Cloud Storage as files, then moves into a table system for querying. Plan the destination, region, access policy, and whether transfer is one-time or ongoing before loading, so the format and storage choice match both performance and governance needs.
| Format | Structure | Schema and readability | Choose when |
|---|---|---|---|
| CSV | Row-based text | No embedded types, human-readable | The data is flat and simple and needs broad compatibility |
| JSON | Text with nesting | Flexible schema, human-readable | The data is nested or semi-structured from APIs and events |
| Apache Parquet | Columnar binary | Embedded schema, compressed | The workload is large-scale analytics that scans selected columns |
| Apache Avro | Row-based binary | Embedded schema with evolution | The workload is streaming or row-based with changing schema |
| Structured tables | Relational rows and columns | Strict enforced schema | The workload needs typed SQL storage in Cloud SQL or BigQuery |
Domain 1 of 4
30 practice questions
Practice this DomainLast updated