Diagram
A decision tree branching on control, management level, and scaling needs to pick GKE for deep control and scale, Vertex AI for managed MLOps speed, or Cloud Run for serverless scale-to-zero inference.
Platform Options and Business Trade-Offs
Platform options for generative AI trade management level and control for speed, scale, and operational work. GKE is Google-managed Kubernetes with deep control, Vertex AI is a fully managed end-to-end platform, and Cloud Run is a fully managed serverless platform for containers.
| Platform | Management level | Control and flexibility | Best-fit workload | Cost, latency, and time-to-market implications |
|---|---|---|---|---|
| Google Kubernetes Engine (GKE) | Google-managed Kubernetes; Autopilot automates operations and right-sizing | Deep control, portability, custom pipelines, kernel-level customizations | Large-scale training and inference; standardized multi-tenant AI platform | Cost efficiency at scale with Spot and Flex-start VMs; low-latency serving with Inference Gateway; requires Kubernetes expertise |
| Vertex AI | Fully managed, end-to-end platform | Less infrastructure control; offloads management | MLOps and rapid time-to-value | Accelerates development and improves time-to-market |
| Cloud Run | Fully managed serverless platform | Containerized inference with scale-to-zero; less cluster control | Event-driven applications; serving smaller models cost-effectively; GPU inference | Scales to zero and scales rapidly on demand; rapid deployment from prototypes with minimal configuration |
Domain 1 of 5
36 practice questions
Practice this DomainLast updated