Build, deploy, and monitor production ML and generative AI solutions on Gemini Enterprise Agent Platform, and track your readiness for the Professional Machine Learning Engineer exam.
Points to what builds on itWorks with or alternative toHover or tap a line to see what connects the two
GKE works with Text Generation Inference From the official documentation: “GKE supports these quantization options with TGI:”
Text Generation Inference is an alternative to vLLM From the official documentation: “Deploy open LLM models to GKE using serving frameworks such as vLLM or TGI with optimization settings enabled.”
Cloud Monitoring works with GKE From the official documentation: “Enable Cloud Monitoring on GKE Clusters”
Cloud TPU works with GKE From the official documentation: “Running this SFT workload on Cloud TPU and GKE involves the following components:”
Cloud TPU works with Gemini Enterprise Agent Platform From the official documentation: “You can use TPUs through Compute Engine, Google Kubernetes Engine, and Gemini Enterprise Agent Platform.”
GKE works with vLLM From the official documentation: “GKE supports these quantization options with vLLM:”
Cloud Monitoring works with Cloud TPU From the official documentation: “This guide explains how to use [Cloud Monitoring](https://cloud.google.com/monitoring) to monitor your TPU VMs. Cloud Monitoring automatically collects [metrics](https://cloud.google.com/monitoring/api/metrics_gcp) and [logs](https://cloud.google.com/logging) from your TPU and…”
Cloud Monitoring works with vLLM From the official documentation: “To observe your model's performance, you can use the vLLM dashboard integration in Cloud Monitoring.”
Cloud TPU works with vLLM From the official documentation: “Cloud TPU supports large language model (LLM) inference through two open-source serving libraries: [vLLM](https://docs.vllm.ai/en/latest/) and [SGLang](https://docs.sglang.io/).”
Gemini Enterprise Agent Platform is an alternative to GKE From the official documentation: “You can deploy supported Hugging Face models in Gemini Enterprise Agent Platform or Google Kubernetes Engine (GKE).”
Gemini Enterprise Agent Platform works with vLLM From the official documentation: “Gemini Enterprise Agent Platform uses an optimized and customized version of vLLM.”