Build, deploy, and monitor production ML and generative AI solutions on Gemini Enterprise Agent Platform, and track your readiness for the Professional Machine Learning Engineer exam.
Points to what builds on itWorks with or alternative toHover or tap a line to see what connects the two
Fully Sharded Data Parallel is an alternative to pipeline parallelism From the official documentation: “Achieving maximum performance in Multislice environments requires considering how to shard across the multiple slices. There are typically three choices (data parallelism, fully-sharded data parallelism and pipeline parallelism).”
pipeline parallelism is an alternative to Tensor parallelism From the official documentation: “[vLLM supports running workloads across GPUs with two strategies](https://docs.vllm.ai/en/stable/serving/distributed_serving.html#how-to-decide-the-distributed-inference-strategy): - **Tensor parallelism** splits the matrix multiplications in the transformer layer across…”