Provisioned Throughput

Related topics

• Cloud Monitoring works with Provisioned Throughput From the official documentation: “The following Cloud Monitoring metrics are available on the `aiplatform.googleapis.com/PublisherModel` resource for the Gemini models. Use the `dedicated` request types to filter for Provisioned Throughput usage.”
• Flex PayGo works with Provisioned Throughput From the official documentation: “To utilize any available Provisioned Throughput quota before using Flex PayGo, include the header `X-Vertex-AI-LLM-Shared-Request-Type: flex` in your requests, as shown in the following samples.”
• global endpoint works with Provisioned Throughput From the official documentation: “Usage of the global endpoint with Provisioned Throughput is available only for the following models:”
• Priority PayGo is an alternative to Provisioned Throughput From the official documentation: “Priority pay-as-you-go (Priority PayGo) is a consumption option that provides more consistent performance than Standard PayGo without the upfront commitment of Provisioned Throughput.”
• Provisioned Throughput works with Standard PayGo From the official documentation: “By default, traffic that exceeds your Provisioned Throughput baseline (called *spillover traffic*) is handled by [Standard PayGo](/gemini-enterprise-agent-platform/models/standard-paygo).”
• Provisioned Throughput works with Supervised fine-tuning From the official documentation: “Provisioned Throughput can be applied to both base models and supervised fine-tuned versions of those base models.”
• Cloud Monitoring works with Gemini Enterprise Agent Platform From the official documentation: “Gemini Enterprise Agent Platform exports metrics to [Cloud Monitoring](/monitoring/docs).”
• Priority PayGo is an alternative to Standard PayGo From the official documentation: “Priority pay-as-you-go (Priority PayGo) is a consumption option that provides more consistent performance than Standard PayGo without the upfront commitment of Provisioned Throughput.”
• Standard PayGo is part of Gemini Enterprise Agent Platform From the official documentation: “For the default pay-as-you-go model, Agent Platform uses [Standard pay-as-you-go (Standard PayGo)](/gemini-enterprise-agent-platform/models/standard-paygo).”
• Supervised fine-tuning is part of Gemini Enterprise Agent Platform From the official documentation: “Agent Platform supports supervised fine-tuning to customize foundational models.”