Ai Hypercomputer Consumption Model Dynamic Scheduling

What Flex-start is

Flex-start is an AI Hypercomputer and Google Cloud compute consumption model powered by the Dynamic Workload Scheduler (DWS). It allows teams to request dense compute capacity for short-duration workloads lasting up to seven days without committing to a long-term reservation.

How it meets the requirements

• Dense resource allocation: Flex-start allocates GPU nodes physically close to each other within Google Cloud data centers, optimizing dynamic machine learning network fabric throughput and minimizing inter-node latency.
• Non-preemptible execution: Unlike Spot VMs, once Compute Engine provisions a Flex-start instance group or cluster, the VMs run uninterrupted until the workload completes or reaches the maximum run duration of seven days.
• Flexible scheduling: Flex-start queues provisioning requests and automatically instantiates the cluster as soon as the requested contiguous capacity becomes available.
• Cost efficiency: It offers discounted pricing of up to 53% for vCPUs, memory, and accelerator types (such as A3 Ultra and A4 GPUs) on a pay-as-you-go (PAYG) basis, avoiding charges for idle reservation time.

Key advantages and capabilities

• Up to seven-day lifespan: Perfectly matches multi-day fine-tuning runs and batch inference pipelines.
• Broad orchestration integration: Can be provisioned directly via Google Kubernetes Engine (GKE), Slurm clusters, Cluster Toolkit, or Compute Engine Managed Instance Groups (MIGs) with resize requests.
• Higher GPU obtainability: Dynamic queuing gives workloads a higher probability of acquiring scarce accelerator hardware compared to standard on-demand requests.
• Preemptible quota utilization: Leverages preemptible accelerator quotas rather than consuming expensive standard on-demand quotas.

Why this is optimal

Flex-start is specifically designed for non-fault-tolerant, short-duration training and fine-tuning jobs that have flexible start windows. It provides the low-latency network topology of reservations and significant cost savings without the ongoing financial overhead of dedicated calendar reservations.