Google Cloud feature

host memory cache

Topic in 1 exam domain

Also called: host memory kv cache, VM host memory cache

A second-tier prefix KV cache stored in VM host memory beneath GPU memory, providing larger capacity at the cost of transfer latency.