PRODUCTION SCENARIO
A nightly batch of 20,000 classification requests shares an 8,000-token policy prefix. The team enables prompt caching with the default TTL, but most batch requests still report zero cache reads.
Which change is most likely to raise the cache hit rate?
Answering here is anonymous. Nothing is saved unless you sign in.
Show answer and explanation
Answer: Use the 1-hour cache duration, since batches can run past 5 minutes
Batches can take longer than five minutes, so the default entry expires mid-run and the batch docs recommend the 1-hour cache duration for batches with shared context. The other three are also documented batch-caching advice, and two of them are already satisfied here: the prefix is identical across requests and is already shared as widely as it can be. Keeping a steady stream of requests cannot apply to a batch submitted once overnight and processed concurrently in any order.