PRODUCTION SCENARIO
A compliance team uses Gemini to pull policy numbers and effective dates out of letters. Two runs on the same letter sometimes return different dates, and the team wants the most consistent output it can get.
Which parameter change should the team try first?
Answering here is anonymous. Nothing is saved unless you sign in.
Show answer and explanation
Answer: Lower the temperature so the likeliest tokens are picked on each run
Temperature controls how randomly the next token is chosen; lower values suit tasks that need a less open-ended answer, and at a temperature of 0 the highest-probability token is selected, so responses are close to deterministic. Maximum output tokens and stop sequences decide where generation ends rather than how it is sampled, and raising top-K widens the candidate pool, adding variation instead of removing it.