PRODUCTION SCENARIO
A compliance team uses Gemini to pull policy numbers and effective dates out of letters. Two runs on the same letter sometimes return different dates, and the team wants the most consistent output it can get.
Which parameter change should the team try first?
Answering here is anonymous. Nothing is saved unless you sign in.
Show answer and explanation
Answer: Lower the temperature toward 0 so the likeliest tokens are always chosen
Temperature controls how randomly the next token is picked. Lower values suit tasks that need a less open-ended answer, and at a temperature of 0 the highest-probability token is always selected, making responses close to deterministic. Output length and stop sequences shape where generation ends, not how random it is.