PRODUCTION SCENARIO
A legal operations team wants to put an entire 900-page acquisition data room into a single request and ask questions that span documents. The model it tested accepts about 32,000 tokens per request.
Which model characteristic should the team prioritize?
Answering here is anonymous. Nothing is saved unless you sign in.
Show answer and explanation
Answer: A large context window, so the whole corpus fits in a single request
The context window is how much information a model can take in at once, the rough equivalent of short-term memory. Gemini comes standard with a 1-million-token window, about eight average novels, so a corpus of this size can be submitted whole instead of being chopped into pieces.