PRODUCTION SCENARIO
Your due-diligence assistant sends three contracts totaling 60,000 tokens in each request. The prompt opens with the question and detailed instructions, then pastes the contracts underneath. Answers often miss clauses that are plainly present in the documents.
Which prompt restructuring should you try first?
Answering here is anonymous. Nothing is saved unless you sign in.
Show answer and explanation
Answer: Put the contracts at the top in tagged document blocks, with the question and instructions last
Above roughly 20,000 tokens, long documents belong near the top of the prompt, each wrapped in a tagged block with its source metadata, with the query and instructions last. Putting the query at the end has improved response quality by up to 30 percent in testing, most of all on multi-document inputs.