PRODUCTION SCENARIO
An assistant aggregates five MCP servers with about 260 tools, and their definitions consume more than 50,000 tokens per request. Tool selection accuracy has also dropped.
Which change addresses both problems?
Answering here is anonymous. Nothing is saved unless you sign in.
Show answer and explanation
Answer: Add a tool search tool and defer most tools, keeping it and a few frequent ones loaded
The tool search page says selection accuracy degrades past 30 to 50 tools and that deferring tools and loading them on demand cuts definition tokens by over 85 percent while keeping accuracy high. At least one tool, normally the search tool itself, must stay non-deferred or the request returns a 400.