PRODUCTION SCENARIO
Your ticket-triage prompt carries eight examples, all of them billing complaints labeled billing. In production the model labels shipping delays and login failures as billing as well.
How should the examples be revised?
Answering here is anonymous. Nothing is saved unless you sign in.
Show answer and explanation
Answer: Use three to five examples spanning the label set and its edge cases, wrapped in example tags
Examples have to be diverse enough that Claude does not pick up an unintended pattern, and a set drawn from one label teaches exactly the wrong one. Three to five relevant examples covering the label set and its edge cases, wrapped in example tags, give the best results.