PRODUCTION SCENARIO
A company's summarization prompt returns summaries in a format the downstream system cannot parse. The company has several examples of the format that it wants.
Which solution will meet these requirements with the LEAST operational overhead?
Answering here is anonymous. Nothing is saved unless you sign in.
Show answer and explanation
Answer: Add a few of the examples to the prompt as input-output pairs.
Adding a few paired examples to the prompt is few-shot prompting, which calibrates the output to the format the company already has samples of and costs nothing but a prompt edit. Fine-tuning would also teach the format but needs a training job and a customized model to operate. A repair parser adds a component to build and maintain. A stop sequence ends generation rather than shaping structure.