PRODUCTION SCENARIO
A user types the first line of a well-known novel into a GPT model in the Foundry playground and gets the next several sentences back word for word.
What is the model doing?
Answering here is anonymous. Nothing is saved unless you sign in.
Show answer and explanation
Answer: It generates the words most likely to follow the text it was given
Generative language models produce the next series of words that are most likely to follow the previous text, based on their training data. There is no separate lookup or question-answering path; a continuation appears because it is the most likely response to the input.