Think Together · Start with a Short Story
The girl asks, “Give the kitten a name,” twice and gets different answers from the robot. Does that mean the system is broken?
Lay Out the Process
- Same questionMay have several reasonable continuations
- Sampling settingsCan affect the choice
- Different contextCan change the result too
- Check the requestSee whether the answer still fits
Generation may choose from several candidates, so the same question can produce different answers.
Random sampling, context, model versions, and system settings can all affect the result. Creative tasks often allow many answers; factual questions should still stay close to facts that can be checked.
Getting the same answer repeatedly does not prove it is correct by itself.
Now You Try
Different cat names twice may be fine. What about getting different answers for 3 plus 5?
Ready? Open this to see the explanation
Check the second case: the correct answer is 8. Tell apart open-ended creative tasks from tasks with a definite answer.
One Idea to Take Away
Generation may choose from several candidates, so the same question can produce different answers.
Try covering the diagram above and explaining each step to someone in your family. If one step is hard to explain, return to that card and look again.