Skip to content
CodeWiki
Practice
Paths
Tracks
Cheatsheets
Playground
Glossary
AI era
Search
⌘K
English
English
Chinese
Practice
Paths
Tracks
Cheatsheets
Playground
Glossary
AI era
English
English
Chinese
Practice
/
Quiz
/
AI and LLM engineering
/
LLM application basics
Why should a team avoid changing the prompt and model in the same evaluation run?
from LLM application basics
Node 24
beginner
1 min
Why should a team avoid changing the prompt and model in the same evaluation run?
Changing one major variable makes regressions attributable and rollback choices clearer.
Model APIs reject requests when prompt text changes with the model.
Evaluation sets can contain only one prompt version.
A prompt change always costs more than a model change.
Check
Ask AI about this kata
Report an error
next kata
What does this validation fragment print?
Predict the output
A new version is available
Reload