Skip to content
CodeWiki
Practice
Paths
Tracks
Cheatsheets
Playground
Glossary
AI era
Search
⌘K
English
English
Chinese
Practice
Paths
Tracks
Cheatsheets
Playground
Glossary
AI era
English
English
Chinese
Practice
/
Quiz
/
AI and LLM engineering
/
AI and LLM engineering
A team wants to know whether a prompt revision improved its application. Which evaluation…
from AI and LLM engineering
beginner
1 min
A team wants to know whether a prompt revision improved its application. Which evaluation design gives the clearest evidence?
Run the old and new prompt against the same versioned cases, model settings, rubric, and aggregation method
Change the prompt, model, retrieval corpus, and rubric together, then compare one aggregate score
Ask the prompt author which version feels better without recording outputs
Check
Ask AI about this kata
Report an error
next kata
Name the failure mode in which evaluation examples or their answers influence training, t…
Fill in
A new version is available
Reload