LLM evaluation interview questions
LLM evaluation
Why can you not judge an AI feature by trying it a few times? (Easy)
What goes into a useful eval set? (Medium)
What are the failure modes of using a model as the judge? (Hard)
How do you catch a regression caused by the provider rather than by your change? (Extra hard)