LLM fundamentals interview questions
LLM fundamentals
What is a token, and why does it matter to you as a developer? (Easy)
What does temperature control, and when would you set it low? (Medium)
Why do models hallucinate, and which mitigations actually work? (Hard)
A feature is accurate at 2k tokens of context and degrades at 60k. What is happening? (Extra hard)