Model fine-tuning interview questions
Model fine-tuning
When is fine-tuning the wrong first move? (Easy)
What is LoRA and why is it used instead of full fine-tuning? (Medium)
How do you know a fine-tuned model has overfitted? (Hard)
A fine-tuned model scores better on the evaluation set and users prefer the base model. How? (Extra hard)