LLM cost control interview questions
AI cost control
What drives the cost of an LLM feature? (Easy)
What are the cheapest wins on an expensive AI feature? (Medium)
How do you set a per-request budget you can actually enforce? (Hard)
A feature is profitable in aggregate and loses money on a minority of users. What do you do? (Extra hard)