On-device AI interview questions
On-device AI
Why run a model on the device instead of calling a server? (Easy)
What does quantisation trade away? (Medium)
What constrains a model on a phone beyond available memory? (Hard)
How do you decide between on-device, server, or both? (Extra hard)