How do you decide which requests deserve the expensive model?

Instruction: Explain how you would choose when to route traffic to a higher-cost model.

Context: Checks whether the candidate can explain the core concept clearly and connect it to real production decisions. Explain how you would choose when to route traffic to a higher-cost model.

Official answer available

Preview the opening of the answer, then unlock the full walkthrough.

I try to spend the expensive model where it changes the user outcome meaningfully. That usually means high-value tasks, ambiguous...

Upgrade to view official answer

Related Questions