Design a model routing strategy for simple versus complex requests.

Instruction: Explain how you would route between models for easy and hard work.

Context: Assesses whether the candidate can design a practical architecture and explain the main tradeoffs. Explain how you would route between models for easy and hard work.

Official answer available

Preview the opening of the answer, then unlock the full walkthrough.

I would start by defining what simple and complex mean in terms the system can actually observe: ambiguity, expected tool use, prompt length, historical error rate, or whether the workflow crosses a business-risk boundary.

Then I would route obvious low-risk requests to the cheaper path, keep high-value...

Related Questions