Instruction: Describe how you would make model routing maintainable as the product changes.
Context: Assesses whether the candidate can design a practical architecture and explain the main tradeoffs. Describe how you would make model routing maintainable as the product changes.
Official answer available
Preview the opening of the answer, then unlock the full walkthrough.
I would build the routing layer as a product control plane, not as scattered heuristics. That makes it easier to...
easy
easy
easy
easy
easy
easy