Design a scorecard for when to optimize prompts, models, or infrastructure first.

Instruction: Explain how you would decide where to focus optimization work in an AI system.

Context: Assesses whether the candidate can design a practical architecture and explain the main tradeoffs. Explain how you would decide where to focus optimization work in an AI system.

Official answer available

Preview the opening of the answer, then unlock the full walkthrough.

I would build the scorecard around symptom-to-layer mapping. If the issue is unsupported answers with good retrieval, that points toward prompting or model behavior. If the issue is queueing or tail latency, that points toward infrastructure or routing. If the issue is cost explosion with stable quality,...

Upgrade to view official answer

Related Questions