Instruction: Describe how you would observe the three main operating dimensions of an LLM product together.
Context: Assesses whether the candidate can design a practical architecture and explain the main tradeoffs. Describe how you would observe the three main operating dimensions of an LLM product together.
Official answer available
Preview the opening of the answer, then unlock the full walkthrough.
I would build observability so every optimization has a visible side effect profile. If cost goes down, I want to...
easy
easy
easy
easy
easy
easy