Instruction: Describe how you would design streaming so it feels genuinely responsive.
Context: Assesses whether the candidate can design a practical architecture and explain the main tradeoffs. Describe how you would design streaming so it feels genuinely responsive.
Official answer available
Preview the opening of the answer, then unlock the full walkthrough.
I would design streaming around meaningful early progress. Time to first token matters, but time to first useful token matters more. Users should see whether the system understood the request, whether it is searching or calling tools, and when a concise answer is ready...
easy
easy
easy
easy
easy
easy