Design a long-context vs retrieval strategy for a product with highly variable document lengths.

Instruction: Explain how you would decide when to rely on long context and when to retrieve.

Context: Assesses whether the candidate can design a practical architecture and explain the main tradeoffs. Explain how you would decide when to rely on long context and when to retrieve.

Official answer available

Preview the opening of the answer, then unlock the full walkthrough.

I would route based on task shape, corpus size, and trust requirements. Long-context models are useful when the relevant material is already bounded and trustworthy, like one document or a small known set of documents. Retrieval becomes more important when the corpus is large, freshness matters, or...

Upgrade to view official answer

Related Questions