Design a long-context vs retrieval strategy for a product with highly variable document lengths.

Instruction: Explain how you would decide when to rely on long context and when to retrieve.

Context: Assesses whether the candidate can design a practical architecture and explain the main tradeoffs. Explain how you would decide when to rely on long context and when to retrieve.

Updated

Official answer available

Read the opening below, then unlock the full answer and practical guidance.

I would route based on task shape, corpus size, and trust requirements. Long-context models are useful when the relevant material is already bounded and trustworthy, like one document or a small known set of documents...

Upgrade to view official answer

Related Questions