A long-context model answers correctly without retrieval on benchmarks but fails in production. How would you decide what to keep?

Instruction: Explain how you would decide between long-context prompting and explicit retrieval.

Context: Tests how the candidate diagnoses the problem, chooses the safest next step, and reasons through recovery. Explain how you would decide between long-context prompting and explicit retrieval.

Updated

Official answer available

Read the opening below, then unlock the full answer and practical guidance.

I would not let benchmark performance talk me out of retrieval without checking what the benchmark omitted. Long-context models can look great when the evaluation gives them clean, bounded context and stable documents...

Upgrade to view official answer

Related Questions