Your evaluation says retrieval improved, but user trust got worse. How would you explain the mismatch?

Instruction: Explain how you would reason about a gap between internal retrieval metrics and user perception.

Context: Tests how the candidate diagnoses the problem, chooses the safest next step, and reasons through recovery. Explain how you would reason about a gap between internal retrieval metrics and user perception.

Official answer available

Preview the opening of the answer, then unlock the full walkthrough.

I would ask whether we improved the metric or the experience. A retrieval system can look better offline while still...

Related Questions