Your evaluation says retrieval improved, but user trust got worse. How would you explain the mismatch?

Instruction: Explain how you would reason about a gap between internal retrieval metrics and user perception.

Context: Tests how the candidate diagnoses the problem, chooses the safest next step, and reasons through recovery. Explain how you would reason about a gap between internal retrieval metrics and user perception.

Updated

Official answer available

Read the opening below, then unlock the full answer and practical guidance.

I would explain that the eval improved one layer while the user experienced the whole product...

Upgrade to view official answer

Related Questions