Design an evaluation set for a RAG assistant used by support agents.

Instruction: Describe how you would build an evaluation set for a support-facing RAG system.

Context: Assesses whether the candidate can design a practical architecture and explain the main tradeoffs. Describe how you would build an evaluation set for a support-facing RAG system.

Official answer available

Preview the opening of the answer, then unlock the full walkthrough.

I would build the eval set around the real support failure modes, not just around easy lookups. If the assistant...

Upgrade to view official answer

Related Questions