Latency doubled after adding reranking and citations. What would you change first?

Instruction: Describe your first optimization move when RAG quality features add too much latency.

Context: Tests how the candidate diagnoses the problem, chooses the safest next step, and reasons through recovery. Describe your first optimization move when RAG quality features add too much latency.

Updated

Official answer available

Read the opening below, then unlock the full answer and practical guidance.

I would trace the added latency before removing a trust feature. I would separate retrieval, reranking, evidence assembly, generation, and citation rendering, then compare the slow requests with the earlier path...

Upgrade to view official answer

Related Questions