Instruction: Outline an approach for scientifically measuring how latency in ML model predictions affects user engagement in an application.
Context: This question evaluates the candidate's ability to design experiments that measure the real-world impact of ML system performance on user experience and business metrics.
Official answer available
Preview the opening of the answer, then unlock the full walkthrough.
I would run a controlled experiment where latency is deliberately varied within safe bounds while keeping the model logic otherwise constant. The goal is to isolate how response-time changes affect engagement metrics such as click-through, completion, retention, abandonment, or satisfaction.
I...