Design an experiment to test the impact of latency on user engagement in an ML-powered application.
Instruction: Outline an approach for scientifically measuring how latency in ML model predictions affects user engagement in an application.
Context: This question evaluates the candidate's ability to design experiments that measure the real-world impact of ML system performance on user experience and business metrics.
Updated
Official answer available
Read the opening below, then unlock the full answer and practical guidance.
I would run a controlled experiment where latency is deliberately varied within safe bounds while keeping the model logic otherwise constant...