Design a simple causal inference study to evaluate the effect of a new chatbot on customer satisfaction.
Instruction: Outline a study design that could be used to reliably measure the causal impact of implementing a new chatbot on customer satisfaction levels.
Context: This question evaluates the candidate's ability to apply causal inference principles to design a practical study for a real-world scenario. Candidates should consider aspects such as the selection of control and treatment groups, methodologies to minimize bias, and how to measure outcomes effectively.
Updated
Official answer available
Read the opening below, then unlock the full answer and practical guidance.
Randomize eligible customers to chatbot availability or the existing support flow, using persistent assignment when customers return. Define whether the target is the effect of offering the chatbot or actually using it; analyze assignment for the former. Randomization need not produce exact baseline balance.
Prespecify a common satisfaction question, follow-up timing and target population...
Related Questions
-
medium
-
medium
-
medium
-
hard
-
hard