Instruction: Outline the key elements of a Pre-Post study design, including how you would control for external factors.
Context: Candidates should demonstrate their ability to design a causal study that controls for time-invariant unobserved heterogeneity and accounts for potential external factors influencing the outcome.
Official answer available
Preview the opening of the answer, then unlock the full walkthrough.
First, let's clarify our primary objective: We aim to measure the causal impact of the UI redesign on user experience. To do this, we'll need to establish clear metrics for user experience. These could include measures such as daily active users (DAU), which we define as the number of unique users who log in and interact with our platform on any given day, session length, the average time a user spends on the platform during a visit, and user satisfaction scores, typically gathered through surveys or feedback tools.
Next, to control for time-invariant unobserved heterogeneity, we must ensure that we are comparing like with like. This means carefully selecting a period before the UI redesign and a comparable period after the redesign has been implemented. The selection of these periods...