Instruction: Describe how you would protect the system when different kinds of changes can all create regressions.
Context: Assesses whether the candidate can design a practical architecture and explain the main tradeoffs. Describe how you would protect the system when different kinds of changes can all create regressions.
Official answer available
Preview the opening of the answer, then unlock the full walkthrough.
I would define the gate around change type and failure risk. Model changes, prompt changes, and tool-contract changes all need some shared core tests, but each also deserves targeted slices that reflect how it tends to break the system.
The gate should...
easy
easy
easy
easy
easy
easy