Early AI results are promising, but some outputs could harm user trust. Would you launch?
Instruction: Recommend broad launch, restricted testing or delay from the supplied evidence. Explain the failed gate and what evidence is needed next.
Fictional support-drafting product: outputs go to a human agent before being sent. In 1,000 independently reviewed test drafts, 920 were usable without edits, 70 had minor errors and 10 contained another customer's information. Categories are mutually exclusive. The approved release policy blocks any external pilot with a confirmed cross-customer disclosure; average quality cannot waive that rule. The security lead owns incident assessment; product and security jointly authorize release. No root-cause fix or clean retest exists yet.
Updated
Official answer available
Read the opening below, then unlock the full answer and practical guidance.
Delay any external pilot or broad launch. The supplied sample has 92% usable drafts, 7% minor errors and 1% cross-customer disclosures. Ten confirmed disclosures fail the explicit gate; a high average usability score and human review do not satisfy it.
Contain the issue through the approved security process, restrict test data and access,...
Related Questions
-
easy
-
easy
-
easy
-
easy
-
easy
-
easy