Define success for a case-summary assistant.

Instruction: Choose a primary outcome, define its baseline and denominator, and add guardrails that prevent a misleading success claim.

Context:

A fictional claims-operations team wants an assistant to help employees prepare case summaries. The assistant will not decide claims. The sponsor proposes measuring prompts sent as the main success metric. The team can record end-to-end preparation time, summary corrections, cases completed, and case complexity. No baseline has been collected. Faster summaries matter only if reviewers can use them without extra rework.

Updated

Official answer available

Read the opening below, then unlock the full answer and practical guidance.

I'd use end-to-end preparation time per reviewer-accepted summary as the primary operational outcome. The measurement would include source review, drafting, checking, and corrections, so we don't hide work shifted to another person. I'd report the distribution as well as a central measure because a few difficult cases can drive much of the burden...

Upgrade to view official answer

Related Questions