An assistant follows policy in single-turn tests and drifts in long-running sessions. How would you investigate?

Instruction: Explain how you would debug a safety issue that appears over long sessions rather than in one turn.

Context: Investigating long-session drift with current action checks.

Updated

Official answer available

Read the opening below, then unlock the full answer and practical guidance.

I’d find the first deviation in a replayable long-session test and compare the state immediately before and after it...

Upgrade to view official answer

Your preparation path

Work through these questions in order. Read the answer aloud, then explain it in your own words.

1. Start with the foundations

Build the vocabulary and explain the core decisions.

  1. Why is prompt injection different from ordinary bad input? Free sample
  2. How do you separate policy enforcement from model style instructions? Free sample
  3. What information should never flow from untrusted content straight into tool execution? Free sample

2. Apply it to a real workflow

Practice diagnosis, validation, and everyday tradeoffs.

  1. How do you decide where to place guardrails in a multi-step agent workflow? Free sample
  2. A summarization workflow passes unsafe content from retrieval into a downstream action. How would you fix it? Member answer
  3. A reviewer approves a high-risk action because the model framed it confidently. How would you reduce that risk? Member answer

3. Prepare for senior discussions

Explain failure boundaries, recovery, and production choices.

  1. A multi-agent system routes around one guardrail because another agent has broader permissions. How would you fix it? Member answer
  2. OAuth discovery metadata points your agent at an internal URL. How would you prevent SSRF? Member answer
  3. Why can a localhost MCP server still be exposed to attacks from a website? Member answer

Related Questions