Design observability for multi-step agent traces.

Instruction: Describe the observability you would build for a multi-step AI workflow.

Context: Assesses whether the candidate can design a practical architecture and explain the main tradeoffs. Describe the observability you would build for a multi-step AI workflow.

Official answer available

Preview the opening of the answer, then unlock the full walkthrough.

I would make each trace reconstructible from beginning to end. That means logging user input, relevant context, planner decisions if they exist, tool calls, arguments, retries, errors, latency by step, approvals, and final output, all tied to version metadata for model, prompt, and tool schema....

Related Questions