Design observability for coding-agent runs.

Instruction: Describe the traces and metrics you would expose for a coding agent.

Context: Assesses whether the candidate can design a practical architecture and explain the main tradeoffs. Describe the traces and metrics you would expose for a coding agent.

Official answer available

Preview the opening of the answer, then unlock the full walkthrough.

I would log the run as a workflow: task input, grounding artifacts consulted, plan if any, files read, diffs proposed, tests or commands executed, failures encountered, and final human outcome such as accepted, revised, reverted, or rejected.

I also want version metadata...

Related Questions