agent-observability-replay-trace

Use when a developer wants to iterate on ONE specific Agent Observability / LLM Obs trace whose...

What this skill does for you

Use when a developer wants to iterate on ONE specific Agent Observability / LLM Obs trace whose output they didn't like : re-running that trace against their LOCAL code, seeing a concise diff of the old vs new output, and looping (change code → replay → diff) until satisfied. Invoked as /agent-observability-replay-trace <trace-id> [changes to test]. Signals: "replay this trace"; "iterate on a trace"; "this trace's output is wrong, fix it and re-run"; "re-run trace <id> with <change>"; pasting a trace id from the Agent Observability UI with a description of what to fix. It fetches the trace via the datadog-llmo MCP or the pup CLI, edits code, re-runs the app to emit a NEW trace, and diffs the two : no local server, no browser. For agents traced with ddtrace / LLM Obs (Python first-class), with JSON-serializable entry input. Do NOT use for: scored Experiments or the browser "Replay" button (that's agent-observability-replay-experiment), building an experiment from a dataset/CSV, writing evaluators, root-causing failed traces, or RUM/HTTP session replay.

Quoted from the skill description in the pinned source

Who made it

Publisherdatadog-labs

Repositoryagent-skills

Installs320as of Sep 27, 2026

Use it with Edge

Set up Edge for me: read getedge.cc/SKILL.md and follow it. Then use Edge to load the agent-observability-replay-trace skill from datadog-labs/agent-skills.

Paste it into Claude, ChatGPT, Codex or Cursor.

Or read the skill source first.

Security evidence

Security state at 2026-09-30: reviewed. State definitions. This records static evidence for this revision; live load eligibility is checked again.

3 static scans, 0 counted findings. The listed scanners recorded the results shown for this package revision.

Scanner	Date	Result
Edge static checks	2026-09-27	Pass
Cisco skill-scanner	2026-09-27	Pass
Semgrep Edge rules	2026-09-27	Pass

Static scans check the code, not how well the skill works.

Scanner scope, raw findings and mirrored provider records

Edge static checks (Edge-run): edge-static/1.0.1. Scope: Static patterns for remote execution, credentials with network sends, obfuscation, prompt overrides, hidden Unicode, binaries and persistence. Revision: 7f8b08f4fa57211ac1b2b42d9771c9e0c4d79124. Raw findings: . Counted findings: .

Cisco skill-scanner (Edge-run): cisco-skill-scanner/2.1.0. Scope: Local static, YARA, pipeline and behavioral analyzers; no LLM or AI Defense analysis. Revision: 7f8b08f4fa57211ac1b2b42d9771c9e0c4d79124. Raw findings: 2. Counted findings: .

Semgrep Edge rules (Edge-run): semgrep/1.178.0+edge-rules.c15016a36fd3+offline-v1. Scope: Six Edge-authored static rules with Semgrep CE; offline execution and metrics disabled. Semgrep-maintained rules excluded. Revision: 7f8b08f4fa57211ac1b2b42d9771c9e0c4d79124. Raw findings: . Counted findings: .

Source and licence

Repository: https://github.com/datadog-labs/agent-skills
Pinned skill file: View source at revision
Revision: 7f8b08f4fa57211ac1b2b42d9771c9e0c4d79124
Package hash: sha256:8d13b3f5ef8da46930f204966abcd46c9cf23e1c1b6b3362706a96e7951dcd1d
Licence: MIT