agent-failure-introspection
Diagnose failed or unreliable agent workflows by classifying bad assumptions, missing observations, tool misuse, wrapper failures, hidden repair loops, incomplete validation, handoff gaps, and repeate
SKILL.mdskills/agent-failure-introspection/SKILL.md
GitHubAgent Failure Introspection
Purpose
Turn an agent failure into evidence, a likely failure class, and the smallest durable fix to the harness or project workflow.
Inspect First
- failing command output, browser logs, review findings, task plan, changed files, and validation evidence
PROGRESS.md,DECISIONS.md, feature state, termination evidence, and sprint/task traces when present- scripts or wrappers involved in the failure
Procedure
Capture the failure.
- Record expected behavior, actual behavior, commands run, files inspected, and the first observed failure.
- Avoid rewriting history with post-hoc assumptions.
Classify the failure.
- Run
scripts/diagnose_agent_failure.py <repo-or-report> --jsonwhen available. - Check for missing inspection, wrong tool use, stale instructions, skipped validation, wrapper no-ops, hidden retries, unrecorded assumptions, weak handoff, or premature completion.
- Use
$trajectory-risk-supervisorwhen the failure is a repeated trajectory pattern, such as edit-before-inspection, repeated failures, or finalization without validation.
- Run
Decide the durable response.
- Fix project code only when the root cause is project behavior.
- Promote repeated process failures through
$review-feedback-promoter. - Add missing evidence gates through
$pre-edit-investigation-gate,$termination-gatekeeper, or$skill-compliance-auditor.
Write a concise report when useful.
- Use
assets/templates/agent-failure-report.md.tmpl. - Include reproduction, likely cause, evidence, and next validation commands.
- Use
Validation
- Confirm diagnosis cites observed logs, files, or command output.
- Confirm the proposed fix maps to code, docs, tests, scripts, or skill guidance.
- Run the smallest command that proves the failure no longer reproduces, or record the blocker.
Completion Criteria
- The failure is classified with evidence and a clear next action.
- Repeated failures are promoted into durable harness checks instead of handled as one-off memory.