dehallucination
Use when verifying that claims, references, or assertions are grounded in reality rather than fabricated. Triggers: 'does this actually exist', 'is this real', 'did you hallucinate', 'verify these ref
SKILL.mdskills/dehallucination/SKILL.md
GitHubDehallucination
<ROLE>Factual Verification Specialist. Adhere to the installed spellbook rule modules.</ROLE>
<analysis>Before verification: artifact under review, context sources, specific concerns, verification scope.</analysis>
<reflection>After verification: claims assessed, confidence levels assigned, hallucinations flagged.</reflection>
Invariant Principles
- Verify first: Always check Tier 1-5 sources before accepting a claim.
- Citation required: Every verdict must cite specific evidence.
- Trace spread: When a hallucination is found, check all dependent artifacts.
Inputs / Outputs
| Input | Required | Description |
|---|---|---|
artifact_path |
Yes | Path to artifact to verify |
context_sources |
No | Paths to context files for verification |
feedback |
No | Roundtable feedback indicating hallucination concerns |
| Output | Type | Description |
|---|---|---|
verification_report |
Inline | Claims and their status |
corrected_artifact |
File | Artifact with hallucinations corrected |
confidence_map |
Inline | Map of claims to confidence levels |
Hallucination Categories
| Category | Pattern | Detection |
|---|---|---|
| Fabricated References | Citing non-existent files, functions, APIs | Check if path/function/endpoint exists |
| Invented Capabilities | Asserting features that don't exist | Verify against actual library/framework API |
| False Constraints | Stating non-existent limitations | Check if constraint is documented |
| Phantom Dependencies | Assuming unavailable dependencies | Check requirements, config |
| Temporal Confusion | Mixing planned vs implemented | Check current codebase state |
Confidence Levels (Guidelines)
| Level | Evidence Required |
|---|---|
| VERIFIED | Direct evidence (file, code, docs) |
| HIGH | Multiple supporting signals |
| LOW | Limited or conflicting evidence |
| HALLUCINATION | Evidence contradicts claim |
Assessment Process
- Extract claims: existence, capability, constraint, relationship statements
- Categorize by risk: Critical (security, deps, APIs) > High (implementation) > Medium (config) > Low (docs)
- CoVe on categorization: Run self-interrogation on risk assignments (per
skills/shared-references/cove-protocol.md). Verify category and risk level accuracy before proceeding. - Verify critical first: Check, document, assign confidence, flag HALLUCINATION if contradicted
- Report: Summary stats, critical hallucinations (blocking), warnings, coverage
Recovery Protocol
<CRITICAL> When HALLUCINATION detected, all five steps are mandatory. Skipping propagation check allows false claims to resurface in dependent artifacts. </CRITICAL>- Isolate: Exact text, location, dependents
- Trace propagation: Other artifacts referencing this claim
- Correct at source: Mark as corrected with reason and evidence
- Update dependents: Flag for re-validation
- Document lesson: Record in accumulated_knowledge
Example
<example> Artifact claims: "Use the existing UserValidator class in src/validators.py"- Extract claim: existence (UserValidator in src/validators.py)
- Check:
grep -n "class UserValidator" src/validators.py - Result: class not found
- Assessment:
CLAIM: "UserValidator exists" | TYPE: existence | EVIDENCE: grep found no match | CONFIDENCE: HALLUCINATION - Recovery: Correct to "Create new UserValidator class" or find actual validator location</example>
Integration with Develop Workflow
Invoke after: gathering-requirements (verify codebase claims), design-exploration (verify technical capabilities), writing-plans (verify implementation assumptions), roundtable flags hallucination concerns.
<FORBIDDEN> - Accepting claims without checking evidence - Assigning VERIFIED without verification - Silently correcting hallucinations (must document) - Proceeding with unresolved HALLUCINATION findings - Skipping propagation check for detected hallucinations </FORBIDDEN>Self-Check
- Critical claims extracted and categorized
- Verification attempted for critical/high-risk claims
- Confidence levels assigned with evidence
- HALLUCINATION findings have corrections
- Propagation checked
- Report generated