research-fact-source-sync
Sync research facts, experiment metrics, terminology, figures, and thesis/paper prose from authoritative source files. Use when Codex is asked to update a paper after code/data/benchmark changes, alig
SKILL.mdskills/research-fact-source-sync/SKILL.md
GitHubResearch Fact Source Sync
Use this skill to keep a research paper aligned with code, experiments, figures, and evidence.
Workflow
- Identify authoritative sources before editing prose:
- claim manifest or result summary;
- term mapping or glossary;
- document hub or affected-file list;
- figure manifest, evidence report, or run log.
- Classify the change:
- new fact or metric;
- renamed term;
- changed experiment status;
- new boundary, failure case, or limitation;
- figure/table replacement.
- Update source-of-truth records first. If they do not exist, create a small manifest rather than scattering facts only in prose.
- Do one long synchronized update across all affected paper locations.
- Search for stale wording, old numbers, old model names, and over-claims.
- Record verification evidence: grep output, compiled PDF status, rendered page paths, or review notes.
Guardrails
- Do not let narrative prose become the only source of truth for numeric claims.
- Separate main experiments from pilots, pressure tests, and extension experiments.
- Separate complete coverage from manual correctness validation.
- Keep LLM-generated prose downstream of facts; do not let an LLM invent schools, scores, citations, or experimental metrics.
- Preserve failure cases and scope boundaries in the paper when they materially affect claims.
Useful Resources
- Read
references/sync-checklist.htmlfor the detailed synchronization checklist. - Use
assets/claim-manifest.htmlas a starter page when a project lacks a claim manifest.