cgagentharness-verify
Verify CG-agent-harness backend, native desktop and local model behavior using isolated fixtures and evidence tied to the tested source and binary. Use for smoke tests, regression checks or release ac
SKILL.md.codex/skills/cgagentharness-verify/SKILL.md
GitHubVerify the harness
Read AGENTS.md, INVARIANTS.md, current CI and nearest tests. Identify the real
checkout, source SHA, dirty state, binary and architecture. Preserve operator
homes/services. Inspect fixtures and current test assertions.
Choose checks by the changed contract:
- Backend: run the changed command, route or function and inspect its effects;
use the scoped local checks in
AGENTS.md. Broad regression tests belong in CI. - Contracts: use
cgagentharness-invariant-guardfor current test mapping, including ownership, memory, MCP, web, reload, schedules and notifications. Documentation edits selectinvariant_guard::markdown_stays_on_the_docs_budget. - Native execution:
tests/macos_cargo.rsand process lifecycle tests need real macOS Seatbelt; sandbox permission errors are not application regressions. - Desktop: use
cgagentharness-releasefor packaging order and provenance; select desktop checks andscripts/test-desktop-backend.pycases that exercise the changed boundary against the packaged backend. - Model/runtime: inspect actual inventory and exact configured model tag; do not equate similarly named GGUF/MLX variants or turn on cloud fallback for a smoke test.
For live acceptance, use an owned temporary home and unique port. Record the known binary, environment and listener, issue harmless local chat, then stop it. Fake model/provider tests prove protocol behavior, not availability or live quality. App launch alone is not UI acceptance. Record only native UI interactions actually observed, in the PR body.
Keep a failing-case reproducer for corrections; diagnose baseline failures before
attributing them to the candidate. Report commands, exit statuses, tested
SHA/architecture, artifact hashes and remaining limits. A zero-test selection is
NOT RUN. Follow AGENTS.md for preserving assertions and operator data/services.