CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

arn-code-catch-up

This skill should be used when the user says "catch up", "catch-up", "arness code catch up", "retroactive docs", "document old commits", "backfill artifacts", "what did I miss", "undocumented commits", "catch up on commits", "document past work", "backfill records", or wants to retroactively document commits that were made outside the Arness pipeline.

Quality

83%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

73%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-engineered procedural skill: concrete git commands, explicit user-confirmation gates with re-ask loops, idempotency handling, and thorough error recovery. Its main flaws are token efficiency — the body duplicates algorithm detail already delegated to its own reference files, and Step 5 repeats its confidence/gaps instructions — and a few judgment-dependent steps (theme grouping, gaps enumeration) that lack concrete criteria.

Suggestions

Remove the inline restatements in Steps 2 and 3 (the three-tier fallback and the seven cross-reference steps) and defer to references/cross-reference-algorithm.md with a one-line summary each — the full duplication costs tokens for no added clarity.

Merge Step 5's duplicated instructions (item 2's "Always set catchup.confidence to 'low'" and item 4's "Always set confidence: 'low'. Populate gaps[] honestly") into a single "honesty constraints" bullet.

Give the grouped batching tier executable criteria — e.g., cluster by shared modified files/module or commit-message prefix — instead of the undefined "commits clustered by theme".

DimensionReasoningScore

Conciseness

The body is mostly operational, but Step 2 ("Read ... cross-reference-algorithm.md for the scan range detection procedure") then restates the entire three-tier fallback inline, and Step 3 ("Follow the cross-reference algorithm from ...") restates all 7 algorithm steps — duplicating content already delegated to the reference file. Step 5 also repeats itself ("Always set catchup.confidence to 'low'" in item 2, then "Always set confidence: 'low'. Populate gaps[] honestly" in item 4). This is more than minor over-explanation (below 4) but contains no concept-teaching padding (above 2).

3 / 5

Actionability

Guidance is largely executable and copy-paste ready: `git log --format='%H|%aI|%s' --no-merges --after=<scan-start>`, `git diff-tree --no-commit-id --name-only -r <hash>`, `mkdir -p <plans-dir>/CATCHUP_<name>/`, concrete thresholds (">80% file overlap", batching tiers 1-5/6-20/21+), exact display templates and error messages, and explicit JSON field mappings. It stops short of 5 because a few steps remain judgment-dependent with no concrete criteria — "commits clustered by theme" gives no clustering basis, and "catchup.gaps — list what information is missing" has no enumeration guidance.

4 / 5

Workflow Clarity

Eight clearly sequenced steps (0-7) with explicit validation checkpoints (Step 1 path validation with exit message, Step 3.1 hash validation, Step 3.6 idempotency check against duplicate records) and genuine feedback loops (Step 4 options 2/3 explicitly re-ask after adjustments; error handling specifies "warn about the malformed file, skip it, continue with remaining files"). This is a batch operation, but validation is present (user confirmation gate, idempotency, error recovery), so the batch-cap at 3 does not apply; the Step 7 completion summary serves as the final checklist.

5 / 5

Progressive Disclosure

Both bundle reference files (references/cross-reference-algorithm.md, references/catchup-record-format.md) exist, are well-signaled with full paths ("Read ... for the record format specification"), and are one level deep with no chained references. It falls short of 5 because Steps 2-3 inline the referenced algorithms rather than cleanly splitting overview vs. detail, and several referenced paths (arn-code-ensure-config, arn-code-save-plan, arn-code-execute-plan references and report templates) live outside this skill's bundle and cannot be resolved here.

4 / 5

Total

16

/

20

Passed

Description

86%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with excellent trigger coverage and an explicit use-when clause that clearly delimits the skill's niche. Its only real weakness is that the 'what' names a single action, understating the scan/cross-reference/generate workflow the body actually performs. Voice is appropriately third-person and there is no fluff.

DimensionReasoningScore

Specificity

The description states one concrete action — "retroactively document commits that were made outside the Arness pipeline" — plus the domain, matching the anchor for 1-2 concrete actions without comprehensive coverage. It omits the skill's other capabilities (scan git history, cross-reference artifacts, generate CATCHUP_ records), so it does not reach 'several specific actions' (4); the action named is concrete rather than generic, so it is above 2.

3 / 5

Completeness

Both questions are answered explicitly: 'what' via "retroactively document commits that were made outside the Arness pipeline" and 'when' via the explicit "This skill should be used when the user says..." clause with concrete trigger phrases. The 'when' is maximally explicit with concrete triggers (better than the 4 anchor, whose 'when' could be more specific), and the 'Use when' clause is present so the completeness-at-3 cap does not apply.

5 / 5

Trigger Term Quality

Eleven natural trigger phrases with genuine synonym coverage — "catch up", "catch-up", "arness code catch up", "retroactive docs", "document old commits", "backfill artifacts", "what did I miss", "undocumented commits", "catch up on commits", "document past work", "backfill records" — all phrasings a user would plausibly say. This matches the comprehensive-synonyms anchor; no common variation of the request is missing.

5 / 5

Distinctiveness Conflict Risk

The niche is clear — most triggers ("arness code catch up", "backfill records", "undocumented commits", "retroactive docs") point uniquely at retroactive commit documentation. It falls short of 'minimal conflict risk' (5) because "catch up", "catch-up", and "what did I miss" are everyday phrases that could fire in unrelated contexts (messages, news, conversations); it is above 3 because the distinctive triggers dominate.

4 / 5

Total

17

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

AppsVortex/arness

Path

plugins/arn-code/skills/arn-code-catch-up/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.