CtrlK
BlogDocsLog inGet started
Tessl Logo

setup-caliber

Sets up Caliber for automatic AI agent context sync. Installs pre-commit hooks so CLAUDE.md, Cursor rules, and Copilot instructions update automatically on every commit. Use when Caliber hooks are not yet installed or when the user asks about keeping agent configs in sync.

72

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is setup-caliber in caliber-ai-org/ai-setup

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

This is a well-engineered procedural skill: a five-step conditional workflow where every step checks state before acting, with executable commands, labeled outcomes, fallback chains, and exact user messages throughout. The only notable improvements are trimming a few justificatory asides and moving the inline GitHub Action YAML into an assets file.

DimensionReasoningScore

Conciseness

The body is almost entirely executable commands, decision branches, and exact user-facing messages with no explanations of concepts Claude already knows. A few asides could be trimmed ('faster for daily use since the pre-commit hook runs on every commit', '~500ms per invocation', 'This prompts for the value securely via stdin') and the closing summary template is somewhat padded, matching 'Efficient; minor instances of over-explanation' rather than the lean anchor 5.

4 / 5

Actionability

Every step provides copy-paste-ready bash with labeled outcomes (NOT_INSTALLED, HOOK_ACTIVE, NO_HOOK, ACTION_EXISTS, GH_AVAILABLE), a complete fallback chain (npm -> npx -> NO_NODE), a full workflow YAML file, and exact secret-setting instructions. Only a trivial gap exists (parsing the JSON score value in Step 4), which does not undermine executability of the common cases.

5 / 5

Workflow Clarity

Steps 1-5 are strictly ordered with the governing rule 'check the current state first, then only act if something is missing', giving each step an explicit validation checkpoint. Error-recovery feedback loops are present (npm failure falls back to npx; NO_NODE stops with an exact user message) and the summary checklist closes the process. No destructive or batch operations, so the workflow-clarity cap does not apply.

5 / 5

Progressive Disclosure

No bundle files exist (references/, scripts/, assets/ are absent) and the body references no external files, so there is no nesting or buried content; sections are clearly organized for a self-contained procedural skill. The under-50-lines exception for a section-only score of 5 does not apply to this ~205-line body, and the inline GitHub Action YAML (~20 lines) could arguably live in an assets file, placing this at 'Good structure; most content is appropriately placed' rather than anchor 5.

4 / 5

Total

18

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that pairs concrete capability statements with an explicit, naturally-phrased 'Use when' trigger clause. It is specific and distinct thanks to naming the tool and its artifacts; the only weakness is incomplete coverage of the skill's full capability set and a few missing trigger synonyms.

DimensionReasoningScore

Specificity

Lists several concrete actions ('Sets up Caliber', 'Installs pre-commit hooks so CLAUDE.md, Cursor rules, and Copilot instructions update automatically on every commit') with named artifacts, but coverage is not comprehensive — the body's config generation, scoring, refresh, and team GitHub Action capabilities are absent. Not 3 because it names more than 1-2 specific actions; not 5 because 'comprehensive coverage' would require the remaining setup actions.

4 / 5

Completeness

Explicitly answers both what ('Sets up Caliber for automatic AI agent context sync. Installs pre-commit hooks...') and when with two concrete trigger conditions ('Use when Caliber hooks are not yet installed or when the user asks about keeping agent configs in sync'). Matches the anchor-5 example structure; anchor 4's caveat that 'when' could be more explicit does not apply since the when clause is fully explicit.

5 / 5

Trigger Term Quality

Good natural keyword coverage: 'Caliber', 'hooks are not yet installed', 'keeping agent configs in sync', plus config file names users would mention. A few natural terms are missing (e.g. 'install Caliber', 'update agent rules', 'set up Cursor/Copilot configs'), so it falls between anchors 4 and 5, noticeably above the midpoint.

4 / 5

Distinctiveness Conflict Risk

Clear niche — a named tool (Caliber) for agent-config sync via pre-commit hooks — with triggers referencing the tool by name and a specific installation state. Minimal overlap risk with generic sync or config skills.

5 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
caliber-ai-org/ai-setup
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.