CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

autoresearch

Run bounded automated experiment iterations by recording baselines, applying hypothesis patches, comparing metrics, protecting regression guards, and deciding keep, discard, rollback, or block. Use when automated research is requested or a repo/skill needs evidence-backed research, metric tracking, or safe optimisation loops.

Quality

91%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exemplarily lean, imperative skill body: no filler, no explanations of known concepts, concrete ledger and shell templates, a validated fail-fast workflow, and a verified progressive-disclosure map whose reference files all exist one level deep. The only gap is that concrete command templates exist for just one example domain rather than the general case.

DimensionReasoningScore

Conciseness

The body is telegraphic and dense — sections like "Baseline first. Never keep an experiment before baseline evidence exists" and "Treat configured regression gates as absolute" carry operational content with zero explanation of concepts Claude already knows. Every token earns its place, matching the level-5 lean/efficient anchor; there is no over-explanation to justify level 4.

5 / 5

Actionability

Concrete, executable artifacts are present: a copy-paste YAML ledger template with real commands ("./bin/ask evals run ... --json --robot"), a runnable shell iteration example ("uv run train.py --steps 200 --json", "pytest tests/regression_guard.py"), and an explicit decision rule "baseline - candidate >= min_delta". However, the generic workflow path ("Define parser contract, guard command, held-out checks...") stays at directive level without command templates outside the single LLM-training example domain — mostly executable with minor gaps, i.e. level 4 rather than the fully-covered level 5.

4 / 5

Workflow Clarity

The 9-step numbered Workflow sequences the loop with explicit validation checkpoints (baseline-first rule, per-iteration Verify and Guard, step 6 re-reading state), plus a dedicated Validation section with a feedback loop ("Fail fast: stop at first failed gate; do not proceed until it is fixed and rerun") and a Repair section defining fix-rerun-broaden ordering. This batch/potentially destructive skill has validation present, so the level-3 cap does not apply; it matches the level-5 anchor with explicit validation and error-recovery loops.

5 / 5

Progressive Disclosure

A dedicated "Progressive Disclosure" section maps each of the five reference files (autoresearch-project.md, contract.yaml, evals.yaml, task-profile.json, discovery-interview.md) to its purpose, and all five exist as substantive files one level deep with no further nesting. The body stays a lean overview while details live in the bundle — matching the level-5 anchor of well-signaled one-level-deep references with easy navigation.

5 / 5

Total

19

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete, comprehensive action list in third-person imperative voice, paired with an explicit and specific 'Use when' clause. Trigger coverage is good but misses a few natural synonyms (experiments, benchmarks) that users might say.

DimensionReasoningScore

Specificity

The description enumerates multiple concrete actions covering the full loop: "recording baselines, applying hypothesis patches, comparing metrics, protecting regression guards, and deciding keep, discard, rollback, or block" — comprehensive coverage of the skill's capabilities, matching the level-5 anchor rather than the level-4 anchor (which allows minor coverage gaps).

5 / 5

Completeness

It clearly answers both questions: the first sentence states what the skill does with concrete actions, and "Use when automated research is requested or a repo/skill needs evidence-backed research, metric tracking, or safe optimisation loops" is an explicit when-clause with concrete trigger phrases — exactly the level-5 anchor pattern. Level 4 would require the when-clause to be less explicit.

5 / 5

Trigger Term Quality

Natural phrases like "automated research is requested", "evidence-backed research", "metric tracking", and "safe optimisation loops" are terms users would plausibly say. However, common synonyms a user might naturally use — "run experiments", "benchmark", "iterate on" — are missing, so it fits the level-4 anchor (good coverage, a few natural terms missing) rather than level 5 (comprehensive coverage including synonyms).

4 / 5

Distinctiveness Conflict Risk

The bounded-experiment-loop niche with ledger/guard/keep-discard vocabulary is distinctive, but the trigger terms "metric tracking" and "safe optimisation loops" carry minor overlap risk with monitoring or performance-tuning skills, fitting level 4 (mostly distinct, minor overlap with closely related skills) rather than level 5 (minimal conflict risk).

4 / 5

Total

18

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_field

'metadata' should map string keys to string values

Warning

Total

15

/

16

Passed

Repository

jscraik/Agent-Skills

Path

Skills/agent-ops/autoresearch/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.