CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

waypoint-bio

Use when working with Outpost Bio's open microbiome foundation models - the Waypoint checkpoints (Waypoint-6m, Waypoint-45m, Waypoint-170m), the Atlas pretraining corpus, the Compass eight-task benchmark, or the `waypoint` CLI from the `waypoint-bio` package. Covers embedding microbiome samples, fine-tuning on taxonomic abundance data, benchmarking a checkpoint on Compass, pretraining a GPT-2 model on taxonomic abundance profiles, and converting MetaPhlAn, Kraken2, QIIME 2, or MGnify abundance tables into waypoint format.

73

Quality

92%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is waypoint-bio in K-Dense-AI/scientific-agent-skills

SKILL.md
Quality
Evals
Security

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-engineered skill body: fully executable command coverage for all five subcommands, a correctly ordered workflow with an explicit pre-flight validation gate and error-recovery guidance, and clean deferral of detail to verified one-level-deep references. The only weakness is minor redundancy — two load-bearing warnings are each stated twice, and the citation boilerplate adds length without task value.

Suggestions

State the out-of-vocabulary warning and the ~1,000-sample threshold once (workflow step 2 and 'When to use' respectively) and have the caveats section cross-reference them rather than repeat them.

Move the 'Citing Scientific Agent Skills' and 'Upstream' blocks into a reference file or the frontmatter metadata to keep the body focused on task execution.

DimensionReasoningScore

Conciseness

The body is dense with non-obvious, load-bearing detail (gated-repo 401/403 semantics, `trust_remote_code` revision pinning, defaults worth overriding with exact values, split-leakage warnings) and assumes Claude's competence throughout — no generic explanations of transformers, parquet, or CLIs. It falls short of anchor 5 only because a few warnings are stated twice (out-of-vocabulary dropping appears in workflow step 2 and again in caveats; the ~1,000-sample threshold appears in 'When to use' and in caveats) and the citation/administrative sections ('Citing Scientific Agent Skills', 'Upstream') are boilerplate rather than task-serving — minor trimming is possible, which is anchor 4, not noticeably-verbose anchor 3.

4 / 5

Actionability

Every workflow step is a complete, copy-paste-ready command with flags and realistic arguments (`waypoint embed --model outpost-bio/Waypoint-6m --data dataset.parquet --output embeddings.parquet`), including both classification and regression finetune invocations, converter calls for three profiler formats, and the coverage-check script. Specific examples cover the common cases and concrete defaults are given ('warmup_steps: 1000' → ~50, hidden dims 256/512/768 per model), matching anchor 5 exactly.

5 / 5

Workflow Clarity

The workflow is six clearly numbered, correctly sequenced steps with an explicit validation checkpoint placed before anything else ('Check vocabulary coverage before anything else', with a concrete 0.8 threshold and instruction to re-examine taxonomy labels before trusting downstream numbers), error-recovery guidance (a 401/403 'almost always means access was never requested on that specific repo'), and a load-bearing caveats checklist for the fragile operations (split leakage, batch effects, small-sample regime). This matches anchor 5 ('Clear sequence with explicit validation steps; feedback loops for error recovery; checklists for complex processes') and exceeds anchor 4, whose checkpoints lack the feedback-loop framing.

5 / 5

Progressive Disclosure

SKILL.md is a true overview: each workflow step keeps only the essential command and key gotchas inline, while bulk detail is split across four real, substantive reference files (cli-reference.md, compass-benchmark.md, data-preparation.md, python-api.md — all verified present in the bundle) plus two scripts, each listed with a one-line description in dedicated References/Scripts sections. References are one level deep (reference files point only to bundled scripts, not to further .md files), navigation is easy, and nothing that belongs in a separate file is inlined — matching anchor 5.

5 / 5

Total

19

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exemplary description: an explicit 'Use when...' clause with concrete named triggers, followed by a comprehensive inventory of five specific capabilities. The only gap is a handful of natural domain terms (16S, shotgun, file extensions) that would catch users who describe their data by sequencing method rather than by profiler tool.

Suggestions

Add '16S/shotgun' and common file extensions (.tsv, .parquet) to the trigger terms so users who describe their data by sequencing modality rather than profiler tool also match.

Consider naming the abundance-matrix conversion path ('sample x taxa abundance matrix') as a trigger, since users with plain abundance tables may not mention any profiler.

DimensionReasoningScore

Specificity

The description lists five concrete actions — 'embedding microbiome samples, fine-tuning on taxonomic abundance data, benchmarking a checkpoint on Compass, pretraining a GPT-2 model on taxonomic abundance profiles, and converting MetaPhlAn, Kraken2, QIIME 2, or MGnify abundance tables into waypoint format' — comprehensively covering the skill's capability surface with no gaps. This matches the anchor 'Lists multiple specific concrete actions; comprehensive coverage' and exceeds anchor 4, which is reserved for coverage with minor gaps.

5 / 5

Completeness

Both questions are answered explicitly with concrete trigger phrases: the 'what' ('Covers embedding microbiome samples, fine-tuning..., pretraining..., and converting...') and the 'when' ('Use when working with Outpost Bio's open microbiome foundation models - the Waypoint checkpoints (Waypoint-6m, Waypoint-45m, Waypoint-170m), the Atlas pretraining corpus, the Compass eight-task benchmark, or the `waypoint` CLI'). This matches anchor 5 exactly and clearly exceeds anchor 4, whose 'when' is generic.

5 / 5

Trigger Term Quality

Strong natural keyword coverage: 'microbiome', 'foundation models', 'fine-tuning', 'benchmarking', 'pretraining', plus tool names users actually say ('MetaPhlAn, Kraken2, QIIME 2', 'waypoint CLI'). A few natural terms are missing — '16S', 'shotgun', and file extensions like .tsv/.parquet — which is precisely anchor 4 ('Good keyword coverage; a few natural terms missing'); anchor 5 requires synonyms and file extensions, and a microbiome researcher would plausibly say '16S data' without naming a profiler.

4 / 5

Distinctiveness Conflict Risk

The trigger surface is anchored to uniquely named artifacts ('Waypoint-6m, Waypoint-45m, Waypoint-170m', 'Atlas pretraining corpus', 'Compass eight-task benchmark', 'waypoint-bio package'), giving it a clear niche with minimal conflict risk, matching anchor 5. The generic profiler names (MetaPhlAn, Kraken2, QIIME 2) create only minor theoretical overlap with general microbiome skills, and only within the scoped context of converting to waypoint format — not enough to drop to anchor 4.

5 / 5

Total

19

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_field

'metadata' should map string keys to string values

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

14

/

16

Passed

Repository

synthetic-sciences/openscience

Path

backend/cli/skills/biology/waypoint-bio/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.