CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

weights-and-biases

W&B: log ML experiments, sweeps, model registry, dashboards.

Quality

71%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./optional-skills/mlops/evaluation/weights-and-biases/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

67%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is well-organized, code-first, and actionable, covering the full W&B workflow surface with correct modern APIs and a genuine one-level-deep reference bundle. Its weaknesses are redundancy (three near-identical training-loop examples, a redundant sweep-strategies section) and off-task marketing content (usage stats, pricing), plus in-body duplication of material already in the reference files.

Suggestions

Cut the marketing material ("Users: 200,000+ ... GitHub Stars: 10.5k+" line and the Pricing section) and merge the three near-duplicate init/log training-loop examples into one, per the conciseness rubric.

Trim the in-body Sweeps and Integration Examples sections to a minimal quick-start snippet and point to references/sweeps.md and references/integrations.md from within those sections instead of only in the trailing "See Also".

Replace the vague commented-out offline recovery step with the concrete command (e.g., `wandb sync wandb/offline-run-*`) and add a verification checkpoint after logging/saving (e.g., check run.url or confirm artifact upload) to strengthen workflow clarity.

DimensionReasoningScore

Conciseness

Mostly code with little prose padding, but several sections are unnecessary or duplicated: the basic, PyTorch, and configuration-tracking examples repeat the same init/config/log pattern; "Sweep Strategies" re-lists three sweep_config variants after a full example; and marketing material ("Users: 200,000+ ML practitioners | GitHub Stars: 10.5k+", the Pricing section) does not help Claude use the tool. This matches the score-3 anchor ("Mostly efficient but includes some unnecessary explanation or could be tightened").

3 / 5

Actionability

Concrete, largely executable code throughout: pip install/wandb login commands, a complete PyTorch training loop, full sweep config with wandb.sweep/wandb.agent, artifact create/add/log/use calls, and the correct modern Keras callbacks (WandbMetricsLogger/WandbModelCheckpoint with a note that the monolithic WandbCallback was removed). Only minor gaps keep it from 5: stubs like train_epoch() and build_model(wandb.config), undefined train_acc/val_acc in the first example, and the vague commented-out "# wandb sync <run_directory>".

4 / 5

Workflow Clarity

Task workflows are clearly sequenced in code (install → login → init → log → finish; sweep config → sweep_id → train function → agent; artifact create → add → log → use), matching the score-4 anchor. It is not 5 because there are no validation/feedback checkpoints (e.g., verifying a run URL opened, checking sync status, confirming artifact upload succeeded), and the offline-mode recovery step is left as a vague comment.

4 / 5

Progressive Disclosure

The bundle's three reference files (references/sweeps.md, artifacts.md, integrations.md — verified to exist with substantial content) are each signaled one level deep in a "See Also" section with one-line descriptions, and the body stays at overview level. Minor gaps keep it from 5: the sweeps and integrations sections in the body substantially duplicate what the reference files cover, and the relevant sections never point to their corresponding reference file in context (all pointers are deferred to the bottom of the document).

4 / 5

Total

15

/

20

Passed

Description

66%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is concise and names the tool plus four concrete capability areas, with good natural trigger keywords. Its main weaknesses are the absence of any explicit 'use when' trigger clause and missing common synonyms (wandb, Weights & Biases, experiment tracking) and the artifacts capability.

Suggestions

Add an explicit trigger clause, e.g. "Use when the user mentions W&B, wandb, Weights & Biases, experiment tracking, or hyperparameter sweeps."

Include the synonyms users naturally say: "wandb" (the package/import name) and the full name "Weights & Biases".

Mention artifact logging/versioning to close the coverage gap and mention "metrics" or "experiment tracking" as natural trigger terms.

DimensionReasoningScore

Specificity

"log ML experiments, sweeps, model registry, dashboards" lists several concrete capability areas, matching the score-4 anchor ("Lists several specific actions; minor gaps in coverage"). It falls short of 5 because artifacts (a major W&B feature) is omitted and items like "sweeps" and "model registry" are terse noun labels rather than fully stated actions.

4 / 5

Completeness

The "what" is clear (logging experiments, sweeps, registry, dashboards) but there is no "Use when..." clause or equivalent explicit trigger guidance, so per the judging guideline completeness is capped at 3 ("Has a clear 'what' but 'when' is missing or only weakly implied").

3 / 5

Trigger Term Quality

Terms "W&B", "sweeps", "model registry", and "dashboards" are natural phrases users would say, giving good keyword coverage above the score-3 anchor. Not 5: common synonyms "wandb", "Weights & Biases" (full name), "experiment tracking", and "hyperparameter tuning" are missing, which goes beyond a few omissions.

4 / 5

Distinctiveness Conflict Risk

Naming the tool ("W&B") with niche features like "sweeps" and "model registry" makes it mostly distinct with only minor overlap risk against other experiment-tracking skills (e.g., MLflow-style skills), matching the score-4 anchor. It is not 5 because "log ML experiments" and "dashboards" alone are generic phrases shared by competing tracking tools.

4 / 5

Total

15

/

20

Passed

Validation

75%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 12 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

skill_md_line_count

SKILL.md is long (599 lines); consider splitting into references/ and linking

Warning

metadata_version

'metadata.version' is missing

Warning

metadata_field

'metadata' should map string keys to string values

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

12

/

16

Passed

Repository

NousResearch/hermes-agent

Path

optional-skills/mlops/evaluation/weights-and-biases/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.