CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

pufferlib

High-performance reinforcement learning framework optimized for speed and scale. Use when you need fast parallel training, vectorized environments, multi-agent systems, or integration with game environments (Atari, Procgen, NetHack). Achieves 2-10x speedups over standard implementations. For quick prototyping or standard algorithm implementations with extensive documentation, use stable-baselines3 instead.

64

Quality

80%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./backend/cli/skills/ml-training/pufferlib/SKILL.md

The canonical home for this skill is pufferlib in K-Dense-AI/scientific-agent-skills

SKILL.md
Quality
Evals
Security

Quality

Content

71%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, highly actionable overview that uses progressive disclosure effectively with a real, matching bundle. The main weaknesses are redundancy — the Resources section and Tips list restate content already given — and validation steps that are named but lack concrete commands.

Suggestions

Cut the 'Resources' section (it duplicates the per-capability reference summaries) or reduce it to a one-line-per-file table, and trim the ten-item Tips list to the few non-obvious ones.

Concretize the workflow checkpoints: show the actual command or snippet for 'Test environment locally' (e.g., the testing utilities in scripts/env_template.py) and what output confirms the environment is valid before scaling.

Merge 'Common Use Cases' into the capability sections (it repeats the same pufferlib.make patterns) and define placeholders like 'my_policy' so the training-loop example is copy-paste ready.

DimensionReasoningScore

Conciseness

The code examples themselves are lean and executable with no conceptual over-explanation, but the body carries noticeable padding: the ~80-line 'Resources' section re-describes every reference file already summarized inline, the ten-item 'Tips for Success' list includes filler like 'Read references as needed', and 'Common Use Cases' repeats code patterns from 'Core Capabilities'. This fits 'mostly efficient but includes some unnecessary explanation or could be tightened' rather than the severely padded level 2.

3 / 5

Actionability

Abundant concrete, runnable guidance: CLI commands ('puffer train procgen-coinrun --train.device cuda...'), a full training loop, a complete PufferEnv class, a Policy module, and integration snippets with real environment names. Minor gaps keep it from 5 — e.g., 'my_policy' and 'create_policy' are never defined, and the Policy example references undefined 'obs_dim'/'num_actions' variables.

4 / 5

Workflow Clarity

The four 'Quick Start Workflow' sections give clearly numbered, ordered steps, and each includes an explicit checkpoint ('Test environment locally', 'Profile current throughput', 'Test with environment before full training'). It falls short of 5 because the checkpoints are named but not concretized — there is no example validation command or expected-output check for testing an environment before scaling training.

4 / 5

Progressive Disclosure

The body is a genuine overview: each capability section keeps a short inline example and signals exactly what the one-level-deep reference covers ('read references/training.md for:...'), the two scripts are referenced from the workflows, and all referenced paths (training.md, environments.md, vectorization.md, policies.md, integration.md, env_template.py, train_template.py) exist in the bundle. Navigation is easy and the split is appropriate, matching the top anchor.

5 / 5

Total

16

/

20

Passed

Description

82%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with explicit what/when structure, good trigger terms, and excellent distinctiveness via an explicit contrast with stable-baselines3. Its main flaws are second-person voice in the trigger clause and a slightly buzzwordy speedup claim.

Suggestions

Rewrite the trigger clause in third person (e.g., 'Use when the user needs fast parallel training...' or 'For fast parallel training, vectorized environments, multi-agent RL, or Atari/Procgen/NetHack integration') to remove the second-person 'you'.

Ground or trim the '2-10x speedups over standard implementations' over-claim, and add high-frequency synonyms like 'RL', 'PPO', or 'Gymnasium' to the trigger terms.

DimensionReasoningScore

Specificity

The description lists several concrete capability areas ('fast parallel training, vectorized environments, multi-agent systems, or integration with game environments (Atari, Procgen, NetHack)') and grounds them in named frameworks, which sits at the 'several specific actions, minor gaps' level (4). However, it uses second person voice ('Use when you need...'), which the guidelines penalize by one point, and the unqualified '2-10x speedups' claim reads as an over-claim rather than a concrete action.

3 / 5

Completeness

It explicitly answers both what ('High-performance reinforcement learning framework optimized for speed and scale... 2-10x speedups') and when ('Use when you need fast parallel training, vectorized environments, multi-agent systems, or integration with game environments'), and adds explicit negative guidance ('For quick prototyping or standard algorithm implementations with extensive documentation, use stable-baselines3 instead').

5 / 5

Trigger Term Quality

Good natural keyword coverage: 'reinforcement learning', 'parallel training', 'vectorized environments', 'multi-agent systems', and named game environments (Atari, Procgen, NetHack) are phrases users would plausibly say. A few common variations are missing, such as 'RL', 'PPO', 'train an agent', or 'gym/Gymnasium', keeping it just below the comprehensive synonym level.

4 / 5

Distinctiveness Conflict Risk

It carves out a clear niche (high-performance/parallel RL with specific game-environment integrations) and explicitly disambiguates from the nearest competing skill (stable-baselines3), so the risk of triggering for the wrong skill is minimal.

5 / 5

Total

17

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

14

/

16

Passed

Repository

synthetic-sciences/openscience

Path

backend/cli/skills/ml-training/pufferlib/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.