CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/notebook-ci-pipeline-author

Wires the papermill-tests, nbval-tests, and testbook-tests skills into a single working GitHub Actions CI pipeline: parameterized execution (papermill) -> output regression (nbval) -> function unit tests (testbook) -> artifact upload (executed .ipynb + HTML report). Use when a team has notebook tests spread across the three tools but assembles the pipeline manually and needs a single authoritative workflow file with output stripping (nbstripout), pip caching, and structured failure reporting.

74

Quality

93%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

Overview
Quality
Evals
Security
Files

Quality

Content

100%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-crafted, highly actionable skill body: lean prose, executable snippets at every step, explicit pre-flight validation and failure-aware retention, and clean one-level-deep progressive disclosure into a verified bundle. Minor tightening is possible in the References section but nothing rises to a rubric penalty.

DimensionReasoningScore

Conciseness

Lean and disciplined: it assumes Claude's competence (no explanation of what notebooks/GitHub Actions are), states 'this skill covers only the wiring and integration decisions', and offloads the two longest blocks to the bundle. Each section's prose is load-bearing (e.g. why lax mode, why module-scoped fixture).

3 / 3

Actionability

Every step ships executable, copy-paste-ready snippets — bash for nbstripout, YAML for the workflow stages, Python for the testbook fixture, and an ini sanitize.cfg — with concrete flags and paths rather than pseudocode.

3 / 3

Workflow Clarity

Eight explicitly sequenced stages prefixed by a hard-reject checklist (pre-flight validation), a nbstripout verify gate, and `if: always()` failure-aware retention, plus an anti-patterns table covering failure modes — clear sequence with explicit validation checkpoints.

3 / 3

Progressive Disclosure

Spine holds per-stage snippets and integration decisions; the full assembled workflow YAML and complete testbook test file live one level deep in the real references/notebook-ci-pipeline.md (verified present), clearly signaled with markdown links in Steps 5 and 8.

3 / 3

Total

12

/

12

Passed

Description

85%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong, specific description with an explicit use-trigger and a distinct niche; it correctly uses third-person voice. The only weak spot is trigger-term breadth: the language is technical and aimed at maintainers already familiar with the three tools, so it misses common user phrasings.

Suggestions

Broaden trigger terms toward everyday phrasings a non-specialist would say, e.g. 'Use when notebook CI is slow, flaky, or hand-rolled across papermill, nbval, and testbook' alongside the existing maintainer-facing clause.

Add a few natural keyword variants (e.g. 'notebook testing in CI', 'GitHub Actions for Jupyter', 'notebook regression tests') so the description surfaces for those queries.

DimensionReasoningScore

Specificity

Lists multiple concrete actions in sequence — 'parameterized execution (papermill) -> output regression (nbval) -> function unit tests (testbook) -> artifact upload' — matching the 'lists multiple specific concrete actions' anchor.

3 / 3

Completeness

Answers both 'what' (the four-stage pipeline plus nbstripout/caching/reporting) and 'when' with an explicit 'Use when a team has notebook tests spread across the three tools but assembles the pipeline manually...' trigger clause.

3 / 3

Trigger Term Quality

Contains relevant terms ('notebook tests', 'CI pipeline', 'GitHub Actions', 'assembles the pipeline manually') but they are niche and jargon-heavy, lacking the common natural variations a broader user base would say. Not a 3 because coverage of everyday phrasings is thin; not a 1 because several usable trigger words are present.

2 / 3

Distinctiveness Conflict Risk

Occupies a clear niche — wiring three named sibling skills (papermill-tests, nbval-tests, testbook-tests) into one workflow — with distinct triggers unlikely to fire for unrelated skills.

3 / 3

Total

11

/

12

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

Total

15

/

16

Passed

Reviewed

Table of Contents