CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/notebook-ci-pipeline-author

The single home for Jupyter notebook testing: wires parameterized execution (papermill), output regression (nbval), function-level unit tests (testbook), output stripping (nbstripout), and artifact upload into one working GitHub Actions CI pipeline, with per-tool depth for papermill (parameters tag, CLI/API, sweeps) and nbval (strict/lax modes, per-cell markers, sanitize config) in references/. Includes a notebook PR review checklist covering untested notebooks, --nbval-lax misuse, hardcoded credentials, non-deterministic output cells, missing parameters tags, and committed outputs, with BLOCK / WARN / INFO severities and a BLOCK-or-PASS verdict. Use when notebooks must run as parameterized regression jobs in CI, when a repo ships .ipynb files whose outputs must stay stable, or when a PR that adds or modifies notebooks needs a structured quality review.

76

Quality

96%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

Overview
Quality
Evals
Security
Files

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a well-structured, executable CI pipeline guide with clear sequencing, validation gates, and appropriate offloading of tool depth to references. Its only weakness is mild citation/reference verbosity that slightly inflates the token budget.

Suggestions

Consolidate the trailing 'References' list — most link targets are already cited inline — to cut duplicate tokens.

Reduce the recurring 'per the [X docs]' phrasings; a single citation per claim suffices.

DimensionReasoningScore

Conciseness

The body is efficient and avoids explaining concepts Claude already knows (no 'what is a notebook' filler), but the repeated 'per the [docs]' citation phrasings and the duplicated reference link list at the end add tokens that could be trimmed. Not 5 because of this citation verbosity; not 3 because it does not over-explain known concepts.

4 / 5

Actionability

Provides copy-paste-ready bash, YAML workflow snippets, a Python fixture, and a sanitize.cfg example covering the common pipeline cases end to end.

5 / 5

Workflow Clarity

Steps 1-9 are clearly sequenced, with upfront hard-reject validation ('State the blocker to the user and stop'), an anti-patterns table, and a review checklist that ends in a BLOCK-or-PASS verdict — explicit checkpoints and feedback loops for a batch CI operation.

5 / 5

Progressive Disclosure

SKILL.md is an overview that delegates per-tool depth to one-level-deep, well-signaled references (references/papermill.md, references/nbval.md, references/notebook-ci-pipeline.md — all present in the bundle), keeping wiring and integration decisions inline.

5 / 5

Total

19

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is third-person, concrete, and answers both 'what' and 'when' with explicit trigger phrases and a named file extension. It is dense but not padded, with no over-claims.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — 'wires parameterized execution (papermill), output regression (nbval), function-level unit tests (testbook), output stripping (nbstripout), and artifact upload' plus a six-item PR review checklist — giving comprehensive, non-abstract coverage.

5 / 5

Completeness

Explicitly states what the skill does (wires tools into one CI pipeline, ships a review checklist with BLOCK/WARN/INFO severities) and gives an explicit 'Use when...' clause with three concrete trigger scenarios.

5 / 5

Trigger Term Quality

Covers natural user phrasing ('Jupyter notebook testing', 'PR that adds or modifies notebooks', '.ipynb files') alongside tool names and the file extension, with synonyms for the use cases.

5 / 5

Distinctiveness Conflict Risk

Occupies a clear niche — Jupyter notebook CI pipelines with named tools and a notebook-PR review checklist — with triggers unlikely to fire for unrelated skills.

5 / 5

Total

20

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

Total

15

/

16

Passed

Reviewed

Table of Contents