CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/notebook-ci-pipeline-author

Use when Jupyter notebooks must run in CI as tests, their outputs must stay stable, or a PR adding notebooks needs review. Wires papermill parameterized runs, nbval output checks, testbook unit tests, nbstripout and artifacts into GitHub Actions, plus a review checklist with a BLOCK or PASS verdict.

Quality

94%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The content is a well-structured pipeline spine: every step is executable, validation and failure handling are explicit (hard-reject gate, dry-run verify, if: always() artifacts, BLOCK/PASS checklist), and detail is correctly offloaded to three real one-level-deep reference files. The only improvement space is minor duplication of rationales across the hard-rejects, steps, and anti-patterns sections.

DimensionReasoningScore

Conciseness

The body is almost entirely repo-specific wiring — YAML snippets, integration decisions, an anti-patterns table, and a checklist — with no inlined tutorials of concepts Claude already knows, but a few rationales are repeated (lax-mode behavior in Step 4 and checklist item 2; the scope="module" fixture rationale in the hard-rejects, Step 5, and the anti-patterns table). This is the efficient-with-minor-trimmable-over-explanation anchor; it is not the lean-every-token-earns-its-place anchor at 5 because of that repetition.

4 / 5

Actionability

Every step carries copy-paste-ready material: bash install commands, papermill CLI invocation, nbval pytest command with a concrete sanitize.cfg, a Python module-scoped fixture, nbconvert and upload-artifact YAML, plus the fully assembled workflow and complete test file in the bundle. This matches the fully-executable anchor covering the common cases.

5 / 5

Workflow Clarity

Nine clearly sequenced steps are gated by an explicit hard-reject check ("State the blocker to the user and stop"), include a nbstripout dry-run verification and if: always() failure-aware artifact recovery, and end in a six-check review checklist with severity levels and a BLOCK/PASS verdict. This matches the top anchor: explicit validation steps, feedback loops for error recovery, and a checklist for the complex process.

5 / 5

Progressive Disclosure

The spine deliberately holds only wiring and integration decisions while per-tool depth (papermill.md, nbval.md) and the two longest blocks (full workflow YAML and test file in notebook-ci-pipeline.md) live in three real one-level-deep bundle files, each clearly signaled inline ("Full papermill depth ... is in references/papermill.md") and catalogued with descriptions in a References section. No nested references exist in the bundle files, matching the clear-overview anchor.

5 / 5

Total

19

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is strong: it opens with an explicit multi-trigger "Use when" clause and then states concrete, comprehensive capabilities naming every tool in the pipeline and the review-verdict deliverable. The only weakness is trigger-term coverage, which omits the .ipynb file extension and common synonyms a user might naturally say.

DimensionReasoningScore

Specificity

The description lists multiple concrete actions covering the full pipeline: "Wires papermill parameterized runs, nbval output checks, testbook unit tests, nbstripout and artifacts into GitHub Actions, plus a review checklist with a BLOCK or PASS verdict". This matches the comprehensive-coverage anchor; score 4 would require a coverage gap, and none is evident.

5 / 5

Completeness

It explicitly answers both questions: the "what" is wiring five specific tools into GitHub Actions plus a review checklist with a verdict, and the "when" opens with an explicit "Use when..." clause listing three concrete triggers. This matches the top anchor with concrete trigger phrases; score 4 would require the "when" to be less explicit.

5 / 5

Trigger Term Quality

Natural trigger phrases are present ("Jupyter notebooks must run in CI as tests", "outputs must stay stable", "PR adding notebooks needs review") alongside tool names, but common variations like the ".ipynb" file extension or synonyms such as "notebook testing" / "regression" are missing. This is the good-coverage-with-a-few-gaps anchor rather than the comprehensive synonym-and-extension anchor.

4 / 5

Distinctiveness Conflict Risk

It occupies a clear niche (notebook CI testing) with named tools (papermill, nbval, testbook, nbstripout) and a distinctive BLOCK/PASS verdict deliverable, so it is unlikely to fire for an unrelated skill. Minimal conflict risk matches the top anchor rather than the minor-overlap anchor at 4.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

On this page