CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/data-quality-gate

Use when a data pipeline needs one CI step that fails the build when data quality drops. Gathers check results from dbt, Great Expectations or Soda, applies severity-aware thresholds and returns a single go/no-go decision with a reason per check.

Quality

82%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, engine-agnostic gate skill with concrete record shapes, an explicit decision rule, and a genuinely executable worked example. The main weaknesses are the absent failure-handling path (missing/malformed artifacts silently pass) and small navigation frictions: a referenced scripts/ path that does not exist in the bundle and a References section that mixes real links, absent bundle files, and external sibling skills.

Suggestions

Add an explicit validation step in Step 3 or the worked example for missing or unparseable engine artifacts (e.g. treat a configured-but-absent artifact as a blocker, or fail loudly) so the gate cannot false-pass when an engine step was skipped.

Resolve the scripts/run_quality_gate.py reference: either ship the script in a scripts/ directory or reword the body to say the code lives only in references/worked-example.md.

Merge the duplicated link lists - the inline citation definitions and the References section repeat the same three external URLs - and label the sibling-skill entries (dbt-testing/SKILL.md, etc.) as cross-skill pointers rather than bundle references.

DimensionReasoningScore

Conciseness

The body is lean and assumes engine familiarity ("The three engines ... each produce their own per-check output") with dense field-mapping tables and code instead of concept explanations. Minor trimming is possible: the Overview partially duplicates the intro, and the References section re-lists the three external links already cited inline.

4 / 5

Actionability

Provides a concrete unified record JSON, a per-field source mapping table, a runnable gate_decision function, exact markdown/JSON artifact formats, and a fully executable worked example in references/worked-example.md. Minor gaps remain, e.g. how dbt severity is actually extracted (run_results.json does not carry the severity config) and Soda stdout parsing exists only in the reference file.

4 / 5

Workflow Clarity

Steps 1-4 are clearly sequenced (identify sources, flatten to unified record, apply decision rule, emit artifact) with the decision rule as an explicit checkpoint plus a stricter-mode variant. Not a 5 because there is no error-recovery loop for missing or malformed engine artifacts - the worked example silently skips absent files, which can false-pass the gate; not capped at 3 since the operation is read/report rather than destructive.

4 / 5

Progressive Disclosure

Good structure with a clearly signaled, one-level-deep reference ("A full end-to-end collector ... is in references/worked-example.md", which exists as a real file). Minor gaps: the body names scripts/run_quality_gate.py implying a bundle file that does not exist, and the References section points to sibling skills (dbt-testing/SKILL.md etc.) that are not part of this bundle.

4 / 5

Total

16

/

20

Passed

Description

83%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: third-person voice, an explicit 'Use when' trigger tied to a concrete CI scenario, and multiple specific capabilities naming all three supported engines. The only improvements are coverage of the artifact/report output and a few missing natural synonyms such as 'data quality checks' or 'data validation'.

DimensionReasoningScore

Specificity

Lists several concrete, tool-named actions ("Gathers check results from dbt, Great Expectations or Soda", "applies severity-aware thresholds", "returns a single go/no-go decision with a reason per check"). Falls short of anchor 5 because the artifact/report output side of the skill (markdown table, JSON sibling) is not covered - a minor coverage gap, matching anchor 4.

4 / 5

Completeness

Explicitly answers when ("Use when a data pipeline needs one CI step that fails the build when data quality drops") with a concrete trigger scenario, and what (gather results from named engines, apply severity-aware thresholds, return a go/no-go decision with per-check reasons). This matches the anchor-5 pattern of both what and when stated explicitly with concrete triggers.

5 / 5

Trigger Term Quality

Natural user phrasings are present: "data pipeline", "CI step", "fails the build", "data quality", "go/no-go", plus the three engine names users would name directly. Not anchor 5 because common synonyms such as "data quality checks", "data tests", or "data validation" are missing; comfortably above anchor 3's partial coverage.

4 / 5

Distinctiveness Conflict Risk

Clear niche - a unified, engine-agnostic release gate across dbt/GX/Soda - with triggers unlikely to fire for unrelated skills. Minor overlap risk remains with the individual engine skills (dbt-testing, great-expectations, soda-checks) for users working with a single engine, which matches anchor 4 rather than anchor 5's minimal-conflict profile.

4 / 5

Total

17

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

referenced_paths_exist

Referenced path issues: 1 missing

Warning

Total

15

/

16

Passed

Reviewed

On this page