CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

soda-checks

Use when warehouse data quality (Snowflake, BigQuery, Postgres, Redshift and others) should be checked with YAML-based SodaCL: writing checks, configuration.yml data sources, soda scan runs and CI gating on the exit code, with Soda Core or Soda Cloud.

Quality

88%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is testland/soda-checks

SKILL.md
Quality
Evals
Security

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body delivers a tight, copy-paste-ready workflow from check authoring through CI gating, with concrete YAML, CLI, and bash examples throughout and explicit failure semantics. Sequencing and structure are clear; an explicit recovery loop for failing checks and small trims (Overview framing, the duplicated References section) are all that separate it from the top level.

DimensionReasoningScore

Conciseness

The body is efficient and assumes Claude's competence — no primers on YAML, warehouses, or CI basics — but the Overview's definitional framing ("SodaCL (Soda Checks Language) is a YAML-based domain-specific language for data reliability") and the closing References section, which re-describes links already cited inline, could be trimmed. This lands on the efficient-with-minor-overexplanation anchor rather than the every-token-earns-its-place anchor.

4 / 5

Actionability

Fully executable throughout: a complete checks.yml example, a complete configuration.yml with env-var substitution, exact `soda scan -d warehouse -c configuration.yml checks.yml` invocations, a tee/grep result-parsing snippet, and a copy-paste-ready GitHub Actions workflow. The examples cover the common cases end to end.

5 / 5

Workflow Clarity

Section order mirrors the real workflow (author checks → configure source → run scan → parse results → gate CI), and failure handling is explicit (non-zero exit code, `grep -E '^\s*FAIL'` filtering, `if: always()` log capture for triage). It falls short of the top anchor only because there is no explicit fix-and-rerun recovery loop when checks fail.

4 / 5

Progressive Disclosure

Well-organized single-file structure with clear section headers, and depth is delegated via well-signaled one-level-deep external links (optional-config grammar, evolving scan flag set, the Soda GitHub Action). However, reference-grade material such as the full ~35-line CI workflow is inlined, and at ~230 lines the body exceeds the simple-skill exception that would allow a top score on organization alone.

4 / 5

Total

17

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

This is a strong description: it explicitly covers both what the skill does (authoring SodaCL checks, configuring data sources, running scans, CI gating) and when to use it, with dense natural trigger vocabulary spanning the major warehouses and the Soda tool family. The only weaknesses are a few missing synonym/filename triggers and minor overlap risk with adjacent data-quality tooling when no tool is named.

DimensionReasoningScore

Specificity

The description lists multiple concrete actions — "writing checks, configuration.yml data sources, soda scan runs and CI gating on the exit code" — covering the full author-to-gate workflow with named tooling (SodaCL, Soda Core, Soda Cloud), matching the comprehensive-coverage anchor.

5 / 5

Completeness

Both parts are explicit: the "what" enumerates concrete capabilities (writing checks, configuring data sources, running scans, CI gating on the exit code), and the "Use when warehouse data quality ... should be checked with YAML-based SodaCL" clause gives concrete trigger conditions including warehouse names. The "when" is specific enough to clearly match the top anchor rather than the "could be more explicit" anchor below it.

5 / 5

Trigger Term Quality

Strong natural keywords: "warehouse data quality", "Snowflake, BigQuery, Postgres, Redshift", "soda scan", "Soda Core", "Soda Cloud", "configuration.yml", "CI gating". A few natural terms are missing — e.g., "checks.yml", "data validation", "data testing" — so coverage is good but not exhaustive.

4 / 5

Distinctiveness Conflict Risk

The SodaCL/Soda-specific vocabulary carves a clear niche with minimal conflict from unrelated skills, but the broad lead trigger "warehouse data quality" could also match adjacent data-quality tooling (e.g., dbt tests, Great Expectations) when the user does not name a tool — minor overlap risk with closely related skills.

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

testland/qa

Path

plugins/qa-data-quality/skills/soda-checks/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.