CtrlK
BlogDocsLog inGet started
Tessl Logo

run-snowflake-quality-tests

examine the data we have inside snowflake and based on this, build and deploy a testing pipeline and deploy it to orchestra

40

Quality

37%

Does it follow best practices?

Impact

No eval scenarios have been run

SecuritybySnyk

Passed

No known issues

Optimize this skill with Tessl

npx tessl skill review --optimize ./skills/orchestra/skills/run-snowflake-quality-tests/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

42%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The skill provides a reasonable framework for building Snowflake data quality tests and deploying them to Orchestra, with a useful YAML template and concrete MCP tool calls. However, it suffers from apparent copy-paste contamination in the troubleshooting section (references to motherduck, dlt, snapshots, and prod promotion that are irrelevant to a testing pipeline), inconsistent formatting, and missing validation steps between stages. The lack of executable Snowflake inspection queries in Step 1 and the absence of any bundle structure weaken its overall utility.

Suggestions

Remove or replace the Step 5 failure troubleshooting content that references motherduck, dlt, RESTORE snapshots, and prod promotion — these are clearly from a different skill and create confusion.

Add executable SQL queries in Step 1 for inspecting Snowflake tables (e.g., INFORMATION_SCHEMA queries to list tables, columns, and sample data for threshold determination).

Extract the YAML template into a separate reference file (e.g., TEMPLATE.yml) and reference it from the main skill to improve progressive disclosure.

Add an explicit validation checkpoint between Steps 2 and 3 (e.g., validate YAML syntax, confirm test coverage with user) and fix the inconsistency where Step 1 references 'Step 4' for user validation but Step 4 is actually pipeline registration.

DimensionReasoningScore

Conciseness

The skill contains a substantial YAML example which is useful as a template, but there's significant verbosity in Step 5's failure troubleshooting section that references irrelevant scenarios (motherduck destinations, dlt requirements, RESTORE from snapshots) that don't apply to a Snowflake testing pipeline. Some content feels copy-pasted from a different skill.

2 / 3

Actionability

Step 1 provides good conceptual guidance on test types but lacks executable code for the Snowflake inspection queries. Steps 4-5 provide concrete MCP tool calls which is good, but Step 3 is vague ('Create a new branch... Push the yml') without specifying how. The YAML template in Step 2 is concrete and copy-paste ready, which helps.

2 / 3

Workflow Clarity

The 5-step sequence is clear and logical, and Step 5 includes a polling loop and failure diagnosis flow. However, there are no explicit validation checkpoints between steps (e.g., validating the YAML before pushing, confirming Snowflake connectivity before building tests). Step 1 mentions 'prompt the user to validate in Step 4' but Step 4 is about registering, not validating test scope. The step numbering is also inconsistent (Steps 3-5 use ### while Steps 1-2 use #).

2 / 3

Progressive Disclosure

Everything is in a single monolithic file with no references to supporting documents. The large YAML example could be in a separate template file. There are no bundle files, and the failure troubleshooting in Step 5 references concepts from an entirely different pipeline type (motherduck/dlt), suggesting content was pasted from another skill without proper adaptation.

1 / 3

Total

7

/

12

Passed

Description

32%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description reads more like a user request than a skill description—it uses first-person plural ('we have') and imperative phrasing rather than third-person declarative voice. It lacks a 'Use when...' clause, concrete sub-actions, and sufficient trigger terms, making it difficult for Claude to reliably select this skill from a larger set.

Suggestions

Rewrite in third-person declarative voice describing concrete actions, e.g., 'Examines Snowflake data sources, builds data testing pipelines, and deploys them to Orchestra.'

Add an explicit 'Use when...' clause with natural trigger terms, e.g., 'Use when the user asks about Snowflake data validation, data quality testing, pipeline deployment to Orchestra, or orchestration of test workflows.'

Include common keyword variations such as 'data warehouse', 'data quality', 'orchestration', 'deploy pipeline', and 'Snowflake tests' to improve trigger term coverage.

DimensionReasoningScore

Specificity

It names specific platforms (Snowflake, Orchestra) and mentions building/deploying a testing pipeline, but the actions are not broken down into concrete sub-tasks—'examine the data' and 'build and deploy a testing pipeline' remain fairly high-level.

2 / 3

Completeness

It loosely describes what the skill does but has no explicit 'Use when...' clause or equivalent trigger guidance. Per the rubric, a missing 'Use when' clause caps completeness at 2, and the 'what' itself is also weak, so this scores a 1.

1 / 3

Trigger Term Quality

Includes some relevant keywords like 'snowflake', 'testing pipeline', and 'orchestra', but misses common variations (e.g., 'data warehouse', 'CI/CD', 'data quality tests', 'orchestration') and doesn't cover the natural language a user might use.

2 / 3

Distinctiveness Conflict Risk

The mention of Snowflake and Orchestra provides some niche specificity, but 'testing pipeline' is generic enough to overlap with CI/CD, data quality, or other pipeline-related skills.

2 / 3

Total

7

/

12

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation11 / 11 Passed

Validation for skill structure

No warnings or errors.

Repository
orchestra-hq/orchestra-skills
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.