CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

azure-pipelines-validator

Validates, lints, and security-scans Azure DevOps Pipeline configurations (azure-pipelines.yml / azure-pipelines.yaml). Use when working with ADO pipelines, YAML pipeline files, or CI/CD configurations in Azure DevOps: including validating YAML syntax and schema, detecting hardcoded secrets or credentials, checking for deprecated or unpinned task versions, enforcing best practices (caching, timeouts, display names), performing pipeline security audits, or reviewing azure-pipelines.yml before merging. Trigger terms: azure-pipelines.yml, ADO pipeline, Azure Pipelines, YAML pipeline, CI/CD validation, pipeline security scan, DevOps configuration review.

69

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

73%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-built operational skill body: fully executable commands with flags, a realistic output sample, a tight fix-and-re-run error-recovery loop, and a bundle structure whose referenced files all exist. Its weaknesses are redundancy (the Common Scenarios and 11 anti-pattern sections repeat content already conveyed) and one broken pseudocode example in the Extending section.

Suggestions

Consolidate the 'Common Scenarios' section (which repeats Basic Usage commands) and trim the 11 anti-pattern blocks to the non-obvious ones — e.g. the rule codes already shown in the output example and the strict-mode guidance carry most of the information — to tighten conciseness.

Fix or remove the non-executable code in 'Extending the Skill': the example references an undefined `pool` variable and lacks the method scaffolding, so it reads as broken pseudocode rather than a working custom-rule template.

Replace the vague "see `references/` for rule details" pointer in error recovery with the explicit file name (references/azure-pipelines-reference.md), and consider moving the detailed anti-pattern catalog into that reference file.

DimensionReasoningScore

Conciseness

The operational content (commands, flags, output sample, troubleshooting table) is efficient and free of concepts-Claude-already-knows padding, but ~65 lines of 11 anti-pattern blocks partially restate rule codes already shown in the output example, and "Common Scenarios" re-runs commands verbatim from Basic Usage — more than the 'minor trimmable instances' of the 4 anchor, fitting 'mostly efficient but could be tightened' at 3. Not 2, since there is no unnecessary concept explanation and most sections earn their tokens.

3 / 5

Actionability

Nearly everything is copy-paste executable: "bash scripts/validate_azure_pipelines.sh azure-pipelines.yml --security-only --strict", per-layer flags, a real output/error format, and a troubleshooting table with concrete fixes. The gap is the "Extending" snippet — "if 'tags' not in pool" references an undefined `pool` and is incomplete pseudocode, which the guidelines penalize — so 4 (minor gaps) rather than 5.

4 / 5

Workflow Clarity

The workflow is clearly sequenced with an explicit feedback loop: "Fix findings in layer order", numbered error-recovery steps ("Note the rule code... Fix the flagged line and re-run the same layer... Run full validation once all targeted fixes are applied"), and a validation checkpoint treating MEDIUM/HIGH security findings as merge blockers — this matches the explicit-validation-with-error-recovery 5 anchor, not 4 where checkpoints have gaps.

5 / 5

Progressive Disclosure

Structure is good: SKILL.md is an overview with one-level-deep references that all exist (references/azure-pipelines-reference.md, five assets/examples files, all referenced scripts), and the References section signals each file's purpose. Minor gaps keep it at 4: the error-recovery pointer "see `references/` for rule details" is vague rather than naming the file, and the large inline anti-patterns block is content that could be split out; not 3, since the split and navigation are genuinely good and nothing is buried.

4 / 5

Total

16

/

20

Passed

Description

96%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete multi-action capability statement in third person, an explicit 'Use when' clause, and a rich trigger-term list with synonyms and both file extensions. The only weakness is two broadly scoped trigger terms ('CI/CD validation', 'DevOps configuration review') that slightly raise conflict risk with other CI/CD validator skills.

DimensionReasoningScore

Specificity

"Validates, lints, and security-scans Azure DevOps Pipeline configurations" plus enumerated concrete actions — "validating YAML syntax and schema, detecting hardcoded secrets or credentials, checking for deprecated or unpinned task versions, enforcing best practices (caching, timeouts, display names)" — gives comprehensive, specific coverage in third-person voice, matching the multiple-specific-actions anchor rather than the minor-gaps anchor at 4.

5 / 5

Completeness

Both "what" (validate/lint/security-scan with specific sub-actions) and "when" are explicit: "Use when working with ADO pipelines, YAML pipeline files, or CI/CD configurations in Azure DevOps" plus a dedicated trigger-term sentence — clearly matches the explicit what-AND-when-with-concrete-triggers anchor, well above the 4 anchor where 'when' is less explicit.

5 / 5

Trigger Term Quality

Trigger terms "azure-pipelines.yml, ADO pipeline, Azure Pipelines, YAML pipeline, CI/CD validation, pipeline security scan, DevOps configuration review" include both file extensions (.yml/.yaml), the ADO acronym, and natural synonyms a user would actually say — comprehensive coverage including synonyms and file extensions per the 5 anchor; not the 4 anchor since no common variation is missing.

5 / 5

Distinctiveness Conflict Risk

The Azure/ADO-specific terms create a clear niche, but the generic triggers "CI/CD validation" and "DevOps configuration review" could plausibly fire for closely related validator skills (GitHub Actions, GitLab CI), which is minor overlap risk — the 4 anchor — rather than the minimal-conflict-risk 5 anchor. Not 3, since the dominant triggers are unambiguously Azure Pipelines-specific.

4 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

referenced_paths_exist

Referenced path issues: 6 deeper-than-1-level

Warning

Total

15

/

16

Passed

Repository

pantheon-org/tekhne

Path

skills/ci-cd/azure-pipelines/validator/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.