CtrlK
BlogDocsLog inGet started
Tessl Logo

manual-validation-harness

Use when validating a Coralogix terraform-provider bug fix end-to-end against a real Coralogix environment. Builds the provider locally, runs multi-step Terraform apply/plan scenarios to verify idempotency, and catches perpetual-diff regressions before merge.

75

Quality

92%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A tight, well-structured single-file skill: an executable procedure with explicit idempotency validation, error-diagnosis gotchas, and cleanup, with zero padding. The only improvement is spelling out the terraformrc/dev_overrides file verbatim.

Suggestions

Include the actual terraformrc content as a small copy-paste-ready snippet (dev_overrides block for coralogix/coralogix) instead of describing it in prose, closing the actionability gap.

Optionally name the exact install path placeholder (e.g. the <arch> subdirectory value or a command to resolve it) so step 3's 'pointing at the install dir above' is unambiguous.

DimensionReasoningScore

Conciseness

Lean ~21-line body that assumes Claude's competence (no explanation of dev_overrides, idempotency, or terraform basics); every section — Trigger, Procedure, Gotchas, Why — earns its tokens.

5 / 5

Actionability

Mostly executable commands ("make install", "export TF_CLI_CONFIG_FILE=$PWD/terraformrc", "cp steps/stepN.tf main.tf"), but the terraformrc with dev_overrides is described rather than given as a copy-paste-ready snippet — a minor gap.

4 / 5

Workflow Clarity

Six clearly sequenced steps with explicit validation checkpoints ("terraform plan → expect 'No changes.'", "verify in UI") and failure-diagnosis feedback ("403 from API = key/env mismatch, not a provider bug"), plus a cleanup step.

5 / 5

Progressive Disclosure

Under 50 lines, no bundle files needed, and well-organized sections with no buried references; per the rubric's simple-skill guideline this matches the top anchor.

5 / 5

Total

19

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: third-person, concrete, and explicit about both capability and trigger conditions for a well-defined niche. The only weakness is limited synonym/variation coverage in trigger terms.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — "Builds the provider locally", "runs multi-step Terraform apply/plan scenarios to verify idempotency", "catches perpetual-diff regressions" — that comprehensively cover the skill's scope.

5 / 5

Completeness

Explicitly answers both: what ("Builds the provider locally, runs multi-step Terraform apply/plan scenarios ... catches perpetual-diff regressions") and when ("Use when validating a Coralogix terraform-provider bug fix end-to-end ... before merge") with concrete trigger phrases.

5 / 5

Trigger Term Quality

Good natural keywords ("validating a ... bug fix", "Terraform apply/plan", "before merge") but no synonyms or variations a user might naturally say (e.g. "test the provider", "verify the fix"), so it falls just short of comprehensive coverage.

4 / 5

Distinctiveness Conflict Risk

"Coralogix terraform-provider" and "perpetual-diff regressions" define a clear niche with distinct triggers; virtually no overlap risk with generic terraform or validation skills.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
coralogix/terraform-provider-coralogix
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.