CtrlK
BlogDocsLog inGet started
Tessl Logo

manual-validation-harness

Use when validating a Coralogix terraform-provider bug fix end-to-end against a real Coralogix environment. Builds the provider locally, runs multi-step Terraform apply/plan scenarios to verify idempotency, and catches perpetual-diff regressions before merge.

75

Quality

93%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

93%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is dense, executable, and well-organized with a clear sequence and an explicit idempotency validation step. The only gap is an implicit rather than structured failure-recovery loop for the destructive apply/destroy operations.

Suggestions

Add an explicit failure-recovery branch in step 5: if 'terraform plan' shows changes, investigate which attribute causes the perpetual diff before re-running, turning the implicit Gotchas guidance into a structured validate→fix→retry loop.

Show the exact terraformrc dev_overrides block verbatim (or as a fenced snippet) rather than describing it in prose, so the setup step is fully copy-paste ready.

Make the UI-verification expectation concrete (e.g., which Coralogix screen/resource to inspect and what state confirms success) to strengthen the validation checkpoint.

DimensionReasoningScore

Conciseness

A lean ~20-line body with terse numbered commands and inline rationale only where it changes behavior; it assumes Claude knows Terraform and adds no padding.

5 / 5

Actionability

Fully executable copy-paste commands throughout ('make install', 'mkdir /tmp/<ticket>-test && cd $_', 'terraform apply -auto-approve', 'terraform plan') with specific paths, env vars, and stated expectations like 'expect No changes.'

5 / 5

Workflow Clarity

A clear 6-step sequence with an explicit validation checkpoint (step 5: verify in UI then plan expecting no changes), but the failure-recovery loop is only implied via the Gotchas section rather than a structured validate→fix→retry.

4 / 5

Progressive Disclosure

A self-contained single-purpose skill under 50 lines with no bundle files, organized into clear Trigger/Procedure/Gotchas/Why sections — meeting the simple-skill exception for full marks.

5 / 5

Total

19

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is specific, complete, and distinctive, with a clear 'Use when' trigger and concrete capability statements. Trigger-term coverage is strong but slightly short of fully comprehensive synonym variation for its niche.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — 'Builds the provider locally, runs multi-step Terraform apply/plan scenarios to verify idempotency, and catches perpetual-diff regressions' — comprehensively covering the build→apply→verify→regression-check flow.

5 / 5

Completeness

Explicitly answers both — an explicit 'Use when validating a Coralogix terraform-provider bug fix...' trigger and a clear statement of what it does (builds, runs scenarios, verifies idempotency, catches regressions).

5 / 5

Trigger Term Quality

Natural practitioner terms are present ('validating...end-to-end', 'Terraform apply/plan', 'idempotency', 'perpetual-diff regressions'), but synonym/extension variation is limited within this narrow domain, sitting just below comprehensive.

4 / 5

Distinctiveness Conflict Risk

A clear, narrowly-scoped niche (Coralogix terraform-provider bug-fix validation, perpetual-diff regression detection) with triggers unlikely to fire for unrelated skills.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
coralogix/terraform-provider-coralogix
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.