CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

soc2-evidence-collector

Use when preparing for a SOC 2 Type II audit or any audit that needs evidence packages from automated tests: per-criterion artifacts (CC1-CC9 and optional categories), collection from CI, audit and access logs and change records, Vanta, Drata or Secureframe formats, and observation-period sampling.

Quality

89%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

The canonical home for this skill is testland/soc2-evidence-collector

SKILL.md
Quality
Evals
Security

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured workflow skill: concrete code, a clear multi-step process with mock-audit validation and failure alerting, and exemplary progressive disclosure into three well-signaled reference files. It falls just short of top marks on conciseness, actionability, and workflow clarity due to minor restated checklists, app-specific assumptions in test code, and end-loaded rather than per-step validation checkpoints.

Suggestions

Trim redundant overview text (e.g., the Type II observation-period primer in the Overview and the Step 8 checklist that repeats Steps 2 - 7) to tighten conciseness.

Make the per-control test example self-contained by noting or stubbing the app-specific User, deprovision, and AuditLog dependencies so it is copy-paste adaptable.

Fold an explicit validate-before-proceeding checkpoint into the collection steps (e.g., verify the collector output parses and covers the full population before wiring it into the GRC platform) rather than concentrating validation in Step 8.

DimensionReasoningScore

Conciseness

Mostly efficient — tables, short paragraphs, and tight code examples with domain specifics Claude does not know — but a few spots could be trimmed, e.g. the 'Type II is assessed over a 3 - 12 month observation period' primer and the Step 8 checklist that restates Steps 2 - 7 with checkmarks.

4 / 5

Actionability

Gives mostly executable guidance: a concrete collector script and a per-control test with real assertions, and the injected-client interfaces (okta_client, aws_iam, github_org, slack) are explicitly justified as wrappers over named vendor SDKs. Minor gaps remain — the test example assumes app-specific User, deprovision, and AuditLog objects without stubs.

4 / 5

Workflow Clarity

A clear 8-step sequence with an end-to-end checklist, a mock-audit validation step, CI test feedback, and collector-failure alerting ('Continuity gaps in collector runs are themselves audit findings'). Validation is consolidated at the end rather than explicit per-step validate-then-proceed checkpoints, so it sits between anchors 4 and 5.

4 / 5

Progressive Disclosure

The body stays at overview level while the heavy detail (scope-decision table, packaging workflow with citations, GRC/CI automation) is split into three real, one-level-deep references/evidence-*.md and grc-*.md files, each clearly signaled in-line and in a References section with a description of what it carries.

5 / 5

Total

17

/

20

Passed

Description

95%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: explicit 'Use when' trigger guidance, concrete capability enumeration, natural domain vocabulary including the three major GRC platform names, and a distinct niche. The only weakness is that capabilities are listed as noun phrases (artifacts, sources, formats) rather than verb-led actions, which keeps specificity just short of the top anchor.

DimensionReasoningScore

Specificity

Lists several concrete capabilities — 'per-criterion artifacts (CC1-CC9 and optional categories)', 'collection from CI, audit and access logs and change records', 'Vanta, Drata or Secureframe formats', 'observation-period sampling' — but they are phrased as artifacts and sources rather than verb-led actions, leaving a minor coverage gap versus the comprehensive anchor 5.

4 / 5

Completeness

Explicitly answers both: 'Use when preparing for a SOC 2 Type II audit or any audit that needs evidence packages from automated tests' gives the when, and the colon-enumerated list (per-criterion artifacts, CI/log collection, platform formats, sampling) gives a concrete what.

5 / 5

Trigger Term Quality

Dense with natural trigger phrases users would actually say — 'SOC 2 Type II audit', 'evidence packages', 'Vanta, Drata or Secureframe', 'audit', 'CI' — including platform-name synonyms, with no jargon-only terms.

5 / 5

Distinctiveness Conflict Risk

A clear niche — SOC 2 evidence collection keyed to CC1-CC9 with named GRC platforms — that is unlikely to trigger for unrelated audit, testing, or compliance-adjacent skills.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

testland/qa

Path

plugins/qa-compliance/skills/soc2-evidence-collector/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.