CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/codeql-queries

Use for any question or task about CodeQL or deep semantic static analysis (SAST) on a GitHub repo, including setting up code scanning and finding injection that flows through helper functions across files: codeql database create and analyze per language, query packs, SARIF upload to code scanning, and suppressions.

Quality

89%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A high-quality skill body: executable commands for the core scan path, a clearly sequenced five-step workflow with failure-mode guidance, and exemplary progressive disclosure that offloads pack lists, custom-query authoring, and CI integration to a real, well-described reference file. The only improvements are trimming the conceptual Overview paragraph and adding an explicit database/SARIF validation checkpoint between steps.

DimensionReasoningScore

Conciseness

The body is dominated by lean, executable commands and tables, but the Overview paragraph ('build a database of the codebase (control flow, data flow, type info) ... pattern matchers cannot express') explains concepts the model already knows, fitting anchor 4's 'efficient; minor instances of over-explanation that could be trimmed' rather than anchor 5's every-token-earns-its-place.

4 / 5

Actionability

Fully executable, copy-paste-ready guidance throughout: curl/unzip install with version check, `codeql database create` for both interpreted and compiled-language cases, `database analyze` with explicit flags, an executable jq SARIF filter, and a filled-in inline-suppression template — covering the common cases as anchor 5 requires (SARIF upload detail is deliberately and clearly deferred to the reference file).

5 / 5

Workflow Clarity

Steps 1–5 are clearly sequenced (install → create → analyze → triage → performance) with an install verification and an anti-patterns table documenting failure modes, but there is no explicit checkpoint validating database creation or SARIF output between steps, matching anchor 4's 'clear sequence with most checkpoints present; minor validation gaps' rather than anchor 5's explicit validation steps and feedback loops.

4 / 5

Progressive Disclosure

The body is a well-organized spine that explicitly defers detail to a single one-level-deep reference — 'The full per-language pack list, the query suites ..., a custom `.ql` query example, and the GitHub Actions CI integration are in [references/codeql-reference.md](references/codeql-reference.md)' — and that file exists with exactly that content, matching anchor 5's 'well-signaled one-level-deep references; content appropriately split'.

5 / 5

Total

18

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that explicitly covers both what the skill does and when to use it, with concrete, tool-specific action language and good natural trigger terms. The only weaknesses are a handful of missing natural synonyms (taint analysis, security scanning) and a slightly over-broad SAST trigger that could overlap sister scanner skills.

DimensionReasoningScore

Specificity

The description lists multiple concrete actions spanning the full workflow — 'setting up code scanning', 'finding injection that flows through helper functions across files', 'codeql database create and analyze per language, query packs, SARIF upload to code scanning, and suppressions' — which is comprehensive coverage for this domain, matching the anchor-5 example's breadth rather than anchor 4's 'minor gaps'.

5 / 5

Completeness

It explicitly answers 'when' with the concrete trigger phrase 'Use for any question or task about CodeQL or deep semantic static analysis (SAST) on a GitHub repo' and 'what' with the enumerated action list, matching anchor 5's 'clearly and explicitly answers both what AND when with concrete trigger phrases'.

5 / 5

Trigger Term Quality

Good natural keyword coverage including the synonym pair 'deep semantic static analysis (SAST)' plus 'CodeQL', 'code scanning', and 'injection', but a few natural terms users would say are missing (e.g., 'taint analysis', 'security scan', 'vulnerability scan'), fitting anchor 4's 'good coverage; a few natural terms missing' rather than anchor 5's comprehensive synonym list.

4 / 5

Distinctiveness Conflict Risk

CodeQL is a distinct named niche, but the broad trigger 'any question or task about ... deep semantic static analysis (SAST)' creates minor overlap risk with closely related SAST skills (e.g., semgrep/sonarqube), fitting anchor 4 ('mostly distinct; minor overlap risk') rather than anchor 5's minimal conflict risk.

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

On this page