Content
86%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A high-quality skill body: executable commands for the core scan path, a clearly sequenced five-step workflow with failure-mode guidance, and exemplary progressive disclosure that offloads pack lists, custom-query authoring, and CI integration to a real, well-described reference file. The only improvements are trimming the conceptual Overview paragraph and adding an explicit database/SARIF validation checkpoint between steps.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dominated by lean, executable commands and tables, but the Overview paragraph ('build a database of the codebase (control flow, data flow, type info) ... pattern matchers cannot express') explains concepts the model already knows, fitting anchor 4's 'efficient; minor instances of over-explanation that could be trimmed' rather than anchor 5's every-token-earns-its-place. | 4 / 5 |
Actionability | Fully executable, copy-paste-ready guidance throughout: curl/unzip install with version check, `codeql database create` for both interpreted and compiled-language cases, `database analyze` with explicit flags, an executable jq SARIF filter, and a filled-in inline-suppression template — covering the common cases as anchor 5 requires (SARIF upload detail is deliberately and clearly deferred to the reference file). | 5 / 5 |
Workflow Clarity | Steps 1–5 are clearly sequenced (install → create → analyze → triage → performance) with an install verification and an anti-patterns table documenting failure modes, but there is no explicit checkpoint validating database creation or SARIF output between steps, matching anchor 4's 'clear sequence with most checkpoints present; minor validation gaps' rather than anchor 5's explicit validation steps and feedback loops. | 4 / 5 |
Progressive Disclosure | The body is a well-organized spine that explicitly defers detail to a single one-level-deep reference — 'The full per-language pack list, the query suites ..., a custom `.ql` query example, and the GitHub Actions CI integration are in [references/codeql-reference.md](references/codeql-reference.md)' — and that file exists with exactly that content, matching anchor 5's 'well-signaled one-level-deep references; content appropriately split'. | 5 / 5 |
Total | 18 / 20 Passed |