Auto-generated tile from GitHub (10 skills)
92
94%
Does it follow best practices?
Impact
92%
1.16xAverage score across 44 eval scenarios
Advisory
Suggest reviewing before use
{
"context": "Tests whether the agent uses the batch rendering workflow with glob patterns, leverages environment variables for CI-wide defaults and CLI flags for per-run overrides, verifies output after rendering, and documents the exact commands and output paths.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Batch command used",
"description": "The CI script uses `snipgrapher batch` (not `snipgrapher render`) for rendering multiple files",
"max_score": 12
},
{
"name": "Glob pattern in batch",
"description": "The batch command includes a glob pattern (e.g. `\"./snippets/**/*.ts\"` or similar) to select multiple input files",
"max_score": 10
},
{
"name": "Out-dir flag used",
"description": "The batch command includes an `--out-dir` flag specifying the output directory",
"max_score": 10
},
{
"name": "Concurrency or manifest flag",
"description": "The batch command includes either `--concurrency` or `--manifest` (or both) flags",
"max_score": 10
},
{
"name": "Env var for CI defaults",
"description": "The script sets at least one SNIPGRAPHER_* environment variable (e.g. SNIPGRAPHER_THEME, SNIPGRAPHER_FORMAT, SNIPGRAPHER_PROFILE, SNIPGRAPHER_FONT_SIZE, SNIPGRAPHER_PADDING, or SNIPGRAPHER_LINE_NUMBERS) to establish CI-wide defaults",
"max_score": 15
},
{
"name": "CLI flag for override",
"description": "The script uses at least one CLI flag (e.g. --theme, --format, --profile) to override a setting for a specific render run, distinct from the env var defaults",
"max_score": 13
},
{
"name": "Output verification step",
"description": "The script includes a step to verify rendered output files exist and are non-zero in size (e.g. `ls -lh`, file size check, or equivalent)",
"max_score": 15
},
{
"name": "Commands and paths documented",
"description": "The script or accompanying documentation records the exact commands run and the output directory/file paths produced",
"max_score": 15
}
]
}evals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10
scenario-11
scenario-12
scenario-13
scenario-14
scenario-15
scenario-16
scenario-17
scenario-18
scenario-19
scenario-20
scenario-21
scenario-22
scenario-23
scenario-24
scenario-25
scenario-26
scenario-27
scenario-28
scenario-29
scenario-30
scenario-31
scenario-32
scenario-33
scenario-34
scenario-35
scenario-36
scenario-37
scenario-38
scenario-39
scenario-40
scenario-41
scenario-42
scenario-43
scenario-44
skills
documentation
fastify
init
linting-neostandard-eslint9
node
nodejs-core
rules
oauth
octocat
snipgrapher