Collect and normalize agent logs, discover installed verifiers, and dispatch LLM judges to evaluate adherence. Produces per-session verdicts and aggregated reports.
91
90%
Does it follow best practices?
Impact
96%
3.09xAverage score across 3 eval scenarios
Passed
No known issues
{
"context": "Tests whether the agent correctly creates a companion verifier-only tile for a registry-sourced (read-only) tile: placing the tile outside .tessl/, creating docs/overview.md with links to every verifier, adding the 'docs' key to tile.json, including sources fields, and using flat kebab-case verifier files.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Companion tile outside .tessl/",
"description": "The companion tile directory is created outside .tessl/ (e.g. in tiles/ or similar) — no files written inside .tessl/",
"max_score": 15
},
{
"name": "tile.json present",
"description": "The companion tile has a tile.json manifest file",
"max_score": 8
},
{
"name": "docs key in tile.json",
"description": "tile.json includes a 'docs' key pointing to docs/overview.md (e.g. '\"docs\": \"docs/overview.md\"')",
"max_score": 10
},
{
"name": "docs/overview.md present",
"description": "A docs/overview.md file exists inside the companion tile directory",
"max_score": 8
},
{
"name": "Every verifier linked in overview",
"description": "docs/overview.md contains a markdown link (e.g. [name](../verifiers/file.json)) to every verifier JSON file created",
"max_score": 15
},
{
"name": "Flat verifiers dir at tile root",
"description": "All verifier JSON files are in a flat verifiers/ directory at the companion tile root — no subdirectories inside verifiers/",
"max_score": 10
},
{
"name": "Sources field included",
"description": "Verifier JSON files include a sources field (since they are at the tile root, not embedded in a skill directory)",
"max_score": 12
},
{
"name": "Kebab-case file names",
"description": "All verifier JSON filenames use kebab-case slugs — no spaces, underscores, or uppercase letters",
"max_score": 8
},
{
"name": "watch-local install command",
"description": "setup-notes.md or another output file mentions using `tessl install file:<path> --watch-local` to install the companion tile",
"max_score": 7
},
{
"name": "Binary checklist rules",
"description": "Every checklist item rule in the verifier files is binary (yes/no) — no subjective or graded language",
"max_score": 7
}
]
}