CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl-labs/audit-logs

Collect and normalize agent logs, discover installed verifiers, and dispatch LLM judges to evaluate adherence. Produces per-session verdicts and aggregated reports.

91

3.09x
Quality

90%

Does it follow best practices?

Impact

96%

3.09x

Average score across 3 eval scenarios

SecuritybySnyk

Passed

No known issues

Overview
Quality
Evals
Security
Files

criteria.jsonevals/scenario-1/

{
  "context": "Tests whether the agent correctly creates a companion verifier-only tile for a registry-sourced (read-only) tile: placing the tile outside .tessl/, creating docs/overview.md with links to every verifier, adding the 'docs' key to tile.json, including sources fields, and using flat kebab-case verifier files.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Companion tile outside .tessl/",
      "description": "The companion tile directory is created outside .tessl/ (e.g. in tiles/ or similar) — no files written inside .tessl/",
      "max_score": 15
    },
    {
      "name": "tile.json present",
      "description": "The companion tile has a tile.json manifest file",
      "max_score": 8
    },
    {
      "name": "docs key in tile.json",
      "description": "tile.json includes a 'docs' key pointing to docs/overview.md (e.g. '\"docs\": \"docs/overview.md\"')",
      "max_score": 10
    },
    {
      "name": "docs/overview.md present",
      "description": "A docs/overview.md file exists inside the companion tile directory",
      "max_score": 8
    },
    {
      "name": "Every verifier linked in overview",
      "description": "docs/overview.md contains a markdown link (e.g. [name](../verifiers/file.json)) to every verifier JSON file created",
      "max_score": 15
    },
    {
      "name": "Flat verifiers dir at tile root",
      "description": "All verifier JSON files are in a flat verifiers/ directory at the companion tile root — no subdirectories inside verifiers/",
      "max_score": 10
    },
    {
      "name": "Sources field included",
      "description": "Verifier JSON files include a sources field (since they are at the tile root, not embedded in a skill directory)",
      "max_score": 12
    },
    {
      "name": "Kebab-case file names",
      "description": "All verifier JSON filenames use kebab-case slugs — no spaces, underscores, or uppercase letters",
      "max_score": 8
    },
    {
      "name": "watch-local install command",
      "description": "setup-notes.md or another output file mentions using `tessl install file:<path> --watch-local` to install the companion tile",
      "max_score": 7
    },
    {
      "name": "Binary checklist rules",
      "description": "Every checklist item rule in the verifier files is binary (yes/no) — no subjective or graded language",
      "max_score": 7
    }
  ]
}

evals

scenario-1

criteria.json

task.md

tile.json