CtrlK
BlogDocsLog inGet started
Tessl Logo

akshay-babbar/doc-sync

Auto-syncs stale docstrings and README when function signatures change. Detects documentation drift after refactors, parameter additions, or return type changes. Dry-run by default — proposes before writing.

87

1.59x
Quality

100%

Does it follow best practices?

Impact

86%

1.59x

Average score across 17 eval scenarios

SecuritybySnyk

Passed

No known issues

Overview
Quality
Evals
Security
Files

criteria.jsonevals/scenario-13/

{
  "context": "Tests whether the agent correctly handles symbols moved between files: it should flag them as [NEEDS HUMAN REVIEW] because import references may be stale, and must NOT auto-update import examples or delete any documentation.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Human review flagged",
      "description": "doc-sync-report.md contains '[NEEDS HUMAN REVIEW]' for parse_config or sanitize_input indicating the move requires human attention",
      "max_score": 30
    },
    {
      "name": "Move context reported",
      "description": "The report mentions that parse_config (or the functions) were moved from utils.py OR references src/utils.py in the flagged entry",
      "max_score": 25
    },
    {
      "name": "README not auto-updated",
      "description": "README.md still contains the original `parse_config(raw)` and `sanitize_input(value)` entries — the agent did NOT rewrite the import paths or module references in README",
      "max_score": 55
    },
    {
      "name": "Documentation not deleted",
      "description": "The report does NOT say the documentation was deleted or that 'Missing coverage' applies to parse_config — the existing docs are preserved",
      "max_score": 55
    },
    {
      "name": "Unified report format",
      "description": "doc-sync-report.md contains '## Doc Sync Report' as a top-level heading",
      "max_score": 45
    }
  ]
}

evals

README.md

SKILL.md

tessl.json

tile.json

TRUST.md