CtrlK
BlogDocsLog inGet started
Tessl Logo

pantheon-ai/makefile-toolkit

Complete makefile toolkit with generation and validation capabilities

97

Quality

97%

Does it follow best practices?

Impact

Pending

No eval scenarios have been run

SecuritybySnyk

Advisory

Suggest reviewing before use

Overview
Quality
Evals
Security
Files

criteria.jsongenerator/evals/scenario-4/

{
  "context": "Evaluate the agent's ability to identify Makefile anti-patterns and produce a corrected file",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Missing .PHONY identified",
      "description": "Agent identifies that clean, test, build, deploy, release, all, and install are missing .PHONY and explains that a file named 'clean' or 'test' would silently block the target",
      "max_score": 15
    },
    {
      "name": "Bare make identified",
      "description": "Agent identifies that make -C packages/core all uses bare make instead of $(MAKE) and explains that jobserver flags (-j, -n, -k) are not inherited",
      "max_score": 15
    },
    {
      "name": "Multi-line cd+command anti-pattern identified",
      "description": "Agent identifies that cd dist followed by npm publish on separate lines means the cd has no effect on the second line",
      "max_score": 15
    },
    {
      "name": "Hardcoded variable assignment identified",
      "description": "Agent identifies that CC, CFLAGS, and PREFIX use = instead of ?= and that this prevents caller override",
      "max_score": 10
    },
    {
      "name": "install uses cp instead of install command",
      "description": "Agent identifies that the install target uses cp instead of the install utility and does not create the destination directory",
      "max_score": 10
    },
    {
      "name": "Corrected Makefile uses .PHONY",
      "description": "The produced corrected Makefile declares all non-file targets in .PHONY",
      "max_score": 10
    },
    {
      "name": "Corrected Makefile uses $(MAKE)",
      "description": "The corrected Makefile replaces bare make with $(MAKE) for recursive calls",
      "max_score": 10
    },
    {
      "name": "Corrected Makefile fixes cd+command",
      "description": "The corrected deploy/dist target chains cd and the following command with && or uses .ONESHELL:",
      "max_score": 10
    },
    {
      "name": "Validation checklist confirmation",
      "description": "Agent lists which items from the skill's validation checklist the corrected Makefile satisfies",
      "max_score": 5
    }
  ]
}

generator

evals

instructions.json

summary_infeasible.json

summary.json

SKILL.md

tile.json