CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-langgraph-cli

CLI for interacting with LangGraph API

Overall
score

74%

Evaluation74%

1.17x

Agent success when using this tile

Overview
Eval results
Files

rubric.jsonevals/scenario-1/

{
  "context": "Evaluates whether the solution leans on langgraph-cli to validate configuration, generate Docker assets with extra build contexts and remapped paths, and run dev/compose flows with debugger plus watch controls. Scoring rewards direct use of the CLI’s APIs and flags instead of reimplementing those behaviors. Checks focus on the package features tied to external dependency handling and debugger/watch setup.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Config validation",
      "description": "Loads the langgraph.json via langgraph_cli.config.validate_config_file (or validate_config) rather than manual parsing, surfacing the package’s schema validation for dependencies and graph paths.",
      "max_score": 15
    },
    {
      "name": "Docker contexts",
      "description": "Generates Dockerfile content and build contexts through langgraph_cli.config.config_to_docker (or the equivalent langgraph dockerfile/build command) and uses the returned build_contexts mapping to attach out-of-tree dependency paths instead of crafting contexts manually.",
      "max_score": 25
    },
    {
      "name": "Path remapping",
      "description": "Uses langgraph_cli.config.config_to_compose or langgraph_cli.docker.compose to remap graph/auth/app paths into container-safe locations, keeping the remapped paths consistent with the build_contexts instead of custom string rewriting.",
      "max_score": 20
    },
    {
      "name": "Debug/watch compose",
      "description": "Produces docker-compose or runtime YAML through langgraph_cli.docker.compose (or langgraph up) with watch=True and debugger_port/debugger_base_url set, relying on the CLI to encode rebuild-on-change mounts and debugger endpoints rather than editing YAML by hand.",
      "max_score": 20
    },
    {
      "name": "Dev debugger start",
      "description": "Launch command uses langgraph dev with --debug-port plus --wait-for-client (and --no-browser when applicable) so the server blocks until a debugger attaches while keeping reload behavior, instead of custom debug handling.",
      "max_score": 20
    }
  ]
}

Install with Tessl CLI

npx tessl i tessl/pypi-langgraph-cli

tile.json