CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-langgraph-cli

CLI for interacting with LangGraph API

Overall
score

74%

Evaluation74%

1.17x

Agent success when using this tile

Overview
Eval results
Files

rubric.jsonevals/scenario-2/

{
  "context": "Evaluates how well the solution uses langgraph-cli to validate langgraph.json, render Docker Compose with overrides, and start the stack through the package's compose launch flow.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Config validation",
      "description": "Loads the provided config_path via langgraph_cli.config.validate_config_file (or validate_config) before composing or launching, failing fast on invalid configs.",
      "max_score": 15
    },
    {
      "name": "Compose overrides",
      "description": "Builds compose YAML using langgraph_cli.docker.compose or langgraph_cli.config.config_to_compose, passing the custom port, image override, and docker_compose overlay path so merged services appear in output.",
      "max_score": 30
    },
    {
      "name": "Watch & debugger",
      "description": "Forwards watch, debugger_port, and debugger_base_url flags into the compose generation so resulting YAML exposes the debugger port and watch configuration when requested.",
      "max_score": 15
    },
    {
      "name": "Postgres wiring",
      "description": "Routes any postgres_uri value into compose generation (postgres_uri parameter) so the stack receives that connection string in its environment/services.",
      "max_score": 15
    },
    {
      "name": "Launch flow",
      "description": "Starts the stack through langgraph up (or equivalent langgraph_cli CLI entry) using the generated compose content, honoring wait/recreate/verbose options to block until services are healthy when wait is set.",
      "max_score": 25
    }
  ]
}

Install with Tessl CLI

npx tessl i tessl/pypi-langgraph-cli

tile.json