CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-langgraph-cli

CLI for interacting with LangGraph API

Overall
score

74%

Evaluation74%

1.17x

Agent success when using this tile

Overview
Eval results
Files

rubric.jsonevals/scenario-3/

{
  "context": "Evaluates whether the solution delegates langgraph.json checking to langgraph-cli's configuration validators and reports results using the validated Config data. Focuses on calls to langgraph_cli.config.validate_config_file/validate_config, use of normalized fields, and surfacing library error details.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Validation call",
      "description": "Invokes langgraph_cli.config.validate_config_file (or validate_config on loaded JSON) to perform schema validation instead of hand-written checks, and bases success/exit status on that call.",
      "max_score": 40
    },
    {
      "name": "Version summary",
      "description": "Builds the reported version line from the validated Config's python_version and node_version fields returned by the validator, handling missing fields by emitting blanks rather than hard errors.",
      "max_score": 20
    },
    {
      "name": "Dependencies listing",
      "description": "Lists dependencies by reading Config.dependencies from the validator output so library normalization (e.g., local path handling) is preserved, instead of manually parsing the raw JSON.",
      "max_score": 15
    },
    {
      "name": "Graphs listing",
      "description": "Enumerates graphs from Config.graphs provided by the validator, respecting any path remapping/normalization done by langgraph-cli.",
      "max_score": 15
    },
    {
      "name": "Error surfacing",
      "description": "Catches ValidationError/FileNotFoundError from langgraph_cli.config.validate_config_file and reports the package's provided messages (e.g., from errors()) to stderr before exiting with code 1.",
      "max_score": 10
    }
  ]
}

Install with Tessl CLI

npx tessl i tessl/pypi-langgraph-cli

tile.json