CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

tessl/pypi-langgraph-cli

tessl install tessl/pypi-langgraph-cli@0.4.0

CLI for interacting with LangGraph API

Agent Success

Agent success rate when using this tile

74%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.17x

Baseline

Agent success rate without this tile

63%

rubric.jsonevals/scenario-4/

{
  "context": "Evaluates whether the solution delegates langgraph.json checking to langgraph-cli's configuration validators and reports results using the validated Config data. Focuses on calls to langgraph_cli.config.validate_config_file/validate_config, use of normalized fields, and surfacing library error details.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Validation call",
      "description": "Invokes langgraph_cli.config.validate_config_file (or validate_config on loaded JSON) to perform schema validation instead of hand-written checks, and bases success/exit status on that call.",
      "max_score": 40
    },
    {
      "name": "Version summary",
      "description": "Builds the reported version line from the validated Config's python_version and node_version fields returned by the validator, handling missing fields by emitting blanks rather than hard errors.",
      "max_score": 20
    },
    {
      "name": "Dependencies listing",
      "description": "Lists dependencies by reading Config.dependencies from the validator output so library normalization (e.g., local path handling) is preserved, instead of manually parsing the raw JSON.",
      "max_score": 15
    },
    {
      "name": "Graphs listing",
      "description": "Enumerates graphs from Config.graphs provided by the validator, respecting any path remapping/normalization done by langgraph-cli.",
      "max_score": 15
    },
    {
      "name": "Error surfacing",
      "description": "Catches ValidationError/FileNotFoundError from langgraph_cli.config.validate_config_file and reports the package's provided messages (e.g., from errors()) to stderr before exiting with code 1.",
      "max_score": 10
    }
  ]
}

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/langgraph-cli@0.4.x
tile.json