CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

tessl/pypi-langgraph-cli

tessl install tessl/pypi-langgraph-cli@0.4.0

CLI for interacting with LangGraph API

Agent Success

Agent success rate when using this tile

74%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.17x

Baseline

Agent success rate without this tile

63%

rubric.jsonevals/scenario-9/

{
  "context": "Evaluates how well the solution uses LangGraph CLI's server customization fields to wire a custom ASGI app, security handlers, endpoint toggles, and HTTP policies described in the spec. Checks focus solely on correct use of langgraph.json keys such as http.app, auth/encryption paths, disable_* flags, and HTTP cors/header options.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "http.app wiring",
      "description": "Config sets http.app to the provided module:attribute string and includes a local dependency (e.g., '.') so LangGraph remaps the custom FastAPI/Starlette app inside the container.",
      "max_score": 25
    },
    {
      "name": "Endpoint toggles",
      "description": "disabled_routes input maps directly to the matching disable_assistants, disable_threads, disable_runs, disable_store, disable_mcp, and disable_meta flags in the http config while leaving unspecified groups enabled (false).",
      "max_score": 20
    },
    {
      "name": "Auth hook",
      "description": "auth.path is populated with the auth_handler module:attribute string and validated for the required format before being written to langgraph.json; rejects or errors on missing attribute sections instead of silently accepting them.",
      "max_score": 20
    },
    {
      "name": "Encryption hook",
      "description": "When encryption_handler is provided, encryption.path is emitted with the same module:attribute pattern and validated; when omitted, encryption config is absent without breaking auth/path handling.",
      "max_score": 15
    },
    {
      "name": "CORS allowlist",
      "description": "http.cors settings in the generated profile honor provided allow_origins/allow_methods/allow_headers/allow_credentials/max_age values and nest them under http.cors so LangGraph applies them.",
      "max_score": 10
    },
    {
      "name": "Header policies",
      "description": "configurable_headers and logging_headers are emitted under http with provided request/response mappings merged or defaulted per the spec instead of being ignored or flattened elsewhere.",
      "max_score": 10
    }
  ]
}

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/langgraph-cli@0.4.x
tile.json