tessl install tessl/pypi-langgraph-cli@0.4.0CLI for interacting with LangGraph API
Agent Success
Agent success rate when using this tile
74%
Improvement
Agent success rate improvement when using this tile compared to baseline
1.17x
Baseline
Agent success rate without this tile
63%
{
"context": "Evaluates how well the solution uses LangGraph CLI's server customization fields to wire a custom ASGI app, security handlers, endpoint toggles, and HTTP policies described in the spec. Checks focus solely on correct use of langgraph.json keys such as http.app, auth/encryption paths, disable_* flags, and HTTP cors/header options.",
"type": "weighted_checklist",
"checklist": [
{
"name": "http.app wiring",
"description": "Config sets http.app to the provided module:attribute string and includes a local dependency (e.g., '.') so LangGraph remaps the custom FastAPI/Starlette app inside the container.",
"max_score": 25
},
{
"name": "Endpoint toggles",
"description": "disabled_routes input maps directly to the matching disable_assistants, disable_threads, disable_runs, disable_store, disable_mcp, and disable_meta flags in the http config while leaving unspecified groups enabled (false).",
"max_score": 20
},
{
"name": "Auth hook",
"description": "auth.path is populated with the auth_handler module:attribute string and validated for the required format before being written to langgraph.json; rejects or errors on missing attribute sections instead of silently accepting them.",
"max_score": 20
},
{
"name": "Encryption hook",
"description": "When encryption_handler is provided, encryption.path is emitted with the same module:attribute pattern and validated; when omitted, encryption config is absent without breaking auth/path handling.",
"max_score": 15
},
{
"name": "CORS allowlist",
"description": "http.cors settings in the generated profile honor provided allow_origins/allow_methods/allow_headers/allow_credentials/max_age values and nest them under http.cors so LangGraph applies them.",
"max_score": 10
},
{
"name": "Header policies",
"description": "configurable_headers and logging_headers are emitted under http with provided request/response mappings merged or defaulted per the spec instead of being ignored or flattened elsewhere.",
"max_score": 10
}
]
}