CLI for interacting with LangGraph API
Overall
score
74%
Evaluation — 74%
↑ 1.17xAgent success when using this tile
{
"context": "Evaluates whether the solution wires the LangGraph CLI dev server to start an in-memory API with hot reload while honoring the debugger, tunnel, and browser toggle behaviors outlined in the spec. Scoring checks that the official `langgraph dev` command and its flags are used rather than custom server logic.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Dev command usage",
"description": "Invokes `langgraph dev` (not a reimplementation) with the provided config path and port so the package-managed in-memory server starts for that project.",
"max_score": 25
},
{
"name": "Hot reload/watch",
"description": "Enables the package's hot-reload watcher (default or explicit `--watch` paths) so edits in the project tree trigger automatic restarts without manual process control.",
"max_score": 20
},
{
"name": "Debugger wait",
"description": "Uses the CLI debugger options (e.g., `--debugger-port` together with `--wait-for-client`) so startup pauses for an attached debugger before serving when those parameters are requested.",
"max_score": 20
},
{
"name": "Tunnel exposure",
"description": "Enables tunneling via the CLI flag (e.g., `--tunnel`) and surfaces the externally reachable URL emitted by the command once the server is ready.",
"max_score": 20
},
{
"name": "Browser toggle",
"description": "Defaults to allowing the CLI's browser auto-open, and uses the disable flag (e.g., `--no-open`) to suppress it when requested while keeping the server running.",
"max_score": 15
}
]
}Install with Tessl CLI
npx tessl i tessl/pypi-langgraph-clievals
scenario-1
scenario-2
scenario-3
scenario-4
scenario-5
scenario-6
scenario-7
scenario-8
scenario-9
scenario-10