CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-langgraph-cli

CLI for interacting with LangGraph API

Overall
score

74%

Evaluation74%

1.17x

Agent success when using this tile

Overview
Eval results
Files

rubric.jsonevals/scenario-6/

{
  "context": "Evaluates how the solution leverages langgraph-cli telemetry controls and spinner utilities to build the wrapper CLI. Focuses on correct use of the built-in analytics decorator, opt-out mechanics, default config constants, and spinner progress updates.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Log decorator",
      "description": "Command execution function is decorated with langgraph_cli.analytics.log_command so telemetry events are emitted by the package rather than custom logging.",
      "max_score": 25
    },
    {
      "name": "Env opt-out",
      "description": "LANGGRAPH_CLI_NO_ANALYTICS is checked and respected to short-circuit telemetry when set, matching the package's telemetry opt-out behavior.",
      "max_score": 20
    },
    {
      "name": "Flag opt-out",
      "description": "--no-analytics flag feeds into the same telemetry suppression path (e.g., by setting LANGGRAPH_CLI_NO_ANALYTICS or passing disable flag into log_command).",
      "max_score": 10
    },
    {
      "name": "Progress spinner",
      "description": "Uses langgraph_cli.progress.Progress as a context manager and updates its set_message callback to show at least three phase messages during the workflow.",
      "max_score": 25
    },
    {
      "name": "Default config",
      "description": "Defaults CLI config path to langgraph_cli.constants.DEFAULT_CONFIG instead of a hardcoded string.",
      "max_score": 10
    },
    {
      "name": "Telemetry payload",
      "description": "Telemetry events produced by log_command include the command name and a success/failure outcome drawn from the package's logging mechanism.",
      "max_score": 10
    }
  ]
}

Install with Tessl CLI

npx tessl i tessl/pypi-langgraph-cli

tile.json