CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-langgraph-cli

CLI for interacting with LangGraph API

Overall
score

74%

Evaluation74%

1.17x

Agent success when using this tile

Overview
Eval results
Files

rubric.jsonevals/scenario-5/

{
  "context": "Evaluates whether the solution uses langgraph-cli's build tooling to turn a langgraph.json config into a Docker image, reusing package helpers rather than reimplementing Docker plumbing. Focus is on config validation, inline Dockerfile generation, tag/base-image resolution, and the build invocation with proper flags.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Config validation",
      "description": "Loads the config via langgraph_cli.config.validate_config_file (or validate_config) before any build steps and fails early on invalid files.",
      "max_score": 20
    },
    {
      "name": "Tag resolution",
      "description": "Derives the image tag with langgraph_cli.config.docker_tag when no tag is provided while honoring an explicit tag input.",
      "max_score": 20
    },
    {
      "name": "Dockerfile generation",
      "description": "Produces the inline Dockerfile and build contexts using langgraph_cli.config.config_to_docker, passing through platform/base image options instead of hand-writing Dockerfile content.",
      "max_score": 25
    },
    {
      "name": "Base image defaults",
      "description": "Uses langgraph_cli.config.default_base_image output when no override is supplied and threads any base_image override into the build inputs/commands.",
      "max_score": 15
    },
    {
      "name": "Build invocation",
      "description": "Runs the image build through langgraph_cli.exec.Runner (or the package's build command) with the generated Dockerfile/contexts, forwarding build args/platform flags and respecting the pull toggle rather than invoking docker directly with hardcoded strings.",
      "max_score": 20
    }
  ]
}

Install with Tessl CLI

npx tessl i tessl/pypi-langgraph-cli

tile.json