CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

tessl/pypi-numpydoc

Sphinx extension to support docstrings in Numpy format

52%

Overall

Evaluation52%

1.13x

Agent success when using this tile

Overview
Eval results
Files

rubric.jsonevals/scenario-7/

{
  "context": "Evaluates whether the solution wraps numpydoc's render, validate, and lint CLI entrypoints for the required docstring QA flows. Confirms outputs and exit statuses are captured and mapped as described in the problem.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Render call",
      "description": "Invokes `numpydoc render <import_path>` (or equivalent API wrapper) to produce RST for the target object and returns the captured stdout string rather than reimplementing rendering logic.",
      "max_score": 25
    },
    {
      "name": "Render errors",
      "description": "Detects non-zero exit from `numpydoc render` and raises a RuntimeError that includes the CLI exit status and stderr details from the command.",
      "max_score": 15
    },
    {
      "name": "Validate usage",
      "description": "Runs `numpydoc validate <import_path>` with optional `--checks` selection when provided, and returns the failing validation code strings in the order emitted by the CLI output.",
      "max_score": 25
    },
    {
      "name": "Lint usage",
      "description": "Executes `numpydoc lint` on the provided file paths (respecting any ignore patterns) and builds a mapping of each file to the lint code strings reported for that file, leaving clean files mapped to an empty list.",
      "max_score": 25
    },
    {
      "name": "Options passthrough",
      "description": "Supports relevant CLI options such as `--config` for render/validate and ignore or config discovery flags for lint, ensuring those options are forwarded to the numpydoc commands rather than ignored.",
      "max_score": 10
    }
  ]
}
tessl i tessl/pypi-numpydoc@1.9.0

tile.json