CtrlK
BlogDocsLog inGet started
Tessl Logo

hefgi/shortcut

Interact with Shortcut - view, search, update, and create stories, epics, objectives, iterations, docs, labels, and teams using the short CLI. IMPORTANT - When you see URLs matching `app.shortcut.com/*`, use this skill instead of WebFetch.

91

1.88x
Quality

99%

Does it follow best practices?

Impact

81%

1.88x

Average score across 5 eval scenarios

SecuritybySnyk

Advisory

Suggest reviewing before use

Overview
Quality
Evals
Security
Files

criteria.jsonevals/scenario-5/

{
  "context": "Tests whether the agent correctly falls back to the raw API via `short api` when an operation is not available as a dedicated CLI command, uses the correct HTTP method flags, and references the Swagger spec for endpoint discovery.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Uses short api command",
      "description": "Uses `short api <path>` for the raw API request rather than curl, wget, or direct HTTP calls",
      "max_score": 12
    },
    {
      "name": "Correct HTTP method flag",
      "description": "Uses `-X POST`, `-X PUT`, or `-X DELETE` flags with `short api` when the operation requires a non-GET method",
      "max_score": 10
    },
    {
      "name": "Field flag for POST/PUT",
      "description": "Uses `-f \"key=value\"` flag(s) to pass request body fields in POST or PUT operations via `short api`",
      "max_score": 10
    },
    {
      "name": "Prerequisite check",
      "description": "Runs `which short && short --version` before attempting any API calls",
      "max_score": 8
    },
    {
      "name": "Swagger spec referenced",
      "description": "Documents or mentions the Swagger spec (`references/shortcut.swagger.json` or equivalent) as the source for API endpoint paths",
      "max_score": 8
    },
    {
      "name": "No auto-install",
      "description": "Does NOT automatically run any install command if the CLI is missing",
      "max_score": 8
    },
    {
      "name": "User strings quoted",
      "description": "All user-provided string values in `short api` field arguments are properly quoted",
      "max_score": 8
    },
    {
      "name": "Auth failure guidance",
      "description": "If an auth error is described or encountered, the response directs the user to `short install` (not other auth commands)",
      "max_score": 8
    },
    {
      "name": "Success message with URL",
      "description": "After a successful creation via the API, a success message or confirmation is shown that includes the item URL or ID",
      "max_score": 8
    },
    {
      "name": "Follow-up suggestions",
      "description": "After presenting results or a success confirmation, at least one relevant follow-up action is suggested",
      "max_score": 8
    },
    {
      "name": "GET request format",
      "description": "GET requests use `short api <path>` with no `-X` flag (relying on GET as the default method)",
      "max_score": 12
    }
  ]
}

evals

SKILL.md

tile.json