Interact with Shortcut - view, search, update, and create stories, epics, objectives, iterations, docs, labels, and teams using the short CLI. IMPORTANT - When you see URLs matching `app.shortcut.com/*`, use this skill instead of WebFetch.
91
99%
Does it follow best practices?
Impact
81%
1.88xAverage score across 5 eval scenarios
Advisory
Suggest reviewing before use
{
"context": "Tests whether the agent correctly falls back to the raw API via `short api` when an operation is not available as a dedicated CLI command, uses the correct HTTP method flags, and references the Swagger spec for endpoint discovery.",
"type": "weighted_checklist",
"checklist": [
{
"name": "Uses short api command",
"description": "Uses `short api <path>` for the raw API request rather than curl, wget, or direct HTTP calls",
"max_score": 12
},
{
"name": "Correct HTTP method flag",
"description": "Uses `-X POST`, `-X PUT`, or `-X DELETE` flags with `short api` when the operation requires a non-GET method",
"max_score": 10
},
{
"name": "Field flag for POST/PUT",
"description": "Uses `-f \"key=value\"` flag(s) to pass request body fields in POST or PUT operations via `short api`",
"max_score": 10
},
{
"name": "Prerequisite check",
"description": "Runs `which short && short --version` before attempting any API calls",
"max_score": 8
},
{
"name": "Swagger spec referenced",
"description": "Documents or mentions the Swagger spec (`references/shortcut.swagger.json` or equivalent) as the source for API endpoint paths",
"max_score": 8
},
{
"name": "No auto-install",
"description": "Does NOT automatically run any install command if the CLI is missing",
"max_score": 8
},
{
"name": "User strings quoted",
"description": "All user-provided string values in `short api` field arguments are properly quoted",
"max_score": 8
},
{
"name": "Auth failure guidance",
"description": "If an auth error is described or encountered, the response directs the user to `short install` (not other auth commands)",
"max_score": 8
},
{
"name": "Success message with URL",
"description": "After a successful creation via the API, a success message or confirmation is shown that includes the item URL or ID",
"max_score": 8
},
{
"name": "Follow-up suggestions",
"description": "After presenting results or a success confirmation, at least one relevant follow-up action is suggested",
"max_score": 8
},
{
"name": "GET request format",
"description": "GET requests use `short api <path>` with no `-X` flag (relying on GET as the default method)",
"max_score": 12
}
]
}