CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

check-forecast-signals

Retrieve probabilistic forecasts and their scorecard context. Use when the user asks what World Monitor is forecasting, how probabilities shifted, or how calibrated the forecasts are.

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

100%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exemplary API-access skill: lean, fully executable, and self-protecting. It anticipates the real failure modes (degraded-cache false all-clears, key-vs-JWT auth confusion, prompt injection in forecast content, withdrawn scorecard scores) and gives concrete handling for each.

DimensionReasoningScore

Conciseness

The body is lean and operational throughout - it never explains concepts Claude already knows (JMESPath, curl, rate limiting are just used), and every section (auth, endpoints, params, response shape, errors, disambiguation) earns its tokens. The intro sentence restating triggers is standard in-body guidance, not padding.

5 / 5

Actionability

Fully executable: exact endpoints, the required `X-WorldMonitor-Key` header with key format, a copy-paste-ready curl with a realistic JMESPath projection piped to jq, and error codes with concrete actions (429 -> retry with backoff). The common case (get-forecasts) is completely covered; not a 4 because nothing needed for execution is missing.

5 / 5

Workflow Clarity

A simple single-action skill where the call is unambiguous (per the simple-skill exception), and it still includes explicit validation checkpoints: check `degraded`/`stale`/`error` flags so cache misses don't read as all-clear, check the accuracy-record page before quoting scores, and retry with backoff on 429. No destructive or batch operations requiring further feedback loops.

5 / 5

Progressive Disclosure

No bundle files exist and none are needed - all content (endpoint contract, auth, response shape) is required on every call and appropriately inline at ~95 lines with clean section headers. External references (OpenAPI, auth matrix) are clearly listed in a dedicated References section, one level deep.

5 / 5

Total

20

/

20

Passed

Description

78%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with a clear what/when structure and natural trigger phrases; the main limitation is that a retrieval-only skill naturally offers few concrete actions to enumerate. Distinctiveness is good thanks to product-specific branding.

DimensionReasoningScore

Specificity

"Retrieve probabilistic forecasts and their scorecard context" names the domain plus 1-2 concrete actions (retrieve forecasts, retrieve scorecard context), matching the anchor-3 example ('Processes PDF files and extracts content'). Not a 4: it lists only one verb applied to two objects rather than several distinct specific actions.

3 / 5

Completeness

Explicitly answers both questions: what ("Retrieve probabilistic forecasts and their scorecard context") and when ("Use when the user asks what World Monitor is forecasting, how probabilities shifted, or how calibrated the forecasts are") with concrete trigger phrases - a direct match for the anchor-5 example pattern. Third person voice is used correctly.

5 / 5

Trigger Term Quality

Natural user phrasings are present - "what World Monitor is forecasting", "how probabilities shifted", "how calibrated the forecasts are" - giving good keyword coverage. Not a 5 because common variants like "forecast accuracy", "prediction", or "odds" are absent, so coverage is not comprehensive.

4 / 5

Distinctiveness Conflict Risk

The "World Monitor" branding plus the calibration/scorecard framing carves a clear niche with minor overlap risk against sibling skills (prediction markets, news digest) on generic "forecast" or "probability" queries. Not a 5: a bare "show me the forecasts" request could plausibly route to a prediction-market skill instead.

4 / 5

Total

16

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

koala73/worldmonitor

Path

skills/check-forecast-signals/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.