CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

check-forecast-signals

Retrieve probabilistic forecasts and their scorecard context. Use when the user asks what World Monitor is forecasting, how probabilities shifted, or how calibrated the forecasts are.

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A tight, highly actionable API skill: exact auth headers, endpoints, parameters, response semantics (including degraded/stale handling), an executable worked example, and explicit validation checkpoints around scorecard quoting. The only weaknesses are minor: the content-safety paragraph could be more compact and the inline response schema/parameter table could move to a reference file for leaner loading.

DimensionReasoningScore

Conciseness

The body is dense and functional — exact endpoints, a parameter table, a response example, and one curl command with no padding or explanation of concepts Claude already knows. The content-safety paragraph and the repeated trigger conditions in the intro are minor instances of over-explanation that could each be trimmed to a line, fitting 'efficient; minor instances of over-explanation' rather than 'every token earns its place'.

4 / 5

Actionability

Everything needed to execute is concrete: the exact header "X-WorldMonitor-Key" with an example key value, full endpoint URLs, a parameter table with valid domain values and a ready JMESPath example, the full response shape, and a copy-paste-ready curl command piped to jq covering the common case. There are no pseudocode or high-level hints, so it clearly matches the top anchor.

5 / 5

Workflow Clarity

The sequence is explicit with validation checkpoints and feedback loops: "Start with get-forecasts; use the scorecard when the user asks whether the forecast system has been accurate", check the accuracy record status before quoting any score (with a defined fallback: report scores as withdrawn while under audit), treat "empty forecasts plus degraded: true" as unavailable rather than all-clear, preserve degraded/stale/error in JMESPath projections, and retry with backoff on 429 or retry later on degraded data. This matches 'clear sequence with explicit validation steps; feedback loops for error recovery'.

5 / 5

Progressive Disclosure

Sections are clearly headed and easy to navigate, and external references (OpenAPI, auth matrix, key issuance) are well-signaled one level deep in a References section with no nested references. However, no bundle files exist, and the ~25-line inline response schema plus the full parameter table are candidates for a references/ file to keep SKILL.md lean, fitting 'good structure; most content appropriately placed; minor organization gaps' rather than the fully-split top anchor.

4 / 5

Total

18

/

20

Passed

Description

82%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that clearly states what the skill does and when to use it with natural trigger phrases and a distinct product-specific niche. Its main weakness is that the 'what' clause stops at two fairly abstract actions rather than enumerating the concrete retrieval capabilities (domain/region filtering, scorecard, projections).

Suggestions

Enumerate the concrete actions more specifically, e.g. "Retrieve probabilistic forecasts by domain and region, project results with JMESPath, and pull the forecast accuracy scorecard."

Add a few natural trigger synonyms users might say, such as "odds", "likelihood", "scenario probabilities", or "forecast accuracy", to broaden keyword coverage.

Optionally name the sibling capabilities it is NOT for (e.g. prediction-market prices, country briefs) in the description to sharpen routing between related World Monitor skills.

DimensionReasoningScore

Specificity

"Retrieve probabilistic forecasts and their scorecard context" names the domain and two concrete actions (fetch forecasts, fetch scorecard context), matching the anchor for 1-2 concrete actions without comprehensive coverage; it does not list several specific actions such as filtering by domain/region or projecting results, so it is not a 4.

3 / 5

Completeness

It explicitly answers both parts: the 'what' is "Retrieve probabilistic forecasts and their scorecard context" and the 'when' is "Use when the user asks what World Monitor is forecasting, how probabilities shifted, or how calibrated the forecasts are", with concrete trigger phrases matching the top anchor. Third-person voice is used correctly, so no voice penalty applies.

5 / 5

Trigger Term Quality

Natural phrases like "what World Monitor is forecasting", "how probabilities shifted", and "how calibrated the forecasts are" give good keyword coverage (forecasts, probabilities, calibrated, scorecard), but common variations such as "odds", "likelihood", or "prediction accuracy" are missing, which fits 'good coverage; a few natural terms missing' rather than comprehensive.

4 / 5

Distinctiveness Conflict Risk

The description is tied to a specific product ("World Monitor") with distinct triggers around forecasts, probability shifts, and calibration, giving it a clear niche with minimal conflict risk against generic forecasting or document skills; it does not merely overlap with broadly related skills, so it is not a 4.

5 / 5

Total

17

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

koala73/worldmonitor

Path

public/.well-known/agent-skills/check-forecast-signals/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.