CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

aws-observability

Investigates root causes on the Omni context graph (service dependencies) and Intelligence insights; builds, configures, debugs, tunes AWS observability - operator-symptom questions, detecting Omni vs classic CloudWatch. CloudWatch on a reporting service: fleet health views, Log Insights, metric/composite/anomaly alarms, custom metrics/EMF, dashboards, X-Ray/ADOT tracing, canaries, CloudTrail, Dynamic Instrumentation (live breakpoints), and Application Signals service map. CloudWatch Omni on an existing Space: SQL over logs/traces, PromQL, Omni dashboards, alerts and Slack notifications, programmatic/IaC access (API/SDK/CLI/CFN), driving Omni from a coding agent or skills, AI agent quality from traces - on-demand and online evaluation of live traffic, incl. setting it up, readback, evaluators. For first-time setup - creating an Omni Space, granting access, ingestion, or ADOT instrumentation for Application Signals or Omni - use setting-up-cloudwatch-observability. Not for app logging or threat detection.

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exceptionally actionable, well-sequenced routing skill body with explicit validation checkpoints, error-recovery loops, and an output-contract checklist design, all backed by real, well-organized reference files. Its weaknesses are repetition of the same routing guidance across several sections (hurting token efficiency) and one instance of second-level reference nesting plus some reference detail inlined into the body.

Suggestions

Consolidate the Omni-alert guidance that currently appears in five places (Step 0 rule 1, rule 2a, the under-specified-alerts paragraph, the must-state checklist table, and the Omni routing table) into a single routing row plus the alerts.md pointer, keeping the body's total length well under 300 lines.

Trim the Omni-vs-CloudWatch signal vocabulary duplicated between Step 0 rule 1 and the Overview comparison table — state it once and cross-reference the other location.

Move the inline Omni dashboard save/reject semantics (the 400-vs-200 ValidationException detail in the routing-table row) into dashboards.md and keep only the 'validate before save' rule in SKILL.md, and flatten or more explicitly index the second-level references/cloudwatch/dynamic-instrumentation/ sub-files.

DimensionReasoningScore

Conciseness

Nearly all content is non-obvious product-specific routing knowledge (no explaining of concepts Claude already knows), but the 313-line body repeats the same guidance in multiple places: Omni-alert routing appears in Step 0 rule 1, rule 2a, the under-specified-alerts paragraph, the must-state checklist table, and the Omni routing table; Omni-vs-CloudWatch signal vocabulary is enumerated twice (rule 1 and the comparison table); and routing-table cells carry long embedded parentheticals that restate reference-file content (e.g. the full dashboards save-semantics in the Omni table row). This is more than 'minor instances of over-explanation' (anchor 4) but the material is largely earning its place, so it sits at 'mostly efficient but could be tightened'.

3 / 5

Actionability

Guidance is concretely executable throughout: exact CLI probe commands with a working --query filter ('aws cloudwatchomni list-spaces --region <target-region> --query "items[?region=='<target-region>']"'), exact upgrade commands ('pip install -U boto3 botocore'), named API operations, precise section-level pointers into reference files ('Open its "Span Duration" and "Finding failed spans" sections'), and a real CDK/ADOT asset path. For an instruction/routing skill this is copy-paste-ready guidance covering the common cases; not 4 because there are no missing key details — even failure branches (probe errors, empty query results, rejected query windows) carry the exact next action.

5 / 5

Workflow Clarity

The process is explicitly sequenced (Step 0 product decision → Step 0.5 symptom routing → routing tables → must-state output contract) with validation checkpoints and error-recovery feedback loops: the Region probe validates Omni vs CloudWatch and its failure branch (unsupported-service error) routes to an upgrade-then-re-run loop; StartQuery window rejection falls back to FilterLogEvents; empty live results still yield the methodology; and the destructive Dynamic Instrumentation path requires user confirmation before any create/delete. Checklists ('Must-state checklists — the output contract') are present for complex tasks. Not 4 because checkpoints and recovery loops are explicit rather than minor-gapped.

5 / 5

Progressive Disclosure

The body is a well-signaled overview/router pointing to 23 real reference files (all verified to exist), 2 assets, and named scripts, organized under per-product Files tables and routing tables — good structure with clear navigation. It falls short of anchor 5 on two counts: references are not strictly one level deep (references/cloudwatch/dynamic-instrumentation.md defers to a dynamic-instrumentation/ subdirectory of three further files, i.e. second-level nesting), and some detail that belongs in the references is inlined in SKILL.md itself (e.g. the full Omni dashboard save/reject semantics spelled out inside a routing-table row). Not 3 because the split is otherwise appropriate and every reference is clearly signaled with its intended section.

4 / 5

Total

17

/

20

Passed

Description

91%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A dense, highly specific description that comprehensively enumerates capabilities across both CloudWatch products with strong natural trigger vocabulary and explicit scope boundaries. Its only weakness is that the 'when to use' guidance is expressed through product-scoping conditions and exclusions rather than direct user-facing trigger phrases, which keeps completeness just short of the top anchor.

DimensionReasoningScore

Specificity

The description lists many concrete, specific actions and artifacts — 'fleet health views, Log Insights, metric/composite/anomaly alarms, custom metrics/EMF, dashboards, X-Ray/ADOT tracing, canaries, CloudTrail, Dynamic Instrumentation (live breakpoints)' and 'SQL over logs/traces, PromQL, Omni dashboards, alerts and Slack notifications, programmatic/IaC access (API/SDK/CLI/CFN)'. Coverage across both products is comprehensive with no generic filler, matching the 'multiple specific concrete actions; comprehensive coverage' anchor; it cannot be 4 because there are no minor gaps — even evaluation ('on-demand and online evaluation of live traffic, incl. setting it up, readback, evaluators') is enumerated.

5 / 5

Completeness

The 'what' is explicit and detailed (investigates root causes; builds, configures, debugs, tunes), and 'when' guidance exists via scope conditions ('CloudWatch on a reporting service', 'CloudWatch Omni on an existing Space', 'operator-symptom questions') plus explicit boundaries ('For first-time setup ... use setting-up-cloudwatch-observability', 'Not for app logging or threat detection'). It is not 5 because it never states direct user trigger phrases (no 'Use when the user asks to...' formulation — e.g. 'set up an alarm', 'query my logs', 'why is my service slow'), so the 'when' is inferred from product-scoping conditions rather than concrete triggers; it is above 3 because explicit routing and exclusion clauses are present, so trigger guidance is not merely implied.

4 / 5

Trigger Term Quality

Natural operator vocabulary is thorough: 'Log Insights', 'alarms', 'dashboards', 'tracing', 'canaries', 'SQL', 'PromQL', 'alerts', 'Slack notifications', 'service map', plus API-access synonyms 'API/SDK/CLI/CFN' and symptom framing ('operator-symptom questions'). These are the exact terms a user with this need would say; not 4 because no commonly used synonym or variation in the domain is conspicuously absent.

5 / 5

Distinctiveness Conflict Risk

It carves a clear niche (AWS observability across exactly two named products) and actively defuses the one real overlap — first-time setup — by routing it to the named sibling skill, and adds negative boundaries ('Not for app logging or threat detection'). Minimal conflict risk; not 4 because the sibling-skill boundary is explicitly handled rather than left as a minor overlap risk.

5 / 5

Total

19

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 78 deeper-than-1-level

Warning

referenced_paths_exist

Referenced path issues: 2 missing, 83 deeper-than-1-level

Warning

Total

14

/

16

Passed

Repository

aws/agent-toolkit-for-aws

Path

skills/core-skills/aws-observability/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.