run-solution-analyzer

Run the Solutions Analyzer scripts: mapper, documentation generator, ASIM browser. Use when: running solution analyzer, generating CSVs, generating docs, refreshing caches, force-refresh, invalidating caches, generating ASIM browser, running mapper, running collect_table_info, running collect_asim_fields.

Quality

92%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

Securityby

Low

Low-risk findings worth noting

Quality

Content

85%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a highly actionable, well-sequenced operational guide with concrete commands and validation checkpoints for a complex tool. Its main weakness is conciseness, driven by a time-sensitive known-issue note and some sections that could be trimmed or moved to a reference file.

Suggestions

Move the 'Known issue (as of 2026-04-28)' ASIM 404 note into a clearly marked 'Known issues / deprecated' section or a reference file so the time-sensitive date does not penalize the main flow's conciseness.

Tighten the 'Watching Mapper Progress' Tee-Object explanation to the essential rule ('tail the mapper's own log; do not use Tee-Object pipelines') and drop the multi-sentence buffering rationale.

Consider extracting the detailed '--force-refresh' type table and cache-invalidation internals into a reference file, keeping SKILL.md as a concise overview with one-level-deep pointers.

Dimension	Reasoning	Score
Conciseness	The body is mostly operational and assumes Claude's competence (it does not explain basic concepts), but it carries a time-sensitive 'Known issue (as of 2026-04-28)' date and sections that could be tightened; it is not 3 because the date-stamped content and some length do not earn every token, and not 1 because it is not padded with generic explanation.	2 / 3
Actionability	It provides copy-paste-ready commands throughout ('python map_solutions_connectors_tables.py --force-refresh=all', 'git fetch origin master', 'Get-Content ... -Tail 12') with flags explained; it is not 2 because the guidance is executable rather than pseudocode or abstract.	3 / 3
Workflow Clarity	Multi-step flows are sequenced with explicit checkpoints ('Always do this before any analyzer run', 'git status --short' verification, 'Resolve any conflicts before running') plus error-recovery guidance on the known ASIM 404 issue; it is not 2 because validation is explicit rather than implicit.	3 / 3
Progressive Disclosure	No bundle files are present, and the body is organized into well-signaled sections plus a summary scripts table; per the simple/no-bundle scoring note this warrants a 3. It is not 2 because content is appropriately sectioned rather than a monolithic wall with nested references.	3 / 3
	Total	11 / 12 Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it states concrete capabilities and provides an explicit, well-populated 'Use when' trigger list in third-person imperative voice. Trigger coverage is broad and the niche is clearly distinguished from other skills.

Dimension	Reasoning	Score
Specificity	The description names multiple concrete actions ('mapper, documentation generator, ASIM browser') matching the 'Lists multiple specific concrete actions' anchor; it is not below because it avoids vague language like 'helps with'.	3 / 3
Completeness	It answers both 'what' (Run the Solutions Analyzer scripts: ...) and 'when' (explicit 'Use when:' clause with multiple triggers); it is not below because the trigger guidance is explicit, not implied.	3 / 3
Trigger Term Quality	It covers natural phrases a user would say ('generating CSVs', 'generating docs', 'refreshing caches', 'invalidating caches', 'force-refresh'); a couple of terms are script names but overall coverage is strong, so it is not the level below.	3 / 3
Distinctiveness Conflict Risk	'Solutions Analyzer' with its specific script and trigger vocabulary is a clear niche unlikely to fire for unrelated skills; it is not below because the triggers are distinctive rather than generic.	3 / 3
	Total	12 / 12 Passed

Validation

100%

Warnings & errors only

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository: Azure/Azure-Sentinel
Path: .github/skills/run-solution-analyzer/SKILL.md
Commit: fd26ba7

Reviewed: 3 days ago

Table of Contents

Discovery Implementation Validation

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.