CtrlK
BlogDocsLog inGet started
Tessl Logo

analyze-sessions

Analyzes your local Copilot CLI sessions for dotnet/maui to drive iterative improvements to the PR-review agent (and other agents, skills, and instruction files). Runs a select → extract → score → judge → cluster → propose → emit-eval loop: a deterministic core ranks your worst / most-expensive sessions, then the agent rubric-tags recurring failure modes, proposes concrete repo edits, and emits a vally guard-eval per failure mode so each one becomes a regression test. Triggers on: "analyze my recent maui sessions", "what's making my agent runs expensive", "find failure modes in my Copilot sessions", "turn my session failures into guard evals". LOCAL-ONLY — never uploads, shares, or posts transcripts. Do NOT use for: reviewing a single PR (use pr-review), running tests, or analyzing a GitHub issue.

71

Quality

86%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

73%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a well-structured, highly actionable 6-phase workflow with explicit validation and a real one-level-deep bundle, but it repeats the trigger-phrase and privacy-contract content across multiple sections and inlines material that could live in references, costing token efficiency.

Suggestions

Dedupe the trigger phrases and privacy contract: state each once (frontmatter already covers triggers) and have the body cross-reference rather than restate them, to tighten conciseness from 3 toward 4.

Move the full vally YAML template and scoring formula into a references/ file (e.g. references/emit-eval-pattern.md) and link to it from Phase 6, letting the body stay a leaner overview and lifting progressive_disclosure toward 5.

Add one fully worked example proposal (filled Category/Priority/Location/Specific Change/Why It Helps) in Phase 5 to remove placeholders and push actionability from 4 to 5.

DimensionReasoningScore

Conciseness

Mostly efficient and assumes Claude's competence (no padding about what PowerShell or session logs are), but the trigger phrases and privacy contract are each restated across the frontmatter, callout, Architecture, Privacy & safety, and When-NOT-to-use sections, and the ASCII diagram is re-explained in prose — more than the 'minor' trimming a score-4 allows. Not a 2 because it never lapses into explaining concepts Claude already knows.

3 / 5

Actionability

Provides copy-paste-ready pwsh invocations with full args, a complete vally YAML template, an explicit scoring formula, and exact proposal/eval file paths — mostly executable guidance. Held at 4 rather than 5 because the vally template and proposal table rely on placeholders (<skill>, <mode>, <scenario>, <TOKEN>) and no fully worked example proposal is shown inline.

4 / 5

Workflow Clarity

The 6-phase loop is clearly sequenced with explicit validation checkpoints: Phase 6 runs `npx ... vally-cli ... lint --strict` on every emitted eval, Phase 5 gates edits behind user approval, and a Completion-criteria checklist closes the loop — satisfying the feedback-loop requirement for batch/eval-emitting operations that would otherwise cap this dimension at 3.

5 / 5

Progressive Disclosure

Good structure with one-level-deep references: the body points to the real `references/design-rationale.md` and `scripts/Get-SessionAnalysis.ps1` (both verified to exist, and design-rationale.md does not nest further references). Held at 4 rather than 5 because the body inlines sizable content (full vally template, scoring formula) that a leaner overview would defer to a reference file.

4 / 5

Total

16

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is exemplary: it specifies a comprehensive concrete action pipeline, lists natural trigger phrases, explicitly covers both what and when (and when not), and carves out a distinct niche with clear boundaries. Voice is correctly third person. No improvements needed.

DimensionReasoningScore

Specificity

Lists multiple specific concrete actions with comprehensive coverage: 'select → extract → score → judge → cluster → propose → emit-eval loop', 'ranks your worst / most-expensive sessions', 'rubric-tags recurring failure modes', 'proposes concrete repo edits', 'emits a vally guard-eval per failure mode' — matching the score-5 anchor of multiple specific concrete actions.

5 / 5

Completeness

Explicitly answers both what (the analysis loop and its concrete actions) and when via an explicit 'Triggers on:' clause with concrete trigger phrases, plus a 'Do NOT use for' boundary — matching the score-5 anchor of clearly answering both what AND when with concrete trigger phrases.

5 / 5

Trigger Term Quality

Includes comprehensive natural-language trigger phrases users would actually say — 'analyze my recent maui sessions', 'what's making my agent runs expensive', 'find failure modes in my Copilot sessions', 'turn my session failures into guard evals' — covering synonyms (sessions, runs, expensive, fail, failure modes, guard evals, Copilot) beyond the score-4 'a few natural terms missing' anchor.

5 / 5

Distinctiveness Conflict Risk

Occupies a clear niche (local Copilot CLI session analysis for dotnet/maui agent improvement) with distinct triggers and an explicit 'Do NOT use for: reviewing a single PR (use pr-review), running tests, or analyzing a GitHub issue' boundary that minimizes conflict risk, matching the score-5 clear-niche anchor.

5 / 5

Total

20

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
dotnet/maui
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.