CtrlK
BlogDocsLog inGet started
Tessl Logo

pantheon-ai/socratic-method

Refine vague or high-stakes prompts through Socratic questioning — surfaces hidden assumptions, probes reasoning, and iterates toward clarity before committing to a response

50

Quality

63%

Does it follow best practices?

Impact

No eval scenarios have been run

SecuritybySnyk

Passed

No known issues

Overview
Quality
Evals
Security
Files

Quality

Content

62%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The content is a strong, actionable, well-sequenced protocol with concrete example questions and clear checkpoints. Its main weakness is progressive disclosure: the body advertises four reference files that do not exist in the bundle, making the navigation promise unfulfilled, and the Mindset section adds some avoidable verbosity.

Suggestions

Create the four referenced files (references/question-taxonomy.md, classical-foundations.md, anti-patterns.md, worked-examples.md) or remove the broken links and inline the essential material.

Trim the Mindset section and the 'WHY' annotations that merely restate the rule, keeping only the rationales that add non-obvious value.

Consider moving the classical-foundations material fully out of SKILL.md since it is conceptual background Claude already knows, which would also improve conciseness.

DimensionReasoningScore

Conciseness

Most of the body is efficient and purposeful, but the Mindset section re-explains a disposition Claude already grasps and several 'WHY' annotations restate reasoning that is implicit in the rule, adding tokens that could be trimmed.

2 / 3

Actionability

It provides concrete, copy-paste-ready guidance: a five-phase protocol each with literal example questions, hard numeric constraints ('no more than three questions per turn'), and an example opening line — fully executable for an instruction skill.

3 / 3

Workflow Clarity

The five phases are explicitly sequenced in order with a clear checkpoint ('NEVER skip Phase 5 before acting', 'Only after confirmation: execute'), and the override rule ('just do it') acts as an explicit feedback/escape loop, satisfying the validation-checkpoint requirement.

3 / 3

Progressive Disclosure

The body references four files in references/ (question-taxonomy.md, classical-foundations.md, anti-patterns.md, worked-examples.md) and signals them clearly, but none of those files exist on disk — the references are dead links, so the disclosed structure is not actually present.

1 / 3

Total

9

/

12

Passed

Description

50%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is well-written and on-domain but reads as a purpose statement rather than a capability-plus-trigger specification. It states what the skill does clearly but only implies when to use it, and its trigger terms are somewhat abstract.

Suggestions

Add an explicit trigger clause, e.g. 'Use when a request is vague, high-stakes, or asks "how" before "what" — skip for simple concrete tasks like fixing a typo.'

Surface natural user phrasings as triggers ('I don't know where to start', 'make it better', 'should I use X?') that currently live only in the body.

Name a couple more concrete capabilities to lift specificity toward a multi-action list.

DimensionReasoningScore

Specificity

It names the domain (prompt refinement) and concrete actions ("surfaces hidden assumptions, probes reasoning, and iterates toward clarity") but stops short of listing multiple specific concrete operations; it is more of a purpose statement than a list of capabilities.

2 / 3

Completeness

It clearly answers "what" but the "when" is only implied through the adjectives "vague, complex, or high-stakes" rather than an explicit "Use when..." trigger clause, which the rubric caps at 2.

2 / 3

Trigger Term Quality

"vague, complex, or high-stakes prompts" and "Socratic dialogue" are relevant but lean technical/abstract; it lacks the plain phrasings a user would naturally say ("I don't know where to start", "make it better"), which only appear later in the body.

2 / 3

Distinctiveness Conflict Risk

The Socratic-refinement niche is fairly distinct, but the trigger language ("vague, complex, or high-stakes prompts") is broad enough that it could overlap with general planning or brainstorming skills, so it is not a clean, conflict-free niche.

2 / 3

Total

8

/

12

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 4 missing

Warning

referenced_paths_exist

Referenced path issues: 4 missing

Warning

Total

14

/

16

Passed

Reviewed

Table of Contents