Challenge AI output with structured devil's-advocate protocols: anchor, verify, framing, and deep sub-commands.
86
86%
Does it follow best practices?
Impact
Pending
No eval scenarios have been run
Passed
No known issues
Challenge whether the right problem is being solved.
Patterns: Socratic · Steelman
Apply BOTH patterns in sequence.
6-stage questioning sequence to surface hidden assumptions.
(Chang 2023 — adapted from Classical Socratic method)
Stage 1 — Definition: "What exactly do we mean by [key term in problem]?"
Stage 2 — Elenchus (Examination): "Is that definition consistent with how we're actually using it?"
Stage 3 — Dialectic: "What is the OPPOSITE position? Who would disagree, and why?"
Stage 4 — Maieutics (Midwifery): "What do you actually believe, stripped of the framing?"
Stage 5 — Generalization: "Does this apply only here, or is it a symptom of a broader pattern?"
Stage 6 — Counterfactual: "If the problem didn't exist, what would be different? Is that the right thing to change?"
Record: key answers from each stage, assumptions surfaced.
Build the strongest possible counter-argument to current framing.
(Opposite of strawman — give the opposition its best case)
Record: steelmanned counter, stress test results, framing verdict.
## Challenge Report: framing (Socratic · Steelman)
**Target**: [problem statement or framing challenged]
**Error type**: framing / wrong problem
### Technique Selection
- **Family**: Framing — wrong problem / framing errors
- **Patterns applied**: Socratic, Steelman
- **Why these patterns**: [what about the target suggests a framing issue — e.g., solution seems correct but goal unclear, key terms ambiguous, assumptions unstated]
- **Patterns considered but skipped**: none — full framing protocol applied
### Findings
**Socratic Questioning** *(framing family — 6-stage questioning surfaces hidden assumptions)*
- Observation: [what specifically triggered framing concern]
- Definition surfaced: [what key terms actually mean]
- Hidden contradictions: [list]
- Real goal (post-maieutics): [stripped-down actual objective]
- Broader pattern: [local issue or systemic symptom]
- Counterfactual: [what should actually change]
- Reasoning: [what the Socratic stages revealed about the framing's validity]
- Confidence: [High/Med/Low]
**Steelman Counter-Argument** *(framing family — strongest possible counter to current framing)*
- Observation: [what weakness in the framing the steelman exploits]
- Current framing: [X is the problem]
- Steelman: [strongest case that X is NOT the problem]
- Stress test: [does framing survive?]
- Reasoning: [why the steelman succeeds or fails against the framing]
- Framing verdict: [Framing holds / Framing needs revision / Wrong problem entirely]
- Confidence: [High/Med/Low]
### Verdict
- **Assessment**: [Framing holds / Needs revision / Wrong problem — reframe before proceeding]
- **Confidence**: [High / Medium / Low]
- **What would flip this**: [specific evidence that would change the verdict]
- **Strongest counter to this verdict**: [steelman the opposite conclusion]
### Recommended Action
[Proceed as-is | Reframe as: [alternative framing] | Stop and reframe before implementing]