CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

regex-vs-llm-structured-text

Decision framework for parsing structured text (quizzes, forms, invoices, receipts, tables) with a hybrid regex-first pipeline — regex extraction handles 95%+ cheaply, a confidence scorer flags low-confidence items, and an LLM validator fixes only the edge cases. Use when choosing between regex and LLM for text extraction, building a cheap document parser, or optimizing extraction cost and accuracy.

Quality

84%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A lean, well-organized skill with a clear decision framework, an ASCII architecture diagram, near-executable code, and honest production metrics. The main gaps are a stubbed LLM-validator return path, duplicated trigger sections, and no feedback loop for handling malformed LLM validator output.

Suggestions

Complete validate_with_llm: implement parsing of the LLM response (e.g., extract and validate the returned JSON, fall back to the original item on parse failure) instead of the undefined 'corrected_item' return.

Merge the overlapping 'When to Activate' and 'When to Use' sections into one trigger list to remove redundancy and cut tokens.

Consider moving the full pipeline implementation into a scripts/ or references/ file, keeping SKILL.md as a compact overview with the decision framework and a minimal example.

DimensionReasoningScore

Conciseness

The body assumes Claude's competence (no padding explaining regex, LLMs, or parsing basics) and stays tight, but 'When to Activate' and 'When to Use' largely duplicate each other and the intro paragraph restates the frontmatter description. Matches the score-4 anchor (efficient with minor trimmable redundancy) rather than 5, where every token would earn its place.

4 / 5

Actionability

Three of four code sections are executable copy-paste Python, but 'validate_with_llm' ends with 'return corrected_item' (an undefined variable) and the elided comment 'Parse LLM response and return corrected item...', leaving the LLM-output handling unimplemented. This matches score-4 (mostly executable with minor gaps) and is not 5, which requires fully executable coverage; not 3 because the gap is localized to one stub.

4 / 5

Workflow Clarity

The sequence is clear and gated: regex parse → confidence score with an explicit 0.95 threshold → LLM validation only for flagged items, plus a decision tree for when regex vs LLM applies. Matches score-4 (clear sequence with most checkpoints present); not 5 because there is no step for verifying/handling the LLM validator's response (e.g., parse, validate, and fall back on malformed LLM output).

4 / 5

Progressive Disclosure

No bundle files exist, and the single SKILL.md is well-sectioned with clear headers (Decision Framework, Architecture Pattern, Implementation, Best Practices, Anti-Patterns) matching the rubric guidance to score against the actual bundle structure. Matches score-4 (good structure, most content appropriately placed); not 5 because ~90 lines of implementation code could be split into scripts/references rather than inlined, and not 3 because nothing is buried or misfiled.

4 / 5

Total

16

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong, well-structured description: third-person voice, concrete pipeline actions, explicit 'Use when...' triggers, and good natural keyword coverage. Its only weakness is the absence of file-extension and synonym triggers (e.g., 'parse PDFs', '.csv') that would push trigger coverage to comprehensive.

DimensionReasoningScore

Specificity

Names the domain ('quizzes, forms, invoices, receipts, tables') and lists three concrete pipeline actions: 'regex extraction handles 95%+ cheaply, a confidence scorer flags low-confidence items, and an LLM validator fixes only the edge cases'. This matches the score-5 anchor (multiple specific concrete actions, comprehensive coverage of the pipeline) and is not 4 because no meaningful action gaps remain.

5 / 5

Completeness

Explicitly answers 'what' (a hybrid regex-first pipeline with confidence scoring and LLM validation) and 'when' ('Use when choosing between regex and LLM for text extraction, building a cheap document parser, or optimizing extraction cost and accuracy'), with concrete trigger phrases matching the score-5 anchor. Not 4 because both clauses are explicit and specific.

5 / 5

Trigger Term Quality

Good natural keywords users would say — 'choosing between regex and LLM for text extraction', 'building a cheap document parser', 'quizzes, forms, invoices, receipts, tables', 'optimizing extraction cost and accuracy' — but misses synonyms and file extensions (e.g., 'parse PDF', '.csv', '.json'), matching the score-4 anchor rather than 5's comprehensive synonym/extension coverage.

4 / 5

Distinctiveness Conflict Risk

The niche is clear ('hybrid regex-first pipeline', 'regex vs LLM for text extraction') with distinct triggers, but 'structured text' parsing overlaps somewhat with generic document/OCR/PDF extraction skills, matching the score-4 anchor (mostly distinct, minor overlap risk with closely related skills) rather than 5's minimal conflict risk.

4 / 5

Total

18

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

Total

15

/

16

Passed

Repository

affaan-m/ECC

Path

skills/regex-vs-llm-structured-text/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.