CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

rag-architect

Use when the user asks to design a RAG pipeline, choose a chunking strategy or embedding model, pick a vector database, or evaluate retrieval quality (precision@k, recall@k, NDCG). Examples: 'design a RAG system for our docs', 'what chunk size should I use for this corpus', 'evaluate my retriever against ground truth'. NOT for general LLM cost tuning (use llm-cost-optimizer) or agent loops over retrieval (use agenthub).

76

Quality

95%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

96%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A strong operational skill body: deterministic tool-driven workflow with executable commands, explicit output contracts, and a genuine validation feedback loop, all written without wasted tokens. The only structural weakness is that the invoked scripts are absent from the bundle, leaving the tool chain unverifiable.

Suggestions

Ship the three invoked scripts (chunking_optimizer.py, rag_pipeline_designer.py, retrieval_evaluator.py) in the skill bundle (e.g., scripts/) and align the command paths with their actual location.

State where the scripts live relative to SKILL.md (the body says 'All paths relative to this skill folder' but invokes them at the root) so the copy-paste commands resolve without adjustment.

DimensionReasoningScore

Conciseness

Lean and efficient: no explanation of concepts Claude already knows (RAG, precision@k, NDCG are named, not taught); every section is operational (hard rules, tier table with a 'When' column, commands, verification loop). Time-sensitive model names are explicitly hedged ('Current-generation examples (verify before use)') rather than padded facts, so nothing is there that doesn't earn its place.

5 / 5

Actionability

Fully executable guidance: three copy-paste-ready bash commands with real arguments and flags, documented output files with their JSON keys, a fully enumerated requirements schema (all keys listed as required), and concrete evaluation thresholds. Not the anchor-4 case — there are no gaps in the common-case path.

5 / 5

Workflow Clarity

A 4-step numbered workflow with explicit chaining ('Outputs chain: corpus analysis → design → evaluation') and a verification loop containing a true validate→fix→retry feedback loop: concrete floors (precision@5 ≥ 0.8, recall@10 ≥ 0.85), failure analysis via poor-example lists, and the discipline of changing one variable at a time before re-running.

5 / 5

Progressive Disclosure

The three references/*.md files exist in the bundle, are one level deep, and each carries a clear one-line annotation of what it contains — near the anchor-5 pattern. However, the three scripts the workflow invokes (chunking_optimizer.py, rag_pipeline_designer.py, retrieval_evaluator.py) are not present in the provided bundle structure, so not all referenced paths can be verified.

4 / 5

Total

19

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An excellent description: concrete multi-action capability statement, explicit 'Use when' trigger with example user phrasings, and explicit negative boundaries routing to adjacent skills. The only gap is a handful of natural synonyms that would broaden trigger matching.

Suggestions

Add spelled-out and adjacent synonyms such as 'retrieval-augmented generation', 'semantic search', or 'vector search' to the trigger clause to catch users who don't say 'RAG'.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — 'design a RAG pipeline, choose a chunking strategy or embedding model, pick a vector database, or evaluate retrieval quality (precision@k, recall@k, NDCG)' — with named metrics, giving comprehensive coverage of the RAG-design domain with no meaningful gaps, matching the anchor for multiple specific concrete actions.

5 / 5

Completeness

Explicitly answers both what (design/choose/pick/evaluate RAG pipeline components with named metrics) and when, via a literal 'Use when the user asks to...' clause plus concrete example trigger phrases — the anchor-5 pattern of both what AND when with concrete trigger phrases.

5 / 5

Trigger Term Quality

Strong natural keyword coverage including example utterances users would actually say ('design a RAG system for our docs', 'what chunk size should I use for this corpus', 'evaluate my retriever against ground truth'). A few natural synonyms are missing (e.g., 'retrieval-augmented generation' spelled out, 'semantic search', 'vector search'), so it fits 'good keyword coverage; a few natural terms missing' rather than comprehensive.

4 / 5

Distinctiveness Conflict Risk

Clear niche with distinct triggers, and conflict risk is actively mitigated by explicit negative boundary guidance: 'NOT for general LLM cost tuning (use llm-cost-optimizer) or agent loops over retrieval (use agenthub)' — beyond merely minor overlap risk.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

alirezarezvani/claude-skills

Path

engineering/skills/rag-architect/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.