CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

rag-architect

Designs and implements production-grade RAG systems by chunking documents, generating embeddings, configuring vector stores, building hybrid search pipelines, applying reranking, and evaluating retrieval quality. Use when building RAG systems, vector databases, or knowledge-grounded AI applications requiring semantic search, document retrieval, context augmentation, similarity search, or embedding-based indexing.

71

Quality

89%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured skill body: lean and executable code examples with per-step validation checkpoints and a genuine progressive-disclosure split between the overview and five real reference files. The only weaknesses are minor — a phantom evaluate.py reference and the absence of explicit error-recovery guidance when checkpoints fail.

Suggestions

Remove or implement the evaluate.py reference in the retrieval-evaluation example (the commented CLI line points to a script that does not exist in the bundle).

Add brief error-recovery guidance for failed checkpoints (e.g., 'if the assert fails, re-check chunk metadata enrichment and re-run') to complete the validate → fix → retry loop and raise workflow clarity.

Replace undefined placeholder variables (raw_docs, questions, retrieved_contexts) with minimal inline definitions so examples 1 and 5 are fully self-contained and copy-paste ready.

DimensionReasoningScore

Conciseness

The body is lean: no explanations of what RAG is or how libraries work, and inline comments carry only non-obvious guidance ("Evaluate chunk_size on your domain data — never use 512 blindly", "Idempotent upsert with deduplication via deterministic IDs"). Every section earns its tokens; only the two-line attribution footer is trimmable, which is not over-explanation — anchor 5 fits better than anchor 4.

5 / 5

Actionability

Five executable, near-copy-paste code examples with real imports, parameters, and asserts cover the common cases. It is not 5 because example 5's commented CLI references an `evaluate.py` script that does not exist in the bundle, and several examples rely on undefined placeholders (`raw_docs`, `questions`, `retrieved_contexts`).

4 / 5

Workflow Clarity

A clearly sequenced 5-step workflow with "validate before moving on (see checkpoints below)", assert checkpoints after examples 1–3, and a numeric gate ("Target context_precision >= 0.7 and context_recall >= 0.6 before moving to LLM integration"). It falls short of anchor 5 only because checkpoints are one-sided asserts with no error-recovery guidance (fix-and-revalidate loop) when a checkpoint fails.

4 / 5

Progressive Disclosure

The body is a true overview: a topic/reference/load-when table signals each of five one-level-deep reference files, all of which exist in references/ with no nested .md links, while core implementation examples stay inline. This matches anchor 5 (clear overview, well-signaled references, easy navigation).

5 / 5

Total

18

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that clearly and concretely states both capabilities and trigger conditions in third-person voice. Keyword coverage is good but omits a few natural user phrasings, and its broad triggers (vector databases, semantic search) carry minor overlap risk with adjacent skills.

DimensionReasoningScore

Specificity

The description lists six concrete pipeline actions — "chunking documents, generating embeddings, configuring vector stores, building hybrid search pipelines, applying reranking, and evaluating retrieval quality" — in third-person voice, giving comprehensive coverage with no gaps, matching the anchor-5 example structure.

5 / 5

Completeness

It explicitly answers both what ("Designs and implements production-grade RAG systems by...") and when ("Use when building RAG systems, vector databases, or knowledge-grounded AI applications requiring semantic search, document retrieval, context augmentation, similarity search, or embedding-based indexing") with concrete trigger phrases — the exact anchor-5 pattern. It is not 4 because the 'when' clause is fully explicit, not merely present.

5 / 5

Trigger Term Quality

Natural trigger terms are well covered with synonyms ("RAG systems, vector databases, semantic search, document retrieval, context augmentation, similarity search, embedding-based indexing"), but common variations like the spelled-out "retrieval augmented generation", "knowledge base", or "chat with your documents" are missing. Good coverage with a few natural terms absent fits anchor 4, not the comprehensive synonym-plus-extension coverage of anchor 5.

4 / 5

Distinctiveness Conflict Risk

The RAG/retrieval niche is clear with distinct triggers, but standalone phrases like "vector databases" and "semantic search" could pull in users needing pure vector-DB administration or non-RAG search work, creating minor overlap risk with closely related skills. This matches anchor 4 rather than anchor 5's minimal-conflict profile.

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

Jeffallan/claude-skills

Path

skills/rag-architect/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.