CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

feast-testing

How to test and debug Feast — running targeted tests, writing unit tests for new components, debugging registry and online store issues, and inspecting live feature store state. Use when writing tests for a new feature, debugging a failing test, investigating a runtime error, or verifying that a change works correctly end-to-end.

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A solid, dense reference-style skill: lean, mostly copy-paste-ready commands and code, a clear symptom/cause/fix structure for debugging, and well-signposted sections. The main gaps are incomplete code examples (undefined variables, placeholders), a missing run-the-test feedback loop after the test-writing patterns, and some content that could be offloaded to reference files.

Suggestions

Fix the incomplete code examples: define 'config' and 'feature_view' in the async example, import 'Entity' and 'ValueType' in the registry example, and replace 'data=[...]' with a minimal concrete list of tuples.

Add an explicit feedback loop to the 'Writing Unit Tests' section — after following a pattern, run the new test with 'python -m pytest sdk/python/tests/unit/... -k <name> -v' and fix until it passes.

Consider moving the per-store/per-pattern test examples into a references/ file (e.g. TESTING_PATTERNS.md) and keeping one representative pattern inline, so SKILL.md stays a lean overview.

DimensionReasoningScore

Conciseness

The body is lean and reference-style — commands, code blocks, a directory tree, and a table — with almost no over-explanation of concepts Claude already knows ('Rule of thumb' guidance is useful, not padding). It is not a 5 because small parts could be tightened, e.g. the Python registry-inspection snippet under 'Debugging' partially duplicates what 'feast registry-dump' already shows.

4 / 5

Actionability

Most guidance is executable and specific (concrete pytest commands, make targets, CLI commands, a curl example), and pointing to real exemplar files ('Follow sdk/python/tests/unit/infra/online_store/test_dynamodb_online_store.py') is strong. It falls short of 5 because several code examples contain gaps: 'data=[...]' placeholder, undefined 'config'/'feature_view' in the async example, and missing 'Entity'/'ValueType' imports in the registry example.

4 / 5

Workflow Clarity

Sections follow a coherent sequence (organize → run → write → debug → inspect) and the debugging entries use an explicit Symptom → Cause → Fix structure with verification commands ('feast registry-dump', curl against 'feast serve'). Not a 5 because the writing-tests patterns lack an explicit feedback loop (e.g. 'run the new test with pytest -k to confirm it passes') and there is no explicit checkpoint for verifying fixes end-to-end.

4 / 5

Progressive Disclosure

The skill is a single, well-organized SKILL.md with clear section headers, real repo paths, and no nested or buried references (no bundle files exist to score against). It is not a 5 because at ~250 lines the per-pattern test-writing examples could partly live in reference files, keeping the overview leaner; it is above 3 because everything present is appropriately placed and easy to navigate.

4 / 5

Total

16

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete multi-part capability list in third person, an explicit 'Use when...' clause with realistic trigger scenarios, and a clearly bounded Feast-specific niche. The only weakness is modest synonym coverage in trigger terms.

Suggestions

Add a few natural trigger synonyms users would say, such as 'pytest', 'troubleshoot', or 'flaky test', to widen trigger matching.

Optionally mention repo-specific entry points like 'make test-python-unit' in the when-clause so users describing CI failures match the skill.

DimensionReasoningScore

Specificity

The description lists multiple specific concrete actions — 'running targeted tests, writing unit tests for new components, debugging registry and online store issues, and inspecting live feature store state' — giving comprehensive coverage of the testing/debugging domain. It is not a 4 because no meaningful capability in the domain is left uncovered.

5 / 5

Completeness

It explicitly answers what ('running targeted tests, writing unit tests... debugging registry and online store issues, and inspecting live feature store state') and when ('Use when writing tests for a new feature, debugging a failing test, investigating a runtime error, or verifying that a change works correctly end-to-end') with concrete trigger phrases, matching the top anchor. Not a 4 since the 'when' clause is already fully explicit and specific.

5 / 5

Trigger Term Quality

Phrases like 'debugging a failing test', 'investigating a runtime error', and 'verifying that a change works correctly end-to-end' are natural user phrasings with good coverage. It falls short of 5 because common synonyms and tool-specific terms users would say (e.g. 'pytest', 'troubleshoot', 'flaky test') are absent.

4 / 5

Distinctiveness Conflict Risk

It names a clear niche (Feast feature-store testing/debugging) with distinct trigger conditions, so conflict risk with other skills is minimal. It is not a 4 because the Feast-specific domain and explicit triggers leave no meaningful overlap with generic skills.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

feast-dev/feast

Path

skills/feast-testing/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.