CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

backtest-diagnose

Diagnose failed or underperforming backtests, locate the root cause, and fix the issue

Quality

78%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./agent/src/skills/backtest-diagnose/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The content is a strong, highly actionable diagnostic playbook: concrete thresholds, executable validation commands, a gated workflow with feedback loops, and well-organized sections. Remaining gains are marginal — trimming the dense benchmark paragraph and moving peripheral detail (benchmark rules, evidence ingestion) into a reference file. No substantive weaknesses found.

DimensionReasoningScore

Conciseness

The body is dense and domain-specific — error-taxonomy tables, exact thresholds ("trade_count=0", "capital utilization < 50%", "at most 3 repair iterations") — with only minor trimmable parts: the long benchmark-explanation sentence in Logic Bugs #5 and an Overview that restates the description. It is efficient overall but not lean enough for 5.

4 / 5

Actionability

Concrete file paths ("artifacts/metrics.csv", "code/signal_engine.py"), tool calls (read_file, edit_file), a copy-paste AST validation command, and specific action-item examples make the guidance mostly executable. Some fixes ("Add length checks", "Ensure the return value is pd.Series") are directives without exact code, keeping it just below fully copy-paste ready.

4 / 5

Workflow Clarity

A clear 5-step Diagnostic Workflow with an explicit verify step, a Hard-Gate Checklist, Post-Fix Validation Rules, and a fix-one-issue-then-rerun feedback loop capped at 3 iterations. This matches the top anchor: explicit validation steps, error-recovery loops, and a checklist for a complex process.

5 / 5

Progressive Disclosure

The ~88-line body is well organized with headers, tables, and a one-level-deep cross-skill pointer ("See the strategy-discovery skill"), and no bundle files exist to reference. It sits above 50 lines with some inline detail (benchmark fallback rules, evidence hookup) that could live in a reference file, so structure is good but not the ideal split of 5.

4 / 5

Total

17

/

20

Passed

Description

66%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description states a clear domain and three concrete actions with good natural keywords, but lacks an explicit 'Use when...' trigger clause, leaving the invocation condition only weakly implied. It is distinctive within the quant/backtesting niche with minor overlap risk. Overall a solid description whose main gap is the missing trigger guidance.

Suggestions

Append an explicit trigger clause, e.g. "Use when a backtest run fails, errors out, or produces abnormal results (zero trades, low capital utilization, unexpected returns)."

Mention concrete failure signals users would report — such as "exit code", "zero trades", or "poor returns" — to broaden natural trigger-term coverage and sharpen distinctiveness.

Name the diagnostic artifacts involved (metrics, equity curve, trade log) to make the capabilities more tangible and distinguish the skill from general debugging.

DimensionReasoningScore

Specificity

"Diagnose failed or underperforming backtests, locate the root cause, and fix the issue" lists three concrete actions in a clearly named domain, matching the anchor for several specific actions with minor gaps. Not 5 because it omits the failure modes the skill actually handles (runtime errors, zero trades, abnormal results).

4 / 5

Completeness

The "what" is clear (diagnose, locate root cause, fix), but there is no "Use when..." clause or equivalent explicit trigger guidance — "failed or underperforming backtests" is the object of the action, only weakly implying when to invoke the skill. Per the judging guideline, a missing explicit trigger caps completeness at 3.

3 / 5

Trigger Term Quality

"failed", "underperforming", "backtests", and "root cause" are phrases users would naturally say when needing this skill. A few natural variants are missing ("error", "poor results", "losing strategy"), so it does not reach the comprehensive synonym coverage of 5.

4 / 5

Distinctiveness Conflict Risk

"backtests" carves out a distinct niche with minimal conflict risk against generic skills. Minor overlap risk remains with closely related strategy/quant skills, and "fix the issue" is generic, so it falls short of the clear-niche-with-distinct-triggers anchor at 5.

4 / 5

Total

15

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository

HKUDS/Vibe-Trading

Path

agent/src/skills/backtest-diagnose/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.