CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

scholar-evaluation

Systematically evaluate scholarly and research work using the ScholarEval framework. Use when assessing academic papers, research proposals, literature reviews, or scholarly writing for quality, rigor, and publication readiness. Triggers: evaluate paper, scholar evaluation, research quality assessment, peer review scoring, publication readiness, academic paper review, rate research quality, ScholarEval.

Quality

69%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./skills/documentation/research/scholar-evaluation/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

48%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The evaluation workflow core is solid — clear six-step sequence, a genuine rubric reference file, and excellent evidence-first anti-patterns. But the body is padded with a tangential schematics section and generic best-practices filler, and it delegates score aggregation to scripts that do not exist in the bundle.

Suggestions

Delete or drastically shrink the 'Visual Enhancement with Scientific Schematics' and 'Best Practices' sections — they add ~40 lines of material Claude either knows or does not need for this task.

Remove the inline per-dimension sub-bullet lists (already covered by references/evaluation_framework.md) and keep only the dimension names with one-line pointers, cutting ~60 lines.

Either implement scripts/calculate_scores.py and scripts/generate_schematic.py or remove their invocations and the '(not yet implemented)' reference — as written, Step 3 directs Claude to run a nonexistent script.

DimensionReasoningScore

Conciseness

Several padded sections: the ~30-line 'Visual Enhancement with Scientific Schematics' digression is tangential to evaluation, the 8-item 'Best Practices' list restates what Claude already knows ('Maintain Objectivity', 'Provide Evidence'), an empty bash block in Mindset carries only a comment, and the ~60 lines of per-dimension sub-bullets duplicate criteria already in references/evaluation_framework.md. This is 'noticeably verbose; several unnecessary explanations or padded sections', not 3, where padding would be limited to some trimmable spots.

2 / 5

Actionability

The workflow itself is concrete (defined 5-point scale, feedback structure, report components), but the two script invocations point at files that do not exist in the bundle — calculate_scores.py is even acknowledged 'not yet implemented' while Step 3 tells Claude to use it. That is concrete guidance with missing key pieces, matching anchor 3; it is not 4 because a load-bearing command is unrunnable.

3 / 5

Workflow Clarity

Steps 1–6 are clearly sequenced (scope → dimension evaluation → scoring → synthesis → feedback → context adjustment) with checkpoints like 'Ask the user to clarify if the scope is ambiguous' and the anti-patterns section ('NEVER score without evidence', 'NEVER skip dimensions') acting as validation guardrails. Not 5 because there is no explicit verification loop on the final report (e.g., confirming every applicable dimension was scored); not 3 since this is not a destructive/batch operation and checkpoints are largely present.

4 / 5

Progressive Disclosure

References are clearly signaled and one level deep (references/evaluation_framework.md exists and matches the described search patterns), but scored against the actual bundle: scripts/calculate_scores.py and scripts/generate_schematic.py are referenced yet no scripts/ directory exists, and the ~60 lines of inline dimension criteria belong in the reference file. This lands between anchor 3's organizational gaps and anchor 2's inline-misplacement, so 3.

3 / 5

Total

12

/

20

Passed

Description

78%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A well-constructed description: explicit what/when structure with a dedicated trigger list and good natural-language keyword coverage. Its main weakness is thin action specificity — 'systematically evaluate' is the only verb — and minor overlap risk on generic peer-review triggers.

Suggestions

Replace the single broad action with several concrete ones, e.g. 'Score work across eight dimensions (methodology, literature review, analysis rigor, ...), calculate aggregate ratings, and produce a prioritized improvement report'.

Add common user phrasings like 'manuscript', 'thesis', or 'review my draft' to the trigger list to close remaining keyword gaps.

DimensionReasoningScore

Specificity

The single concrete action is 'Systematically evaluate scholarly and research work using the ScholarEval framework' for 'quality, rigor, and publication readiness' — it names the domain well but offers only one broad action verb, with no mention of scoring outputs, structured reports, or dimension-level assessment. This matches 'Names domain and 1-2 concrete actions, but not comprehensive' rather than 4, which would require several distinct specific actions.

3 / 5

Completeness

Explicitly answers what ('Systematically evaluate scholarly and research work using the ScholarEval framework') and when ('Use when assessing academic papers, research proposals, literature reviews, or scholarly writing...'), plus a dedicated 'Triggers:' list of concrete trigger phrases — a direct match for the anchor-5 example structure. Not 4, because the 'when' is fully explicit rather than improvable.

5 / 5

Trigger Term Quality

Trigger list covers natural phrasings users would say: 'evaluate paper', 'peer review scoring', 'rate research quality', 'publication readiness', 'academic paper review', plus work types ('research proposals, literature reviews'). Falls short of 5 because common variations like 'manuscript', 'thesis', or 'review my draft' are missing; well above 3's 'missing common variations'.

4 / 5

Distinctiveness Conflict Risk

The ScholarEval framing and scholarly-evaluation trigger set form a clear niche, but 'peer review scoring' and 'publication readiness' could overlap with a generic peer-review or academic-writing skill — minor overlap risk with closely related skills. Not 5 because a couple of triggers are generic enough to be contested; not 3 because the core triggers are unmistakably about evaluation scoring.

4 / 5

Total

16

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

referenced_paths_exist

Referenced path issues: 5 missing

Warning

Total

14

/

16

Passed

Repository

pantheon-org/tekhne

Path

skills/documentation/research/scholar-evaluation/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.