CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

veomni-new-op

Add or optimize a tensor-level kernel in veomni/ops, register its variants, integrate it with models, and add numerical and registry tests. Trigger: 'add op', 'new kernel', 'add attention variant', 'new fused op', 'add triton kernel', 'optimize operator'.

Quality

97%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is an outstanding example of a workflow skill: lean, entirely non-generic, and organized into five well-sequenced phases with explicit validation commands, failure contracts, and a pitfalls checklist. Its only weakness is that a few implementation steps (model wiring via `VeomniOp`/`resolve_op_impl`, device-package guards, raw forward/backward signatures) are named but never shown in code, leaving minor actionability gaps.

Suggestions

Add a short raw-pair example showing the forward/backward signature (returning `(output, SavedState)` and one gradient per positional tensor input), since Phase 1/2 rely on it but only describe it in prose.

Include a minimal model-integration snippet showing `VeomniOp(resolve_op_impl(...))` construction and storage on the module, mirroring the existing register_op example.

Show the canonical guard-plus-requirement pattern for optional device packages (e.g., the NPU/CUDA import guard), which the pitfalls call out but the implement steps never demonstrate.

DimensionReasoningScore

Conciseness

The body is dense, imperative, and entirely repo-specific (registry identity tuples, `SavedState` contracts, patchgen rules, NPU workflow entries); it explains nothing Claude already knows and contains no padded or motivational prose. Every section earns its place, matching the 'lean and efficient' anchor rather than the 4 anchor's 'minor instances of over-explanation'.

5 / 5

Actionability

Most guidance is executable and specific: a copy-paste-ready `register_op(...)` example with `GpuKernelRequirement(platforms=(NvidiaGpuPlatform(min_cc=80),))`, a concrete `pytest -q tests/ops/<kernel_name>/ tests/ops/base/` command, `make quality`, and `OP_REGISTRY.list_registered(...)`. It falls short of the 5 anchor because several steps name APIs without any example — e.g., constructing "a `VeomniOp` from `resolve_op_impl(...)`", the raw `forward`/`backward` pair's signature, and the pattern for guarding optional device packages are prose-only.

4 / 5

Workflow Clarity

The five phases (Design → Implement → Test → Document → Finalize) form a clear sequence with explicit validation checkpoints: "Run the family tests plus the registry and documentation guards", the finalize checklist ("Run `/veomni-review`", "Run `make quality`", "Verify `OP_REGISTRY.list_registered(...)`"), and a failure contract ("must fail clearly when its requirement is not satisfied; it must not silently fall back to eager"). Together with the Common Pitfalls checklist this matches the 5 anchor's explicit validation and checklist criteria, not merely the 4 anchor's 'most checkpoints'.

5 / 5

Progressive Disclosure

There are no bundle files (references/, scripts/, assets/ are absent), so the skill is judged on its own structure: well-organized sections (Before You Start, Ops Architecture, Phases 1–5, Common Pitfalls) with pointers to repo documentation clearly signaled one level deep (`.agents/knowledge/constraints.md`, `veomni/ops/README.md`, `docs/design/op_selection.md`). At ~140 lines of cohesive procedural guidance, nothing here clearly belongs in a separate file, so it does not drop to the 4 anchor's 'minor organization gaps'.

5 / 5

Total

19

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is exemplary: it states four concrete capabilities covering the full op-development workflow and gives an explicit, well-chosen trigger list with natural synonym coverage. It answers both 'what' and 'when' clearly and is tightly scoped to its niche with no vague language or padding.

DimensionReasoningScore

Specificity

The description lists multiple concrete, non-overlapping actions — "Add or optimize a tensor-level kernel in veomni/ops", "register its variants", "integrate it with models", "add numerical and registry tests" — which comprehensively cover the skill's workflow from implementation through testing. It matches the anchor for multiple specific concrete actions with comprehensive coverage; there is no generic filler to drop it to 4.

5 / 5

Completeness

Both questions are answered explicitly: the 'what' is the four concrete actions (add/optimize kernel, register variants, integrate with models, add tests) and the 'when' is an explicit "Trigger:" clause with concrete trigger phrases. This mirrors the anchor-5 example structure exactly; it is above 4 because the 'when' is explicit rather than merely present-but-imprecise.

5 / 5

Trigger Term Quality

The explicit trigger list provides natural synonyms a user would actually say: 'add op', 'new kernel', 'add attention variant', 'new fused op', 'add triton kernel', 'optimize operator' — covering op/kernel/operator and concrete kernel types (triton, fused, attention). Coverage is comprehensive with synonym variation, matching the top anchor; it does not fall to 4 since no common phrasing for this domain is obviously missing.

5 / 5

Distinctiveness Conflict Risk

The description names a clear niche — tensor-level kernels in veomni/ops with registry/model integration — and its triggers ('add triton kernel', 'new fused op', 'optimize operator') are specific to that niche, so the risk of firing for an unrelated skill is minimal. It is not a 4 because the domain scoping (veomni/ops, registry tests) leaves no meaningful overlap with adjacent skills.

5 / 5

Total

20

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

ByteDance-Seed/VeOmni

Path

.agents/skills/veomni-new-op/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.