ov-gguf-debug-accuracy
Debug wrong or degraded output from a GGUF model running through the OpenVINO GGUF frontend or the ggml-openvino backend. Use when a GGUF model converts but produces garbage, repeated or drifting tokens, a cosine-similarity cliff between layers, output that diverges from llama.cpp CPU, or a broadcast/shape crash that appears only at decode or only for one architecture. Do NOT use for ops that fail to convert at all ("Translation for operation type ... is not implemented"), or for build and CMake failures.
68
86%
Does it follow best practices?
Run evals on this skill
Adds up to 20 points to the overall score
Passed
No findings from the security scan
- Read src/frontends/gguf/docs/debugging_accuracy.md — the coarse-to-fine bisection strategy, the ggml-CPU oracle technique, the catalogue of bug archetypes with their generalizable lessons, the debug env vars, and the checklist.
- Apply its one governing rule before anything else: every accuracy claim is a comparison against the real llama.cpp CPU implementation, never a hand-derived reference. If you are about to write out an op's math to form an expectation, generate it from ggml instead.
- Work the bisection steps in order and do not open a debugger until they have cornered the bug. Check the bug archetypes first when a cosine cliff or dynamic-shape crash points near one.
- After any fix to a shared path — especially a VIEW or
op_casepredicate — re-run the other supported architectures and confirm their classification and output are unchanged.
- Repository
- openvinotoolkit/openvino
- Commit
f766feb
- Last updated
- First committed
Is this your skill?
If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.