CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

reviewing-reidentification-risk

Run expert-determination-style quasi-identifier risk scoring (k-anonymity, l-diversity) plus OpenMed's empirical re-identification attack on a de-identified dataset, then document residual risk in a defensible memo. Use when the user needs HIPAA Expert Determination (45 CFR 164.514(b)(1)) support, asks whether a dataset is safe to release, worries about singling-out via age/ZIP/dates, or wants a statistical "very small risk" determination. Covers identifying quasi-identifiers, computing k-anonymity / l-diversity, running openmed.eval.attacks.reid (run_reid_attack / run_reid_benchmark) as the adversarial attack, and writing the risk memo. Pairs after deidentifying-clinical-text and auditing-deid-leakage.

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is a well-structured, highly actionable guide: executable quick-start code, a gated workflow with a re-score feedback loop, and sharp edge-case guidance (date-shift inversion, auxiliary-data assumptions). It is only marginally held back by a brief conceptual explanation of l-diversity and the absence of a memo-template reference file.

Suggestions

Trim the conceptual explanation in workflow step 3 to just the operational rule (require ≥ l distinct sensitive values per class; flag homogeneous classes).

Move the step-6 memo structure into a one-level-deep reference file (e.g. references/memo-template.md) so the memo format is concrete without bloating SKILL.md.

DimensionReasoningScore

Conciseness

The body is largely efficient — a compact intro, runnable quick start, terse workflow steps, and high-value gotchas — with minor over-explanation a competent model mostly knows, e.g. "k-anonymity hides *which* record, but if every record in a class shares the same sensitive value ... the attribute leaks anyway" (workflow step 3). That matches the 4 anchor: efficient with a little trimming possible.

4 / 5

Actionability

The quick start is copy-paste executable with realistic fixtures, printed metric keys, and a second runnable call (run_reid_benchmark with suite/output args); workflow steps name exact functions, thresholds (k ≥ 5 or k ≥ 11), and concrete generalization moves (ZIP5 → ZIP3). This matches the 5 anchor of fully executable guidance covering the common cases.

5 / 5

Workflow Clarity

The 6-step workflow is clearly sequenced with a precondition gate ("only score QI risk once direct-identifier leakage is zero") and an explicit validation feedback loop in step 5 ("Generalize or suppress, then re-score ... re-run until k_min and linkage rate meet your documented threshold"). The mapping between step 1 and step 6 (documented threshold → memo contents) closes the loop, matching the 5 anchor.

5 / 5

Progressive Disclosure

No bundle files exist, so the skill is a single well-sectioned overview with no buried or nested references — everything sits at the right altitude except that a few pieces arguably belong in one-level-deep references, e.g. a memo template for step 6 or the "Standards & references" list as a reference file. Good structure with minor organization gaps matches the 4 anchor.

4 / 5

Total

18

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it names concrete capabilities including specific API entry points, gives an explicit multi-clause "Use when..." trigger set anchored to a real regulatory hook (45 CFR 164.514(b)(1)), and stays in third-person voice. The only gaps are a few natural trigger synonyms and mild overlap risk with its paired de-identification skills.

Suggestions

Add natural synonyms like "anonymization"/"anonymized" or "re-identification risk assessment" to trigger_term_quality coverage.

Sharpen the boundary against paired skills, e.g. "Use for statistical risk scoring after leakage auditing is clean — not for finding direct-identifier leaks."

DimensionReasoningScore

Specificity

The description lists multiple concrete actions — "quasi-identifier risk scoring (k-anonymity, l-diversity)", "empirical re-identification attack", "document residual risk in a defensible memo" — down to named functions (run_reid_attack / run_reid_benchmark). Coverage of the skill's scope is comprehensive, matching the 5 anchor.

5 / 5

Completeness

Both what and when are explicit: the "what" is concrete (risk scoring + attack + memo) and the "when" opens with "Use when the user needs HIPAA Expert Determination (45 CFR 164.514(b)(1)) support, asks whether a dataset is safe to release, ..." with several concrete trigger phrases. This matches the 5 anchor exactly.

5 / 5

Trigger Term Quality

Natural phrases a user would say are well covered: "HIPAA Expert Determination", "whether a dataset is safe to release", "singling-out via age/ZIP/dates", "very small risk". A few natural synonyms are missing (e.g. "anonymization"/"anonymized", "re-identification risk assessment"), which fits the 4 anchor rather than the comprehensive 5 anchor.

4 / 5

Distinctiveness Conflict Risk

A clear niche (re-identification risk / Expert Determination) with distinct triggers, but it sits alongside closely related skills it explicitly pairs with (auditing-deid-leakage, deidentifying-clinical-text), and a trigger like "is this dataset safe to release" could plausibly fire for those too — mostly distinct with minor overlap, matching the 4 anchor.

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

maziyarpanahi/openmed

Path

skills/reviewing-reidentification-risk/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.