CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

mmm-modeling

Media Mix Modeling with PyMC-Marketing. Use when building MMMs, specifying adstock/saturation transformations, setting priors, fitting multidimensional (geo-level) models, computing channel contributions, ROAS, running budget optimization, calibrating with lift tests, or performing sensitivity analysis. Covers the MMM class, GeometricAdstock, LogisticSaturation, BudgetOptimizerWrapper, and ArviZ diagnostics for marketing models.

Quality

91%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A strong, dense body: executable Quick Start, per-topic code snippets, explicit diagnostic thresholds, and excellent one-level-deep reference structure covering a large API surface without inlining it. The main weaknesses are trimmable meta-justification prose, placeholder-laden snippets in a few sections, and a CV-placement inconsistency between the Inference section and the workflow diagram.

Suggestions

Trim the two opening meta paragraphs ('LLMs understand Bayesian inference…', 'Without it, an LLM might…') and redistribute their domain pitfalls as one-line warnings inside the relevant sections (e.g., 'never hold out test data for the final fit' under Data Preparation, 'flat priors on saturation parameters cause divergences' under Model Specification).

Replace elision placeholders in the CV and diagnostics snippets ('sampler_config={...}', 'var_names=[...]', 'dims={...}') with concrete minimal values so they are copy-paste executable like the Quick Start.

Reconcile the time-slice CV placement: the Inference section says to run TimeSliceCrossValidator 'before the final fit', but the Typical MMM Workflow diagram places it after the media deep dive — pick one position and make both consistent.

DimensionReasoningScore

Conciseness

The body is overwhelmingly code-first and dense, but the two opening prose paragraphs ('LLMs understand Bayesian inference, MCMC, and hierarchical models in general…', 'This skill encodes those patterns. Without it, an LLM might…') spend ~150 words on meta-justification rather than instruction, though they do carry non-obvious domain pitfalls. This is 'efficient with minor instances of over-explanation that could be trimmed' — the 4 anchor — rather than the every-token-earns-its-place 5.

4 / 5

Actionability

The Quick Start is fully copy-paste executable and covers the common case, and most sections show real API calls. However, several snippets rely on elision placeholders ('sampler_config={...}', 'var_names=[...]', 'dims={...}') and undefined contextual variables ('budget_bounds_xr', 'df_lift_test', 'spend_shares', 'channel_scaled'), which are minor gaps — the 4 anchor, not the fully-executable 5.

4 / 5

Workflow Clarity

The 'Typical MMM Workflow' gives a clearly ordered sequence with explicit validation gates (Prior Predictive Checks, 'Divergences (must be 0)', 'R-hat (must be < 1.01)', Posterior Predictive Checks). It falls short of 5 because error-recovery loops are deferred to references/model_fit.md rather than stated inline, and there is a sequencing inconsistency: the Inference section says to run TimeSliceCrossValidator 'before the final fit' while the workflow diagram places '[Optional] Time-Slice Cross-Validation' after the fit and media deep dive. It is above 3 because all major checkpoints are present with numeric pass thresholds.

4 / 5

Progressive Disclosure

Every section pairs a short inline essential with a well-signaled one-level-deep pointer ('See [references/model_specification.md] for full constructor reference…'), all 9 referenced files exist in the bundle, the deep link references/media_deep_dive.md#incremental-analysis-mmmincrementality resolves to a real heading, and bulk API detail (plot signatures, summary tables) correctly lives in reference files with only compact index lists inline. This matches the clear-overview, well-signaled-references anchor.

5 / 5

Total

17

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exemplary description: dense with concrete actions and named APIs, an explicit 'Use when' trigger clause covering every major use case, natural domain vocabulary with synonyms, and a distinct niche with minimal overlap risk. It says exactly what the skill does and when to reach for it without padding.

DimensionReasoningScore

Specificity

The description lists multiple concrete actions — 'building MMMs, specifying adstock/saturation transformations, setting priors, fitting multidimensional (geo-level) models, computing channel contributions, ROAS, running budget optimization, calibrating with lift tests, or performing sensitivity analysis' — which comprehensively mirror the skill's sections, and it names the key classes (MMM, GeometricAdstock, LogisticSaturation, BudgetOptimizerWrapper). This matches the comprehensive anchor; it is not 4 because no meaningful capability from the body is missing.

5 / 5

Completeness

It explicitly answers 'what' (Bayesian MMM with PyMC-Marketing covering the MMM class and named components) and 'when' via a concrete 'Use when building MMMs, … calibrating with lift tests, or performing sensitivity analysis' clause. Both halves are explicit with concrete trigger phrases, matching the top anchor.

5 / 5

Trigger Term Quality

It uses the natural vocabulary a marketing analyst would actually say — 'Media Mix Modeling', 'MMMs', 'adstock', 'saturation', 'priors', 'ROAS', 'budget optimization', 'lift tests', 'sensitivity analysis' — including the abbreviation synonym (Media Mix Modeling/MMMs). Coverage is comprehensive for the domain; it is not 4 because no commonly used natural term for this task is absent.

5 / 5

Distinctiveness Conflict Risk

It occupies a clear niche (PyMC-Marketing media mix modeling) with distinctive triggers like adstock/saturation, lift test calibration, and ROAS. Phrases like 'setting priors' and 'ArviZ diagnostics' are slightly generic but framed entirely inside MMM activities, so conflict risk with a general Bayesian modeling skill is minimal.

5 / 5

Total

20

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

pymc-labs/pymc-marketing

Path

skills/mmm-modeling/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.