CtrlK
BlogDocsLog inGet started
Tessl Logo

create-runtime-setting

Create a new RuntimeSetting that can be changed at runtime via `agent config set/get` and the config API

57

Quality

67%

Does it follow best practices?

Impact

No eval scenarios have been run

SecuritybySnyk

Passed

No known issues

Optimize this skill with Tessl

npx tessl skill review --optimize ./.claude/skills/create-runtime-setting/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

77%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

This is a well-crafted skill that provides clear, actionable guidance for creating RuntimeSettings in the Datadog Agent codebase. Its greatest strengths are the concrete file paths, naming conventions, and the smart approach of reading existing reference implementations before writing code. Minor weaknesses include some redundancy in describing the API/CLI exposure and the lack of supporting bundle files for what is a moderately complex multi-step process.

Suggestions

Remove the repeated description of CLI/API exposure (appears in intro, Step 1 context, and Important Notes) — mention it once in the intro.

Consider extracting the service registration paths (Step 1.7 / Step 5) into a reference file, as these paths may change and centralizing them would improve maintainability.

DimensionReasoningScore

Conciseness

The skill is reasonably efficient but includes some redundancy — the API/CLI exposure information is repeated in the intro, Step 1, and Important Notes. Some details like listing all 7 service registration sites with full paths could be slightly tightened, but most content earns its place given the complexity of the task.

2 / 3

Actionability

The skill provides highly concrete guidance: specific file paths, exact naming conventions, precise method signatures, specific bash commands for testing, and clear instructions to read reference files before writing code. The guidance is specific enough to be directly executable.

3 / 3

Workflow Clarity

The 6-step workflow is clearly sequenced with logical dependencies (gather info → read references → implement → test → register → verify). Step 6 includes explicit validation with test execution and linting, plus a feedback loop to fix issues if they fail.

3 / 3

Progressive Disclosure

The content is well-structured with clear sections and headers, but it's a single monolithic file with no references to supporting documents. Given the complexity (7 registration sites, multiple value types, multiple file locations), some content like the full service registration paths or type-specific implementation patterns could be split into reference files.

2 / 3

Total

10

/

12

Passed

Description

57%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is reasonably specific about what it does (creating a RuntimeSetting) and references concrete mechanisms (agent config set/get, config API), giving it a clear niche. However, it lacks an explicit 'Use when...' clause and could benefit from additional trigger terms and common user phrasings to improve discoverability.

Suggestions

Add an explicit 'Use when...' clause, e.g., 'Use when the user wants to add a new runtime configuration option, setting, or parameter that can be changed via agent config set/get.'

Include additional natural trigger terms such as 'configuration', 'add setting', 'runtime config', 'new config option' to improve matching against user requests.

DimensionReasoningScore

Specificity

Names a specific domain (RuntimeSetting) and a concrete action (create), and mentions the mechanism ('agent config set/get' and config API), but only describes one action rather than listing multiple concrete capabilities.

2 / 3

Completeness

Clearly answers 'what' (create a new RuntimeSetting changeable at runtime), but lacks an explicit 'Use when...' clause or equivalent trigger guidance, so the 'when' is only implied.

2 / 3

Trigger Term Quality

Includes relevant keywords like 'RuntimeSetting', 'agent config set/get', 'config API', and 'runtime', which are somewhat natural for developers in this domain, but misses common variations a user might say such as 'configuration', 'settings', 'add setting', or 'runtime configuration'.

2 / 3

Distinctiveness Conflict Risk

The description targets a very specific niche—creating RuntimeSettings with 'agent config set/get' and the config API—which is unlikely to conflict with other skills due to its precise technical scope.

3 / 3

Total

9

/

12

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation9 / 11 Passed

Validation for skill structure

CriteriaDescriptionResult

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

9

/

11

Passed

Repository
DataDog/datadog-agent
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.