CtrlK
BlogDocsLog inGet started
Tessl Logo

agentsociety-create-agent

Use when creating or revising a custom agent type, when an experiment needs an agent class that does not yet exist in the workspace, or when the agent design must be sized against a simulation budget.

53

Quality

60%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./extension/skills/agentsociety-create-agent/v1.0.0/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

63%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is well-structured and highly actionable, with concrete commands, snippets, and a clear staged workflow. Its main weaknesses are duplicated content (validator commands and the subclassing prohibition each appear twice) and a large set of referenced bundle files (stages/, checklists/, subagent-prompts/, artifacts/templates.md) that are missing, which undermines both conciseness and navigation.

Suggestions

Deduplicate: keep the validator commands in one place (the Validation section) and state the direct-inheritance rule once, linking from Common Mistakes instead of restating it

Ship the missing bundle files (stages/*.md, checklists/compatibility.md, subagent-prompts/*.md, artifacts/templates.md) or inline their essential content — the workflow currently dead-ends at nine dangling references

Add an explicit validate-fail → fix → re-validate loop inline (e.g., "If the validator reports errors, fix them and re-run before registering") so error recovery does not depend on the missing stages/validate.md

DimensionReasoningScore

Conciseness

The body is dense and largely avoids teaching known concepts, but it duplicates content: the validator commands appear verbatim in both the Quick Reference table and the Validation section, and the "never subclass an existing agent" prohibition is stated at length in both Base Class and the Common Mistakes table. Not 4 because these are more than minor trims — whole repeated blocks could be deleted; not 2 because there is no padding or explanation of concepts Claude already knows.

3 / 5

Actionability

Guidance is mostly executable: concrete validator commands ($PYTHON_PATH .agentsociety/bin/ags.py create-agent --file ...), a copy-paste extra_skill_paths JSON snippet, a full SKILL.md frontmatter example, named required methods, and a mistakes-to-fixes table. Not 5 because there is no inline agent-class code template — the pointer to artifacts/templates.md is the only source of scaffolding, and that file is absent from the bundle.

4 / 5

Workflow Clarity

The dot-graph pipeline (intake → design → generate → validate → register), stage notes, and the explicit final validator step give a clear sequence with a concrete checkpoint. Not 5 because the error-recovery loop is not explicit in the body — what to do when the validator fails is deferred to stages/validate.md and checklists/compatibility.md, neither of which is present in the bundle.

4 / 5

Progressive Disclosure

Sections are well organized and the five references/*.md citations resolve to real, one-level-deep files. However, roughly nine referenced paths do not exist in the bundle: stages/intake.md, stages/design.md, stages/generate.md, stages/validate.md, checklists/compatibility.md, subagent-prompts/planner.md, subagent-prompts/implementer.md, subagent-prompts/reviewer.md, and artifacts/templates.md. Not 4 because navigation genuinely breaks at those dangling references; not 2 because the structure that exists is good and the present references are clearly signaled.

3 / 5

Total

14

/

20

Passed

Description

56%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description has strong, explicit trigger guidance with three concrete "when" conditions, but it is entirely trigger-focused: it never states what the skill does. Adding a short "what" clause naming the actual operations (implement AgentBase/PersonAgent subclasses under custom/agents/ and validate them) would materially raise specificity and completeness.

Suggestions

Prepend a what-clause with concrete actions, e.g. "Implements and validates custom AgentBase/PersonAgent subclasses under custom/agents/. Use when..."

Include natural trigger synonyms users would actually say, such as "new agent", "subclass AgentBase/PersonAgent", or "agent doesn't exist yet"

Mention the validation step (ags.py create-agent) so the description conveys the skill's end-to-end scope, not just when to invoke it

DimensionReasoningScore

Specificity

The description names the domain ("custom agent type", "agent class") but lists only the generic actions "creating or revising" — no concrete operations such as implementing AgentBase/PersonAgent subclasses, placing files under custom/agents/, or running the validator. It is above a 1 because the domain is named and two actions are given, but below a 3 because there is no second concrete, specific action.

2 / 5

Completeness

The "when" is explicit and detailed ("Use when creating or revising... when an experiment needs an agent class that does not yet exist... sized against a simulation budget"), but the "what" is only weakly implied — the description never states what the skill actually does (write subclasses, validate, register). Not 4 because anchor 4 requires both present with only the "when" being imprecise; here the imbalance is reversed and the "what" is effectively missing.

3 / 5

Trigger Term Quality

"creating", "revising", "custom agent type", "agent class", "experiment", "simulation budget" are natural phrasings a user of this framework would say, giving good keyword coverage. It falls short of 5 because common variations like "new agent", "define an agent", or the base-class names (AgentBase/PersonAgent) are absent.

4 / 5

Distinctiveness Conflict Risk

The niche (custom agent classes for this simulation framework) is distinct and the triggers would not fire for environment-module or discovery tasks. Not 5 because "creating or revising a custom agent type" is broad enough to slightly overlap adjacent skills like experiment-config or scan-modules in edge cases.

4 / 5

Total

13

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository
tsinghua-fib-lab/AgentSociety
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.