CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

langsmith-observability

LLM observability platform for tracing, evaluation, and monitoring. Use when debugging LLM applications, evaluating model outputs against datasets, monitoring production systems, or building systematic testing pipelines for AI applications.

60

Quality

75%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./backend/cli/skills/llm-tools/langsmith/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

63%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, highly actionable LangSmith reference: setup-to-advanced flow is logical, code examples are mostly executable, and the two bundle files are real, one-level-deep, and honestly described. The main defect is that the body duplicates large chunks of its own reference files (advanced usage and troubleshooting), inflating token cost without adding new information.

Suggestions

Move the 'Advanced tracing', 'Production monitoring', and 'Testing integration' sections into references/advanced-usage.md, leaving a one-line summary plus link in SKILL.md to cut the body roughly in half.

Replace the 'Common issues' section with inline pointers to the corresponding sections of references/troubleshooting.md, keeping only the credential-verification snippet in the body.

Make code examples fully self-contained by defining or commenting the placeholder dependencies ('vector_store', 'llm', 'authenticate') so snippets are copy-paste runnable.

DimensionReasoningScore

Conciseness

Lead-ins are short and code-heavy (assumes competence), but the ~425-line body inlines advanced material that duplicates the bundle: the 'Common issues' section re-covers troubleshooting.md topics ('Traces not appearing', 'High latency from tracing', 'Large payloads') and 'Advanced tracing'/'Hub prompts' overlap advanced-usage.md. Not 4: the duplication and length go beyond minor trimming; not 2: there is no padding explaining concepts Claude already knows.

3 / 5

Actionability

Nearly every section ships copy-paste-ready code: 'pip install langsmith', '@traceable', 'wrap_openai(OpenAI())', client.list_runs(...), evaluate(...) with a complete evaluator function. Not 5: several snippets depend on undefined placeholders ('vector_store.search(query)', 'llm.invoke(...)', 'authenticate(username, password)', 'do_something()'), so they are patterns rather than fully runnable examples.

4 / 5

Workflow Clarity

The progression is coherent — install/env setup, credential verification ([ -n "$LANGSMITH_API_KEY" ] ...), basic tracing, then advanced uses — and the CI/CD section includes an explicit validation checkpoint (assert results.aggregate_metrics["accuracy"] >= 0.9). Not 5: verification steps appear only in a few places (connection check, CI assert) rather than as consistent checkpoints in the evaluation and dataset workflows; not 3: the sequences present are complete and checkpoints are more than implicit.

4 / 5

Progressive Disclosure

Both referenced files are real, well-organized, and exactly one level deep ('references/advanced-usage.md' — custom evaluators, distributed tracing, hub prompts; 'references/troubleshooting.md' — common issues, debugging, performance), matching their link labels. But content that clearly belongs in those files is inlined in SKILL.md itself — the 'Advanced tracing', 'Production monitoring', 'Testing integration', and 'Common issues' sections duplicate the reference files — which is the anchor-3 pattern of 'content that should be separate is inline'. Not 4: the duplication is substantial rather than a minor organization gap; not 2: structure is good, references are clearly signaled, and one level deep.

3 / 5

Total

14

/

20

Passed

Description

78%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with an explicit, well-formed 'Use when...' trigger clause covering four concrete scenarios. Main weaknesses are the somewhat abstract one-word capability list in the 'what' clause and the omission of the 'LangSmith' product name, which would both sharpen specificity and distinctiveness.

DimensionReasoningScore

Specificity

The description names the domain ('LLM observability platform') and three capability nouns ('tracing, evaluation, and monitoring'), but these are single abstract platform-feature words rather than concrete actions like 'capture inputs, outputs, latency'. Not 4: the 'what' lacks the operational specificity of anchor 4's multi-verb examples; not 2: the domain is named and three capability areas plus concrete scenarios ('evaluating model outputs against datasets') go beyond minimal/generic.

3 / 5

Completeness

Explicitly answers both: what ('LLM observability platform for tracing, evaluation, and monitoring') and when ('Use when debugging LLM applications, evaluating model outputs against datasets, monitoring production systems, or building systematic testing pipelines'). This mirrors the anchor-5 good example structure of a what-clause followed by concrete 'Use when' trigger phrases.

5 / 5

Trigger Term Quality

Good natural keyword coverage: 'debugging LLM applications', 'evaluating model outputs against datasets', 'monitoring production systems', 'testing pipelines' — phrases users would actually say. Not 5: it omits the product name 'LangSmith' itself (only in frontmatter name/tags) and common synonyms like 'unit testing', 'prompt evaluation', or 'observability' trigger phrasing is present but variations are thin.

4 / 5

Distinctiveness Conflict Risk

'LLM observability' is a fairly clear niche and the triggers are LLM-specific, so conflict risk with non-LLM tooling is low. Not 5: the triggers 'evaluating model outputs' and 'testing pipelines' overlap with dedicated evaluation/testing skills, and the absence of 'LangSmith' in the description weakens niche identity against competing observability skills.

4 / 5

Total

16

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

14

/

16

Passed

Repository

synthetic-sciences/openscience

Path

backend/cli/skills/llm-tools/langsmith/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.