CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

bedrock-agentcore-evaluations

Amazon Bedrock AgentCore Evaluations for testing and monitoring AI agent quality. 13 built-in evaluators plus custom LLM-as-Judge patterns. Use when testing agents, monitoring production quality, setting up alerts, or validating agent behavior.

Quality

77%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./.claude/skills/bedrock-agentcore-evaluations/SKILL.md

The canonical home for this skill is bedrock-agentcore-evaluations in fernandezbaptiste/Skrillz

SKILL.md
Quality
Evals
Security

Quality

Content

63%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body delivers highly actionable, well-sequenced operational guidance, but it functions as a monolith: the three referenced files are listed yet missing, and their content is inlined, inflating token cost. Tightening the overview and either shipping or removing the broken references would lift conciseness and structure together.

Suggestions

Create the actual reference files (references/evaluator-reference.md, references/test-scenarios.md, references/alerting-patterns.md) or delete the References section — as written, all three cited paths are broken.

Move the inlined CloudWatch alarm patterns (Operation 4), adversarial/domain test suites, and the full evaluator API examples into the referenced files, keeping SKILL.md as a lean overview per operation.

Trim the Overview 'Key Principles (validated by AWS December 2025)' block and consolidate Operation 1's duplicated single-evaluator and loop examples; define or inline the 'run_evaluation()' helper used in the baselines example.

DimensionReasoningScore

Conciseness

The body is mostly efficient code without much explanation of known concepts, but contains clear tightening opportunities: the Overview's 'Key Principles (validated by AWS December 2025)' section duplicates thresholds already encoded in code, and the three full custom-evaluator examples (brand tone, technical accuracy, compliance) plus the duplicate single-vs-loop evaluator creation in Operation 1 pad the file. The time-sensitive 'December 2025' date also sits outside any old-patterns section.

3 / 5

Actionability

Nearly all guidance is concrete, executable boto3 code (create_evaluator calls with real parameter shapes, CloudWatch alarms, dashboard JSON). Minor gaps: the baselines example calls an undefined 'run_evaluation()' helper, and variables like 'agent_arn' and 'helpfulness_evaluator_id' are used without prior definition, keeping it just below copy-paste-ready anchor 5.

4 / 5

Workflow Clarity

The five operations are clearly sequenced (create evaluators → custom evaluators → on-demand evaluation → continuous monitoring → dashboard) with per-operation purpose, time, and automation estimates, and the on-demand flow includes pass/fail reporting. However, the batch evaluation flow lacks an explicit verify-before-deploy checkpoint and the adversarial section asserts without a recovery loop, leaving minor validation gaps versus anchor 5.

4 / 5

Progressive Disclosure

The References section cleanly signals three files ('references/evaluator-reference.md', 'references/test-scenarios.md', 'references/alerting-patterns.md'), but none of these files exist in the bundle, and the content they would hold (alarm patterns, test scenario templates, full evaluator API details) is instead inlined in the ~670-line SKILL.md. This matches anchor 3: content that should be separate is inline and the reference structure is not actually functional.

3 / 5

Total

14

/

20

Passed

Description

83%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that explicitly states both what the skill does and when to use it, with a concrete capability count and named product. Trigger coverage is good but could add synonyms like 'agent evaluation' to further reduce overlap with generic agent-testing requests.

DimensionReasoningScore

Specificity

Names the concrete offering ('13 built-in evaluators plus custom LLM-as-Judge patterns') and two core actions (testing and monitoring AI agent quality). It lists several specific capabilities but omits coverage of a few functions shown in the body (dashboards, A/B testing), matching the 'several specific actions; minor gaps' anchor rather than the fully comprehensive anchor 5.

4 / 5

Completeness

Explicitly answers what ('Amazon Bedrock AgentCore Evaluations for testing and monitoring AI agent quality. 13 built-in evaluators plus custom LLM-as-Judge patterns') and when ('Use when testing agents, monitoring production quality, setting up alerts, or validating agent behavior') with concrete trigger phrases, exactly matching the anchor-5 example pattern.

5 / 5

Trigger Term Quality

The 'Use when' clause provides natural phrases users would say: 'testing agents', 'monitoring production quality', 'setting up alerts', 'validating agent behavior'. Coverage is good but misses common variations like 'evaluating an agent' or 'agent evaluation metrics', fitting anchor 4 (a few natural terms missing) rather than anchor 5's comprehensive synonym coverage.

4 / 5

Distinctiveness Conflict Risk

The 'AgentCore Evaluations' niche is clearly distinct from the sibling skills it must not trigger for (policy enforcement, deployment). However, generic triggers like 'testing agents' and 'validating agent behavior' could fire for non-Bedrock agent testing contexts, giving minor overlap risk — anchor 4 rather than anchor 5's minimal conflict risk.

4 / 5

Total

17

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

skill_md_line_count

SKILL.md is long (678 lines); consider splitting into references/ and linking

Warning

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

referenced_paths_exist

Referenced path issues: 3 missing

Warning

Total

13

/

16

Passed

Repository

fernandezbaptiste/Skrillz

Path

.claude/skills/bedrock-agentcore-evaluations/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.