Content
71%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
This is a highly actionable, well-structured diagnostic guide: concrete commands, copy-paste code, and a clear triage-to-symptom workflow with per-symptom verification steps. Its weaknesses are efficiency (duplicated latency guidance, overlong code examples) and progressive disclosure — a very large body that inlines several topics that should live in reference files like the existing doctor.md.
Suggestions
Deduplicate the CloudWatch ingestion-latency guidance: state the ~10s/~15s wait once (either Step 3 or the 'No traces appearing' section) and cross-reference it from the other, and drop the meta-commentary about what older docs said.
Move self-contained deep-dive topics into reference files (e.g., references/streaming.md for the keepalive pattern and client filtering, references/iam-logging.md for the IaC IAM policy JSON) and keep one-line pointers in SKILL.md, mirroring how doctor.md is already handled.
Trim the emit_keepalive example to the minimal pattern (~10 lines) and fix the repeated "1." list numbering in the 'Memory not working' section so the rendered sequence is correct.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | Mostly efficient and dense with platform-specific facts Claude wouldn't know (maxVms quota semantics, port auto-increment, OTEL wrapping), but there is tightening to do: the ~10s CloudWatch latency guidance appears twice (the "Important" paragraph in Step 3 and the "Symptom: No traces appearing" section), the Step 3 paragraph spends tokens on stale-docs meta-commentary ("Older skills and docs said 30–60s ... both are stale"), and the ~30-line keepalive example plus client-side filter snippet run long. This fits 'mostly efficient but includes some unnecessary explanation or could be tightened' rather than the minor-trim 4 anchor. | 3 / 5 |
Actionability | Fully executable throughout: exact CLI commands ("agentcore traces list --runtime <AgentName> --since 1h", "aws logs tail /aws/lambda/<function-name>"), copy-paste code (stop_runtime_session call, emit_keepalive streaming pattern, IAM policy JSON), and concrete ordered fixes for each symptom. Specific examples cover the common cases, matching the top anchor. | 5 / 5 |
Workflow Clarity | The intake workflow is clearly sequenced (Step 0 problem-type triage → verify CLI version → classify symptom → read traces/logs → symptom-specific diagnosis), and each symptom section follows a check-then-fix order with verification commands (e.g., "If still no traces after ~30 seconds: 1. Verify observability... 2. Check the agent was actually invoked... 3. Check CloudWatch permissions"). It falls short of the 5 anchor because a few fixes lack an explicit post-fix verification step (e.g., the port-kill fix `lsof -tiTCP:8080 ... | xargs kill` and the IAM redeploy) and the Memory section has broken list numbering (repeated "1." items). | 4 / 5 |
Progressive Disclosure | Section structure is good and the one bundle reference ([references/doctor.md]) is real, well-signaled, and one level deep, but the body is a ~700-line monolith while the bundle contains only that single file — deep-dive material that clearly belongs in separate reference files is inlined (the streaming keepalive pattern with full Python code, the IAM policy JSON for IaC deploys, the cross-region inference profile table, and the LangGraph/X-Ray specifics). This matches 'some structure but could be better organized; content that should be separate is inline' rather than the 4 anchor, where most content would be appropriately placed across the bundle. | 3 / 5 |
Total | 15 / 20 Passed |