Content
82%Weight 40%Scale 1-5Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.
A lean, highly actionable troubleshooting guide with executable commands for every scenario and a clear ordered diagnostic checklist for the invalid-XML failure mode. Its main weaknesses are mild duplication of the frontmatter description in the 'Use This Skill When' section and an implicit rather than explicit verification loop.
| Dimension | Reasoning | Score |
|---|---|---|
Conciseness | The body is dense and assumes Claude's competence (no explanation of what SAML or STS is), with commands like 'unset AWS_ACCESS_KEY_ID AWS_SECRET_ACCESS_KEY AWS_SESSION_TOKEN' given without padding. Not 5: the 'Use This Skill When' section duplicates the frontmatter description almost verbatim, and 'Do not document or commit live access keys' is guidance Claude does not need — minor trimming is possible. Not 3: there is no unnecessary conceptual explanation, only these small redundancies. | 4 / 5 |
Actionability | Fully executable, copy-paste-ready commands cover the common cases: 'aws sts get-caller-identity --profile <profile-from-login-output>', 'which -a aws', the full 'aws rds describe-orderable-db-instance-options' invocation with --query/--output/sort pipeline, and a parameterized saml2aws example. Not 4: the commands are complete and specific enough that placeholders are the only substitution needed, with no missing key details. | 5 / 5 |
Workflow Clarity | The 'Invalid XML' section gives an ordered diagnostic sequence ('Typical causes (check in order)') covering credential source, env vars, multiple binaries, proxies, and SIGTSTP, and running 'aws sts get-caller-identity --profile ...' functions as the verification checkpoint. Not 5: the validation loop is implicit rather than an explicit 'verify identity, then proceed' step, and the RDS section reacts to 'Cannot find version' failures without an explicit retry loop. Not 3: the checkpoint (get-caller-identity) and a check-order sequence are clearly present, so validation is not merely implicit-and-missing. | 4 / 5 |
Progressive Disclosure | No bundle files exist, and the single-file body is well organized into tight, navigable sections (Goal, Use When, post-login, Invalid XML, Region/IaC, saml2aws pinning, What not to do). Not 5: the body is ~79 lines — above the under-50-lines threshold where a single well-organized file earns full marks — and material like the RDS engine-version recipe could live in a reference file. Not 3: nothing is buried or inlined that clearly belongs elsewhere; structure is clean. | 4 / 5 |
Total | 17 / 20 Passed |