CtrlK
BlogDocsLog inGet started
Tessl Logo

guardrails-config

Configure TrustyAI Guardrails Orchestrator for LLM input/output content safety on OpenShift AI. Use when: - "Add guardrails to my LLM endpoint" - "Set up content safety for my model" - "Configure PII detection on my inference endpoint" - "Block prompt injection attacks" - "I need a guarded endpoint for my deployed model" Handles GuardrailsOrchestrator CR deployment, detector configuration (content safety, PII, prompt injection, toxicity), orchestration policies, and guarded endpoint validation. NOT for deploying models (use /model-deploy first). NOT for bias/drift monitoring (use /model-monitor). NOT for infrastructure observability (use /ai-observability).

69

Quality

85%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

77%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A strong, highly actionable operational skill with an excellent validated workflow and concrete tool-level guidance throughout. The main weaknesses are mild redundancy across sections and a progressive-disclosure failure where most referenced bundle files are pointer stubs to unresolved external paths.

Suggestions

Inline the actual content (or at minimum working in-bundle copies) of the five pointer-stub reference files (skill-conventions.md, common-issues.md, openshift-fallback-templates.md, live-doc-lookup.md, known-model-profiles.md) so references resolve one level deep within the bundle.

Add a concrete example in Step 3b (sample PII regex patterns with scope/action) and in Step 7 (exact safe and unsafe request payloads for the guarded endpoint) to close the remaining actionability gaps.

Deduplicate by dropping the per-step restatement of tool provenance and consolidating the repeated HITL checkpoints into the single Critical section, which would cut noticeable token overhead.

DimensionReasoningScore

Conciseness

The body is dense operational guidance (exact MCP tool parameters, fallbacks, error handling) with no explanation of concepts Claude already knows, but it repeats content: the Prerequisites tool list is restated per-step, 'WAIT for user decision' appears ~10 times inline and again in the Critical HITL section, and each rhoai tool gets a repeated 'If rhoai unavailable or returns error' fallback clause.

4 / 5

Actionability

Mostly executable guidance — concrete tool names with REQUIRED/OPTIONAL parameter lists, exact apiVersion/kind for fallbacks, a copy-paste curl test and port-forward command. Minor gaps remain: Step 3b says only 'Generate appropriate regex patterns' for PII detection with no example pattern, and Step 7's safe/unsafe guarded-endpoint tests lack concrete request payloads (unlike the original-endpoint curl example).

4 / 5

Workflow Clarity

Eight clearly sequenced steps each with explicit validation (CRD existence check, InferenceService Ready check, pod polling every 15s for 5 minutes, safe-plus-unsafe endpoint verification), per-step error handling with feedback loops (logs/events diagnosis options, /debug-inference escalation), and explicit user-decision checkpoints. Destructive operations are explicitly guarded ('NEVER auto-delete GuardrailsOrchestrator').

5 / 5

Progressive Disclosure

SKILL.md itself is well-structured with clearly signaled link-style references, and the primary reference (guardrails-detectors-reference.md, 94 lines of real CRD/model/config content) is genuinely one level deep. However, 5 of the 6 bundle reference files (skill-conventions.md, common-issues.md, openshift-fallback-templates.md, live-doc-lookup.md, known-model-profiles.md) contain only a relative path pointing outside the bundle that does not resolve, so following those references yields dead-end indirection rather than content.

3 / 5

Total

16

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An excellent description: it explicitly states what the skill does and when to use it with natural, quotable trigger phrases, names concrete capabilities, and actively disambiguates against sibling skills. The only improvement space is broader synonym coverage in the trigger list.

DimensionReasoningScore

Specificity

It lists multiple specific concrete actions with comprehensive coverage: 'Configure TrustyAI Guardrails Orchestrator', 'GuardrailsOrchestrator CR deployment, detector configuration (content safety, PII, prompt injection, toxicity), orchestration policies, and guarded endpoint validation'. This matches the top anchor and exceeds the level-4 anchor, which expects only minor coverage gaps.

5 / 5

Completeness

Both questions are answered explicitly: what it does ('Handles GuardrailsOrchestrator CR deployment, detector configuration..., orchestration policies, and guarded endpoint validation') and when, via a literal 'Use when:' clause with five quoted user phrasings. This mirrors the level-5 exemplar; level 4 would require the 'when' to be less explicit.

5 / 5

Trigger Term Quality

Good natural trigger coverage: 'Add guardrails to my LLM endpoint', 'Set up content safety for my model', 'Configure PII detection', 'Block prompt injection attacks'. Not level 5 because common synonyms users might say — 'content moderation', 'safety filter', 'toxicity filter' — are absent, leaving a few natural terms missing.

4 / 5

Distinctiveness Conflict Risk

A clear niche (guardrails/content safety on LLM endpoints in OpenShift AI) with distinct triggers, reinforced by three explicit exclusions ('NOT for deploying models', 'NOT for bias/drift monitoring', 'NOT for infrastructure observability') that route near-miss requests to sibling skills. Minimal conflict risk.

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository
RHEcosystemAppEng/agentic-plugins
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.