Use when applies to any public website. Use when auditing technical SEO foundations or diagnosing crawl coverage gaps.
53
60%
Does it follow best practices?
Run evals on this skill
Adds up to 20 points to the overall score
View guide
Low
Low-risk findings worth noting
Fix and improve this skill with Tessl
tessl review fix ./skills/robots-txt/SKILL.mdLow
Low-risk findings.
1 low severity finding. Worth noting, but not necessarily harmful.
The skill exposes the agent to untrusted, user-generated content from public third-party sources, creating a risk of indirect prompt injection. This includes browsing arbitrary URLs, reading social media posts or forum comments, and analyzing content from unknown websites.
The required workflow described in SKILL.md instructs the agent to “Fetch `/robots.txt` on the live domain” at runtime; that fetch is a runtime retrieval of outsider-authored public site text (the site’s robots.txt) which the agent would read into its LLM context for validation.
48405aa
If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.