网页内容获取工具 | 当常规爬虫被过滤时,使用替代服务获取网页内容。支持:1) r.jina.ai - 最稳定 2) markdown.new - Cloudflare 专用 3) defuddle.md - 备用方案。触发词:获取网页内容、网页转markdown、内容抓取、fetch webpage、bypass cloudflare
69%
Does it follow best practices?
Run evals on this skill
Adds up to 20 points to the overall score
Low
Low-risk findings worth noting
Fix and improve this skill with Tessl
tessl review fix ./configs/microservice/bff-service/configs/agent-skills/clawhub/web-content-fetcher/SKILL.md当常规 web_fetch/web_search 无法获取内容时,使用替代服务获取网页 Markdown 格式内容。
| 优先级 | 服务 | 用法 | 适用场景 |
|---|---|---|---|
| 1 | r.jina.ai | https://r.jina.ai/{url} | 最稳定,通用性强 |
| 2 | markdown.new | https://markdown.new/{url} | Cloudflare 保护网站 |
| 3 | defuddle.md | https://defuddle.md/{url} | 备用方案 |
当需要获取网页内容时,按顺序尝试:
web_fetch 尝试获取# 使用 jina.ai (首选)
curl -s "https://r.jina.ai/https://example.com"
# 使用 markdown.new (Cloudflare)
curl -s "https://markdown.new/https://example.com"
# 使用 defuddle.md (备用)
curl -s "https://defuddle.md/https://example.com"# 简单获取
fetch_webpage <url>
# 指定方法
fetch_webpage <url> --method jina|markdown|defuddle用户: 帮我获取 https://news.example.com/article/123 的内容
助手: (使用 r.jina.ai 获取)本目录包含 fetch.sh 脚本,可直接调用:
./fetch.sh https://example.com
./fetch.sh https://example.com jina让网页内容获取不再受限 🌐
UnicomAI/wanwu
3e706cb
If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.