honeybadge/harbor
Framework for AI agent evaluation in containerized environments. Use when: (1) Running agent evaluations with `harbor run` against benchmarks (SWE-Bench, Terminal-Bench, Aider Polyglot, etc.), (2) Creating custom benchmark tasks with Dockerfile, instruction.md, solution, and tests, (3) Building adapters to convert existing benchmarks to Harbor format, (4) Implementing custom agents extending BaseAgent or BaseInstalledAgent, (5) Scaling evaluations to cloud providers (Daytona, Modal, E2B), (6) Exporting traces for RL/SFT training, (7) Debugging Harbor runs or inspecting package internals.
79
99%
Does it follow best practices?
Run evals on this skill
Adds up to 20 points to the overall score
View guide
Low
Low-risk findings worth noting
Low
Low-risk findings.
1 low severity finding. Worth noting, but not necessarily harmful.
W011: Third-party content exposure detected (indirect prompt injection risk)
What this means
The skill exposes the agent to untrusted, user-generated content from public third-party sources, creating a risk of indirect prompt injection. This includes browsing arbitrary URLs, reading social media posts or forum comments, and analyzing content from unknown websites.
Why it was flagged
Third-party content exposure detected (high risk: 0.90). The skill's core workflow loads external benchmark datasets and task instructions from a registry or user-provided sources (see references/commands.md for "harbor run -d <dataset@version>" and the --registry-url/harbor datasets list), adapters explicitly accept --source-url and load benchmark data from external repos (references/adapters.md), and tasks include instruction.md (references/tasks.md) which the agent reads and acts on—so untrusted, user-generated third‑party content can be ingested and materially influence agent actions.
Where we found it
harborframework.com
domain · 3 sites
harborframework.com appears only in SKILL.md's Resources section as documentation links; the runtime fetch of this domain as the default registry is plausible but inferred, not explicitly shown in code or instructions.
SKILL.md
104
- [harborframework.com](https://harborframework.com/)
SKILL.md
105
- [Documentation](https://harborframework.com/docs)
SKILL.md
106
- [Registry](https://harborframework.com/registry)
github.com/laude-institute/harbor-datasets
domain · 1 site
This GitHub repository URL appears only as a human-facing documentation instruction for uploading datasets, not as a source the plugin fetches content from at runtime.
references/adapters.md
150
Upload dataset to [harbor-datasets](https://github.com/laude-institute/harbor-datasets)
instruction.md (benchmark task instructions)
content-type · 5 sites
instruction.md files from external benchmark datasets are read by agents as their primary task instructions; the content directly controls agent actions and can contain adversarial prompts. Removed the tangential agents-usage.md:114 location which was merely a method parameter name, not about instruction.md files.
references/tasks.md
8
instruction.md
51
instruction.md
references/adapters.md
23
instruction.md
81
instruction.md
SKILL.md
16
instruction.md
- Audited
- Security analysis