Comprehensive guide for setting up and running local LLMs using Harbor. Use when user wants to run LLMs locally, set up or troubleshoot Ollama, Open WebUI, llama.cpp, vLLM, SearXNG, Open Terminal, or similar local AI services. Covers full setup from Docker prerequisites through running models, per-service configuration, VRAM optimization, GPU troubleshooting, web search integration, code execution, profiles, tunnels, and advanced features. Includes decision trees for autonomous agent workflows and step-by-step troubleshooting playbooks.
72
88%
Does it follow best practices?
Run evals on this skill
Adds up to 20 points to the overall score
View guide
Critical
Do not install without reviewing
Security
3 findings: 1 critical severity, 1 high severity, 1 medium severity. Installing this skill is not recommended: please review these findings carefully if you do intend to do so.
Detected a suspicious URL in the skill instructions that could lead the agent to download and execute malicious scripts or binaries. This includes links to executables from untrusted sources, typosquatting of official packages, URL shorteners that obscure the destination, and personal file hosting services.
The list contains a direct curl|bash install script from an untrusted domain (https://av.codes/get-harbor.sh), which is high-risk because fetching and executing remote shell scripts can install malware; the other URLs are local/internal endpoints or official HuggingFace links and are not flagged.
The skill handles credentials insecurely by requiring the agent to include secret values verbatim in its generated output. This exposes credentials in the agent’s context and conversation history, creating a risk of data exfiltration.
The skill includes explicit commands and examples that set or fetch secrets/token values (e.g., "harbor webui secret sk-203948", "harbor hf token <token>", and commands to get API keys), which would require an LLM or agent to accept and echo secret values verbatim into CLI commands or outputs—an exfiltration risk.
The skill prompts the agent to compromise the security or integrity of the user’s machine by modifying system-level services or configurations, such as obtaining elevated privileges, altering startup scripts, or changing system-wide settings.
The skill includes multiple commands that require or instruct use of elevated privileges (e.g., sudo apt-get, sudo usermod, sudo systemctl restart) and enables sensitive host access (docker socket, editing /etc/docker/daemon.json), which modify system state and can compromise the machine.
Low
Low-risk findings.
1 low severity finding. Worth noting, but not necessarily harmful.
The skill fetches instructions or code from an external URL at runtime, and the fetched content directly controls the agent’s prompts or executes code. This dynamic dependency allows the external source to modify the agent’s behavior without any changes to the skill itself.
The skill instructs users to run "curl https://av.codes/get-harbor.sh | bash" (SKILL.md:129), which fetches and immediately executes a remote shell script at runtime, so the URL constitutes a high-risk executable remote dependency.
If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.