Comprehensive guide for setting up and running local LLMs using Harbor. Use when user wants to run LLMs locally, set up or troubleshoot Ollama, Open WebUI, llama.cpp, vLLM, SearXNG, Open Terminal, or similar local AI services. Covers full setup from Docker prerequisites through running models, per-service configuration, VRAM optimization, GPU troubleshooting, web search integration, code execution, profiles, tunnels, and advanced features. Includes decision trees for autonomous agent workflows and step-by-step troubleshooting playbooks.
72
89%
Does it follow best practices?
Run evals on this skill
Adds up to 20 points to the overall score
View guide
Critical
Do not install without reviewing
Security
2 findings: 1 critical severity, 1 medium severity. Installing this skill is not recommended: please review these findings carefully if you do intend to do so.
Detected a suspicious URL in the skill instructions that could lead the agent to download and execute malicious scripts or binaries. This includes links to executables from untrusted sources, typosquatting of official packages, URL shorteners that obscure the destination, and personal file hosting services.
Contains a direct curl | bash installation script hosted on a third-party domain (https://av.codes/get-harbor.sh), which is a high-risk pattern for malware delivery because it downloads and executes code from an external, not-verified source.
The skill prompts the agent to compromise the security or integrity of the user’s machine by modifying system-level services or configurations, such as obtaining elevated privileges, altering startup scripts, or changing system-wide settings.
The skill contains explicit sudo commands that modify system state (sudo usermod -aG docker, sudo systemctl restart docker, sudo apt-get install ...), enables host Docker-socket and host-folder mounts, and even runs a remote install script via curl|bash — all actions that can change or elevate the machine's state and bypass protections.
Low
Low-risk findings.
2 low severity findings. Worth noting, but not necessarily harmful.
The skill exposes the agent to untrusted, user-generated content from public third-party sources, creating a risk of indirect prompt injection. This includes browsing arbitrary URLs, reading social media posts or forum comments, and analyzing content from unknown websites.
The skill’s Open WebUI workflow enables chat with “Web search / Web RAG” via the bundled SearXNG integration (harbor up searxng), which consumes user-authored chat content and can incorporate retrieved third-party text into the LLM’s runtime context, creating an indirect prompt-injection exposure path.
The skill fetches instructions or code from an external URL at runtime, and the fetched content directly controls the agent’s prompts or executes code. This dynamic dependency allows the external source to modify the agent’s behavior without any changes to the skill itself.
The installation step runs a remote shell script with curl https://av.codes/get-harbor.sh | bash, which fetches and executes remote code at runtime and is required for installing the Harbor CLI.
If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.