Python bindings for the llama.cpp library providing high-performance LLM inference with OpenAI-compatible APIs.
—
Loading evals
Install with Tessl CLI
npx tessl i tessl/pypi-llama-cpp-python