CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/pypi-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Overall
score

69%

Evaluation69%

1.33x

Agent success when using this tile

Overview
Eval results
Files

tile.json

{
  "name": "tessl/pypi-vllm",
  "version": "0.10.0",
  "docs": "docs/index.md",
  "describes": "pkg:pypi/vllm@0.10.2",
  "summary": "A high-throughput and memory-efficient inference and serving engine for LLMs"
}

Install with Tessl CLI

npx tessl i tessl/pypi-vllm

tile.json