CtrlK
CommunityDocumentationLog inGet started
Tessl Logo

tessl/pypi-vllm

tessl install tessl/pypi-vllm@0.10.0

A high-throughput and memory-efficient inference and serving engine for LLMs

Agent Success

Agent success rate when using this tile

69%

Improvement

Agent success rate improvement when using this tile compared to baseline

1.33x

Baseline

Agent success rate without this tile

52%

Assessment results

Generated

Agent Claude Code

Scenario 1

Synchronous and Asynchronous Engines

0%

Scenario 2

Text Generation and Completion

89%

Scenario 3

Basic Memory Management

-23%

Scenario 4

Model Loading and Initialization

-2%

Scenario 5

Beam Search and Advanced Sampling

0%

Scenario 6

Sampling Parameters

78%

Scenario 7

LoRA Adapters and Multi-LoRA Support

-97%

Scenario 8

Chat-based Generation

47%

Scenario 9

Multi-Modal Support

78%

Scenario 10

Custom Attention Mechanisms

0%

Version

Workspace
tessl
Visibility
Public
Created
Last updated
Describes
pypipkg:pypi/vllm@0.10.x
tile.json