vllm-project/vllm-skills

6 resources in this repository

🎯6Skills

🎯Skills6

A collection of modular, reusable agent skills for deploying and benchmarking vLLM, including Docker deployment, Kubernetes deployment, simple deployment, and various performance benchmarking skills. Each skill is a self-contained directory following the Anthropic SKILL.md specification, installable as a Claude Code plugin marketplace.

vllm-deploy-docker

🎯vllm-deploy-simple🎯Skill

A skill for quickly installing and deploying vLLM, starting a serving instance with a simple LLM model, and testing the OpenAI-compatible API endpoint.

vllm-deploy-simple

🎯vllm-bench-serve🎯Skill

A collection of modular skills for deploying and benchmarking vLLM, covering Docker deployment, Kubernetes deployment, simple local serving, prefix cache benchmarking, and OpenAI-compatible API endpoints.

vllm-bench-serve

🎯vllm-prefix-cache-bench🎯Skill

Benchmarks vLLM's automatic prefix caching performance, measuring throughput and latency improvements from shared prompt prefixes in LLM serving scenarios using the OpenAI-compatible API.

vllm-prefix-cache-bench

🎯vllm-bench-random-synthetic🎯Skill

Runs vLLM performance benchmarks using synthetic random data to measure throughput, TTFT, TPOT, and other key metrics without downloading external datasets. Part of a collection of skills for deploying and benchmarking vLLM.

vllm-bench-random-synthetic

🎯vllm-deploy-k8s🎯Skill

Deploys vLLM to Kubernetes with GPU support, health probes, and an OpenAI-compatible API endpoint. Part of the vLLM Skills collection that also includes Docker deployment, simple deployment, and performance benchmarking skills.

vllm-deploy-k8s

Back to Home