Your version.
Your docs.
Start building with vLLM Agentic API. Choose the documentation that matches the version you run.
Rust command-line reference
Latest / development · The agentic CLI: run harnesses, serve, and validate.
Python command-line reference
Latest / development · The agentic-api Python launcher: commands, options, and defaults.
Quickstart
Install the published package, connect a running model, and send a first Responses API request.
API Reference
Explore the Responses, Messages, and other HTTP API endpoints.
Python installation and workflows
Install from PyPI, check the package, and choose a remote or managed vLLM workflow.
Testing Claude Code and Codex through the agentic CLI
Connect coding clients and verify their setup against an Agentic API gateway.
Responses compaction
Compact Responses item history and continue with the resulting context window.
Codex Desktop with local models
Configure Codex Desktop to use a local model through Agentic API.
Running Agentic API in front of SGLang
Connect an SGLang inference endpoint and review its tested configuration.
Running Agentic API in front of NVIDIA Dynamo
Connect NVIDIA Dynamo and a vLLM worker to the gateway.
Run agentic-api in a container
Build and configure the production gateway container.
Observability with OpenTelemetry
Export gateway traces and metrics with OpenTelemetry.
Getting Started
Set up a contributor development environment and build the repository.
Contributing
Find ways to participate and contribute to the project.
agentic-llm-d
Explore the v1alpha response hydration and persistence design.
Kubernetes deployment
Configure the gateway and its dependencies on Kubernetes.
Kubernetes with kind
Run a local Kubernetes deployment with kind.
GitHub authentication with Dex
Set up an authenticated gateway deployment with Dex.
Release guide
Prepare, validate, and publish project releases.