BUILD / DOCUMENTATION

Your version.
Your docs.

Start building with vLLM Agentic API. Choose the documentation that matches the version you run.

Documentation version
MAIN BRANCH

Rust command-line reference

Latest / development · The agentic CLI: run harnesses, serve, and validate.

Python command-line reference

Latest / development · The agentic-api Python launcher: commands, options, and defaults.

01

Quickstart

Install the published package, connect a running model, and send a first Responses API request.

02

API Reference

Explore the Responses, Messages, and other HTTP API endpoints.

03

Python installation and workflows

Install from PyPI, check the package, and choose a remote or managed vLLM workflow.

04

Testing Claude Code and Codex through the agentic CLI

Connect coding clients and verify their setup against an Agentic API gateway.

05

Responses compaction

Compact Responses item history and continue with the resulting context window.

06

Codex Desktop with local models

Configure Codex Desktop to use a local model through Agentic API.

07

Running Agentic API in front of SGLang

Connect an SGLang inference endpoint and review its tested configuration.

08

Running Agentic API in front of NVIDIA Dynamo

Connect NVIDIA Dynamo and a vLLM worker to the gateway.

09

Run agentic-api in a container

Build and configure the production gateway container.

10

Observability with OpenTelemetry

Export gateway traces and metrics with OpenTelemetry.

11

Getting Started

Set up a contributor development environment and build the repository.

12

Contributing

Find ways to participate and contribute to the project.

13

agentic-llm-d

Explore the v1alpha response hydration and persistence design.

14

Kubernetes deployment

Configure the gateway and its dependencies on Kubernetes.

15

Kubernetes with kind

Run a local Kubernetes deployment with kind.

16

GitHub authentication with Dex

Set up an authenticated gateway deployment with Dex.

17

Release guide

Prepare, validate, and publish project releases.