# vLLM Agentic API > vLLM Agentic API is the agentic server that lets you run Codex and Claude Code on top of vLLM. It coordinates conversation state, built-in tool execution, and multi-turn execution for agentic inference with open models. vLLM serves the model; Agentic API coordinates the tool loop and state. The project provides Responses and Messages API surfaces, conversation storage, streaming, and WebSocket transport for Responses. Built-in web search and MCP tools can execute on the gateway; client-executed function tools remain in the harness. Version 0.8.0 is available on PyPI and crates.io. With uv installed, run `uvx --from agentic-api==0.8.0 agentic run codex --upstream http://127.0.0.1:5050` (or `run claude`) without a global install. To start only the gateway, use `uvx --from agentic-api==0.8.0 agentic serve --upstream http://127.0.0.1:5050`. Alternatively, install with `cargo install agentic-server --version 0.8.0 --locked` (Rust and Cargo), then run `agentic`. The Python wheel bundles the Rust executables; serve vLLM separately. Use a tool-capable model and the appropriate tool-calling configuration. SGLang and NVIDIA Dynamo also have documented, tested upstream configurations. Compatibility depends on the model, serving configuration, and API surface. The separate agentic-llm-d component provides response hydration and persistence for llm-d. The Markdown guides below track the development branch (`main`). For a released version, use the same document at its matching Git tag; development documentation may describe features beyond your installed release. ## Getting started - [Roadmap](https://raw.githubusercontent.com/vllm-project/agentic-api/main/ROADMAP.md): Project goals, near-term priorities, longer-term direction, and non-goals. - [Project overview and quickstart](https://raw.githubusercontent.com/vllm-project/agentic-api/main/README.md): Architecture, installation, agentic CLI commands, and configuration examples. - [Rust CLI reference](https://vllm-project.github.io/agentic-api/docs/latest/rust-cli.md): Generated commands, options, and defaults for `agentic ...`: run a harness, attach to an existing gateway, serve, and validate. Installed by both Cargo and PyPI. - [Python CLI reference](https://vllm-project.github.io/agentic-api/docs/latest/python-cli.md): Generated command-line reference for the Python launcher, `agentic-api ...` (or `python -m agentic_api ...`). The Rust CLI uses `agentic ...` and has separate commands and flags. - [Python installation and workflows](https://raw.githubusercontent.com/vllm-project/agentic-api/main/docs/guides/python-installation.md): PyPI installation, remote and managed-vLLM modes, and diagnostics. - [Development setup](https://raw.githubusercontent.com/vllm-project/agentic-api/main/docs/developing/getting-started.md): Build from source and run the development checks. ## APIs and state - [API reference](https://raw.githubusercontent.com/vllm-project/agentic-api/main/docs/api/index.md): Endpoints, request and response examples, and API behavior. - [Architecture](https://raw.githubusercontent.com/vllm-project/agentic-api/main/ARCHITECTURE.md): Crate responsibilities, request lifecycle, tool execution, and storage. - [Responses compaction](https://raw.githubusercontent.com/vllm-project/agentic-api/main/docs/guides/responses-compaction.md): Compact conversation context and continue Responses requests. - [Terminology](https://raw.githubusercontent.com/vllm-project/agentic-api/main/TERMINOLOGY.md): Definitions for Responses items, conversation state, tools, streaming events, and inference rounds. ## Harnesses and integrations - [Codex Desktop](https://raw.githubusercontent.com/vllm-project/agentic-api/main/docs/guides/codex-desktop.md): Tested Linux desktop setup with a separate app profile, local model catalog, shell editing, and the freeform apply_patch limitation. - [Codex integration](https://raw.githubusercontent.com/vllm-project/agentic-api/main/docs/design/codex-integration.md): Codex integration design and configuration. - [Claude Code integration](https://raw.githubusercontent.com/vllm-project/agentic-api/main/docs/design/claude-code-integration.md): Claude Code integration design and configuration. - [MCP gateway integration](https://raw.githubusercontent.com/vllm-project/agentic-api/main/docs/design/mcp-gateway-integration.md): MCP tool discovery, execution, and gateway integration design. - [SGLang upstream](https://raw.githubusercontent.com/vllm-project/agentic-api/main/docs/guides/sglang-upstream.md): Supported configuration and recorded integration coverage. - [NVIDIA Dynamo upstream](https://raw.githubusercontent.com/vllm-project/agentic-api/main/docs/guides/dynamo-upstream.md): Dynamo with a vLLM worker and the tested configuration. - [agentic-llm-d](https://raw.githubusercontent.com/vllm-project/agentic-api/main/docs/design/agentic-llm-d.md): The v1alpha response hydration and persistence service for llm-d. ## Deployment - [Containers](https://raw.githubusercontent.com/vllm-project/agentic-api/main/docs/deploying/container.md): Build and run a container deployment. - [Kubernetes](https://raw.githubusercontent.com/vllm-project/agentic-api/main/docs/deploying/kubernetes.md): Kubernetes deployment and configuration. - [Observability](https://raw.githubusercontent.com/vllm-project/agentic-api/main/docs/deploying/observability.md): Opt-in OpenTelemetry traces, metrics, and log correlation. ## Optional - [Community meeting invite](https://zoom-lfx.platform.linuxfoundation.org/meeting/99957052764?password=caffe82c-cdfe-478e-964c-5e1d95c0c72e&invite=true): Open the community meeting invitation on LFX. - [Meeting notes](https://docs.google.com/document/d/1zJUfxdloxu9_oBYfbfTtgbz5sSZxwAnqvlnt72T67oU/edit?tab=t.0#heading=h.d5de0vs6frfk): Read the shared community meeting notes. - [Contributing](https://raw.githubusercontent.com/vllm-project/agentic-api/main/docs/community/index.md): Ways to contribute code, documentation, reviews, and feedback. - [Releases](https://github.com/vllm-project/agentic-api/releases): Published versions and release notes. - [Versioned documentation directory](https://vllm-project.github.io/agentic-api/docs): Choose a documentation snapshot. - [vLLM Slack](https://slack.vllm.ai/): Join the community in #sig-agentic-api.