Skip to content
GuideLLM Docs
env
English
简体中文
Initializing search
GitHub
GuideLLM Docs
GitHub
Home
Getting started
Getting started
Install
Start a Server
Run a Benchmark
Analyze Results
Guides
Guides
Architecture
Backends
Datasets
Embeddings Benchmarking Guide
Geospatial Model Benchmarking
Knee Profile and Adaptive Concurrency
Metrics
Multiturn Conversation Benchmarking
Output Types
Over-Saturation Stopping
Service Level Objectives
Tool Calling
Trace File Formats
v0.6.0 to v0.7.2 CLI Migration Guide
vLLM Python Backend
vLLM Python Batch Backend
Warnings
Multimodal
Multimodal
Audio Benchmarking
Image Benchmarking
Video Benchmarking
Synthetic Visual Data
Troubleshooting
Examples
Examples
GuideLLM Benchmark Testing with a Local Tokenizer and Custom Dataset
Kubernetes / OpenShift client Job
GuideLLM Benchmark Testing Best Practice
Developer
Developer
Code of Conduct
Contributing Guide
Development Guide
Documentation Translations
API Reference
API Reference
guidellm
guidellm
entrypoints
logger
settings
version
backends
backends
backend
openai
openai
common
http
request_handlers
websocket
vllm_python
vllm_python
batch
common
vllm
vllm_response
benchmark
benchmark
benchmarker
entrypoints
progress
warnings
analysis
analysis
knee
outputs
outputs
console
csv
html
output
plot
serialized
html_report
html_report
profiles
profiles
asynchronous
concurrent
goodput
knee
profile
replay
sweep
synchronous
throughput
scenarios
scenarios
schemas
schemas
accumulator
base
benchmark
metrics
report
warnings
cli
cli
env
export
mock_server
run
preprocess
preprocess
dataset
data
data
builders
config
entrypoints
deserializers
deserializers
deserializer
file
huggingface
memory
synthetic
synthetic_image
synthetic_video
trace_common
trace_minimal
trace_mooncake
trace_otel
trace_session_timing
trace_weka
finalizers
finalizers
conversation_graph
finalizer
generative
loaders
loaders
loader
torch
preprocessors
preprocessors
encoders
mappers
preprocessor
tool_calling
turn_pivot
schemas
schemas
base
conversation_graph_data
tokenizers
tokenizers
huggingface
tokenizer
utils
utils
dataset
extras
extras
audio
numpy
plot
torch
vision
vllm
mock_server
mock_server
models
multimodal
server
utils
handlers
handlers
chat_completions
completions
responses
tokenizer
scheduler
scheduler
dag
environments
scheduler
strategies
worker
worker_group
constraints
constraints
constraint
error
factory
request
saturation
schemas
schemas
backend
conversation
conversation_graph
state
types
schemas
schemas
backends
backends
backend
openai_http
openai_websocket
vllm_python
vllm_python_batch
base
base
base
info
request
request_stats
response
statistics
tool_call
benchmark
benchmark
entrypoints
goodput
random
transient
warnings
outputs
outputs
console
csv
html
output
plot
serialized
profiles
profiles
asynchronous
concurrent
goodput
knee
profile
replay
sweep
synchronous
throughput
scenarios
scenarios
cli
cli
preprocess
data
data
entrypoints
preprocess
deserializers
deserializers
file
huggingface
memory
synthetic
synthetic_image
synthetic_video
trace_common
trace_minimal
trace_mooncake
trace_otel
trace_weka
finalizers
finalizers
generative
loaders
loaders
torch
preprocessors
preprocessors
encoders
mappers
tool_calling
turn_pivot
tokenizers
tokenizers
huggingface
mock_server
mock_server
config
scheduler
scheduler
constraints
constraints
args
error
request
saturation
utils
utils
arg_string
audio
auto_importer
cli
click_pydantic
colors
console
default_group
dict
encoding
env_validator
functions
hf_datasets
hf_transformers
imports
lazy_loader
messaging
mixins
pipe_stdout
random
registry
singleton
statistics
synchronous
text
typing
vision
Zh
Zh
Getting started
Getting started
安装
Home
API Reference
guidellm
cli
guidellm.cli.env
Environment configuration display command.
Back to top