Skip to content

guidellm.cli.benchmark

Benchmark command group.

benchmark()

Benchmark commands for performance testing generative models.

Source code in src/guidellm/cli/benchmark/__init__.py
@click.group(
    help="Load a previously saved benchmark report.",
    cls=DefaultGroupHandler,
    default="run",
)
def benchmark():
    """Benchmark commands for performance testing generative models."""