guidellm.schemas.scheduler.constraints.request
Request-based constraint argument schemas.
MaxDurationConstraintArgs
Bases: ConstraintArgs
Arguments for maximum duration constraint.
Limits benchmark execution time per strategy.
Attributes:
| Name | Type | Description |
|---|---|---|
kind | Literal['max_duration'] | Always "max_duration" |
Source code in src/guidellm/schemas/scheduler/constraints/request.py
MaxRequestsConstraintArgs
Bases: ConstraintArgs
Arguments for maximum request count constraint.
Limits the number of requests processed per strategy.
Attributes:
| Name | Type | Description |
|---|---|---|
kind | Literal['max_requests'] | Always "max_requests" |
Source code in src/guidellm/schemas/scheduler/constraints/request.py
MinRequestsConstraintArgs
Bases: ConstraintArgs
Arguments for minimum processed request count constraint.
Stops execution once the given number of requests have been processed. Unlike max_requests, queuing continues until processing reaches the limit, which avoids throughput tail-off at the end of a benchmark.
Attributes:
| Name | Type | Description |
|---|---|---|
kind | Literal['min_requests'] | Always "min_requests" |