guidellm.schemas.benchmark.profiles.profile
Profile argument schemas for multi-strategy benchmark execution.
Defines the base argument model for profile configuration, including warmup and cooldown phase settings. Uses Pydantic class registry for polymorphic deserialization of profile-specific argument types.
ProfileArgs
Bases: PydanticClassRegistryMixin['ProfileArgs'], ABC
Base class for profile creation arguments.
This class serves as a base for defining argument models used in the creation of profile instances. It inherits from PydanticClassRegistryMixin to enable automatic registration of subclasses, allowing for flexible and extensible profile configurations.
Attributes:
| Name | Type | Description |
|---|---|---|
schema_discriminator | str | Field name for polymorphic deserialization |
Source code in src/guidellm/schemas/benchmark/profiles/profile.py
__pydantic_schema_base_type__() classmethod
Return base type for polymorphic validation hierarchy.
Returns:
| Type | Description |
|---|---|
type[ProfileArgs] | Base ProfileArgs class for schema validation |
Source code in src/guidellm/schemas/benchmark/profiles/profile.py
validate_metrics(metrics)
Check the metrics configuration supports this profile.
Called once the whole benchmark configuration has validated, so a profile that needs a particular metric configured can say so before the run starts rather than failing partway through. Defaults to accepting any configuration.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
metrics | Any | Validated metrics arguments for the run | required |
Raises:
| Type | Description |
|---|---|
ValueError | If the metrics configuration cannot support this profile |