guidellm.scheduler.schemas.types
HistoryT = TypeAliasType('HistoryT', list[tuple[RequestT, ResponseT | None]], type_params=(RequestT, ResponseT)) module-attribute
Record of requests + responses in conversation.
RequestDataT = TypeAliasType('RequestDataT', tuple[RequestT, RequestInfo], type_params=(RequestT,)) module-attribute
Request including external metadata and scheduling config.
RequestT = TypeVar('RequestT') module-attribute
Generic request object type for scheduler processing
ResponseT = TypeVar('ResponseT') module-attribute
Generic response object type returned by backend processing