awrap_model_call(
self,
request: ModelRequest[ContextT],
handler: Callable[[ModelRequest[| Name | Type | Description |
|---|---|---|
request* | ModelRequest[ContextT] | Model request with model, messages, state, and runtime. |
handler* | Callable[[ModelRequest[ContextT]], Awaitable[ModelResponse[ResponseT]]] |
Intercept and control async model execution with retry logic.
Async callable to execute the model and returns ModelResponse.