awrap_model_call(
self,
request: ModelRequest,
handler: Callable[[ModelRequest], Awaitable[ModelResponse]]| Name | Type | Description |
|---|---|---|
request* | ModelRequest | |
handler* | Callable[[ModelRequest], Awaitable[ModelResponse]] |
Modify the model request to add cache control blocks (async version).
The model request to potentially modify.
The async handler to execute the model request.