wrap_model_call(
self,
request: ModelRequest,
handler: Callable[[ModelRequest], ModelResponse]
) | Name | Type | Description |
|---|---|---|
request* | ModelRequest | |
handler* | Callable[[ModelRequest], ModelResponse] |
Modify the model request to add cache control blocks.
The model request to potentially modify.
The handler to execute the model request.