Ask a question to get started
Enter to send•Shift+Enter new line
set_cache_tokens( self, read_tokens: int, write_tokens: int, *, input_tokens: int =
read_tokens
int
write_tokens
input_tokens
0
Set cumulative input and cache token counts for the active thread.
Input tokens served from the provider cache.
Input tokens written to the provider cache.
Inclusive input-token total used as the hit-rate denominator.