Ask a question to get started
Enter to send•Shift+Enter new line
InputTokenDetails()
TypedDict
Audio input tokens.
Input tokens that were cached and there was a cache miss.
Since there was a cache miss, the cache was created from these tokens.
Input tokens that were cached and there was a cache hit. Since there was a cache hit, the tokens were read from the cache. More precisely, the model state given these tokens was read from the cache.
Input tokens that were cached and there was a cache hit over 200k. Part of Gemini pricing.
Input tokens used to create a 5-minute ephemeral cache entry (Anthropic).
Input tokens used to create a 1-hour ephemeral cache entry (Anthropic).
Breakdown of input token counts.
Does not need to sum to full input token count. Does not need to have all keys.
