Breakdown of input token counts.
Does not need to sum to full input token count. Does not need to have all keys.
InputTokenDetails()Example:
{
"audio": 10,
"cache_creation": 200,
"cache_read": 100,
}May also hold extra provider-specific keys.
Audio input tokens.
Input tokens that were cached and there was a cache miss.
Since there was a cache miss, the cache was created from these tokens.
Input tokens that were cached and there was a cache hit.
Since there was a cache hit, the tokens were read from the cache. More precisely, the model state given these tokens was read from the cache.