Type Alias InputTokenDetails

InputTokenDetails: ModalitiesTokenDetails & {
cache_creation?: number;
cache_read?: number;
}

Breakdown of input token counts.

Does not need to sum to full input token count. Does not need to have all keys.

Type Declaration

Optionalcache_creation?: number
Input tokens that were cached and there was a cache miss.

Since there was a cache miss, the cache was created from these tokens.
Optionalcache_read?: number
Input tokens that were cached and there was a cache hit.

Since there was a cache hit, the tokens were read from the cache. More precisely, the model state given these tokens was read from the cache.