Type Alias UsageMetadata

Usage metadata for a message, such as token counts.

Properties

input_token_details?: InputTokenDetails

Breakdown of input token counts.

Does not need to sum to full input token count. Does not need to have all keys.

input_tokens: number

Count of input (or prompt) tokens. Sum of all input token types.

output_token_details?: OutputTokenDetails

Breakdown of output token counts.

Does not need to sum to full output token count. Does not need to have all keys.

output_tokens: number

Count of output (or completion) tokens. Sum of all output token types.

total_tokens: number

Total token count. Sum of input_tokens + output_tokens.