get_num_tokens_from_messages(
self,
messages: list[BaseMessage],
tools: Optional[Sequence] =| Name | Type | Description |
|---|---|---|
messages* | list[BaseMessage] | |
tools | Optional[Sequence] | Default: None |
Get the number of tokens in the messages using AWS Bedrock count_tokens API.
This method uses AWS Bedrock's count_tokens API which provides accurate token counting for supported models before inference. Falls back to the base implementation for unsupported models.
The message inputs to tokenize.
Tool schemas (ignored, unsupported by count_tokens API).