Get the number of tokens in the messages using AWS Bedrock count_tokens API.
This method uses AWS Bedrock's count_tokens API which provides accurate token counting for supported models before inference. Falls back to the base implementation for unsupported models.
get_num_tokens_from_messages(
self,
messages: list[BaseMessage],
tools: Optional[Sequence] = None
) -> int| Name | Type | Description |
|---|---|---|
messages* | list[BaseMessage] | The message inputs to tokenize. |
tools | Optional[Sequence] | Default: NoneTool schemas (ignored, unsupported by count_tokens API). |