| Name | Type | Description |
|---|---|---|
model_name* | str | Name of the model |
num_tokens* | int | Number of tokens. |
price_map* | dict | Map of model names to cost per 1000 tokens. Defaults to AI Foundation Endpoint pricing per https://www.together.ai/pricing. |
is_completion | bool | Default: False |
Get the cost in USD for a given model and number of tokens.
Whether the model is used for completion or not.
