Union type for context size specifications.
Can be either:
ContextFraction: A
fraction of the model's maximum input tokens.ContextTokens: An absolute
number of tokens.ContextMessages: An
absolute number of messages.Depending on use with trigger or keep parameters, this type indicates either
when to trigger summarization or how much context to retain.
ContextSize = ContextFraction | ContextTokens | ContextMessagesExample:
# ContextFraction
context_size: ContextSize = ("fraction", 0.5)
# ContextTokens
context_size: ContextSize = ("tokens", 3000)
# ContextMessages
context_size: ContextSize = ("messages", 50)