PromptCachePolicy(
self,
*,
provider_name: str,
window_seconds: int,
confidence: CacheConfidence,| Name | Type |
|---|---|
| provider_name | str |
| window_seconds | int |
| confidence | CacheConfidence |
| minimum_tokens | int |
| write_bucket | CacheWriteBucket |
Prompt-cache behavior needed to decide and price a warning.
Keyword-only because window_seconds and minimum_tokens are adjacent
bare ints: positionally, transposing them builds a plausible-looking policy
that silently misprices and mis-gates.
Display name of the provider whose endpoint was validated.
Retention window, past which confidence describes what is known.
Whether window_seconds is a documented maximum or minimum.
Smallest prefix the provider will cache at all.
Pricing treatment for the cold request; see estimate_rewarm_cost.