The device to use for inference, cuda or cpu
Configuration for the reader to be deployed in Titan Takeoff API.
Titan Takeoff API LLMs.
Titan Takeoff is a wrapper to interface with Takeoff Inference API for generative text to text language models.
You can use this wrapper to send requests to a generative language model and to deploy readers with Takeoff.
