Message to send to the TextGenInference API.
Response from the TextGenInference API.
Hugging Face LLM's as ChatModels.
Works with HuggingFaceTextGenInference, HuggingFaceEndpoint,
HuggingFaceHub, and HuggingFacePipeline LLMs.
Upon instantiating this class, the model_id is resolved from the url provided to the LLM, and the appropriate tokenizer is loaded from the HuggingFace Hub.
