provider

Name of the provider to use for inference with the model specified in repo_id. e.g. "sambanova". if not specified, defaults to HF Inference API. available providers can be found in the huggingface_hub documentation.