Construct object from model_id
from_model_id(
cls,
model_id: str,
model_kwargs: Optional[dict] = None,
*,
tokenizer_id: Optional[str] = None,
load_in_4bit: bool = True,
load_in_low_bit: Optional[str] = None,
**kwargs: Any = {}
) -> LLM| Name | Type | Description |
|---|---|---|
model_id* | str | Path for the huggingface repo id to be downloaded or the huggingface checkpoint folder. |
tokenizer_id | Optional[str] | Default: NonePath for the huggingface repo id to be downloaded or the huggingface checkpoint folder which contains the tokenizer. |
model_kwargs | Optional[dict] | Default: NoneKeyword arguments to pass to the model and tokenizer. |
kwargs | Any | Default: {}Extra arguments to pass to the model and tokenizer. |