| Name | Type | Description |
|---|---|---|
path* | str | Path to directory. |
glob | Union[List[str], Tuple[str], str] | Default: '**/[!.]*' |
exclude | Union[Sequence[str], str] | Default: () |
silent_errors | bool | Default: False |
loader_cls | FILE_LOADER_TYPE | Default: UnstructuredFileLoader |
loader_kwargs | Union[dict, None] | Default: None |
recursive | bool | Default: False |
show_progress | bool | Default: False |
use_multithreading | bool | Default: False |
max_concurrency | int | Default: 4 |
sample_size | int | Default: 0 |
randomize_sample | bool | Default: False |
sample_seed | Union[int, None] | Default: None |
| Name | Type |
|---|---|
| path | str |
| glob | Union[List[str], Tuple[str], str] |
| silent_errors | bool |
| load_hidden | bool |
| loader_cls | FILE_LOADER_TYPE |
| loader_kwargs | Union[dict, None] |
| recursive | bool |
| show_progress | bool |
| use_multithreading | bool |
| max_concurrency | int |
| exclude | Union[Sequence[str], str] |
| sample_size | int |
| randomize_sample | bool |
| sample_seed | Union[int, None] |
Load from a directory.
A glob pattern or list of glob patterns to use to find files. Defaults to "**/[!.]*" (all files except hidden).
A pattern or list of patterns to exclude from results. Use glob syntax.
Whether to silently ignore errors. Defaults to False.
Whether to load hidden files. Defaults to False.
Loader class to use for loading files. Defaults to UnstructuredFileLoader.
Keyword arguments to pass to loader_cls. Defaults to None.
Whether to recursively search for files. Defaults to False.
Whether to show a progress bar. Defaults to False.
Whether to use multithreading. Defaults to False.
The maximum number of threads to use. Defaults to 4.
The maximum number of files you would like to load from the directory.
Shuffle the files to get a random sample.
set the seed of the random shuffle for reproducibility.