Create a generic document loader using a filesystem blob loader.
from_filesystem(
cls,
path: _PathLike,
*,
glob: str = '**/[!.]*',
exclude: Sequence[str] = (),
suffixes: Optional[Sequence[str]] = None,
show_progress: bool = False,
parser: Union[DEFAULT, BaseBlobParser] = 'default',
parser_kwargs: Optional[dict] = None
) -> GenericLoader| Name | Type | Description |
|---|---|---|
path* | _PathLike | The path to the directory to load documents from OR the path to a single file to load. If this is a file, glob, exclude, suffixes will be ignored. |
glob | str | Default: '**/[!.]*'The glob pattern to use to find documents. |
suffixes | Optional[Sequence[str]] | Default: NoneThe suffixes to use to filter documents. If None, all files matching the glob will be loaded. |
exclude | Sequence[str] | Default: ()A list of patterns to exclude from the loader. |
show_progress | bool | Default: FalseWhether to show a progress bar or not (requires tqdm). Proxies to the file system loader. |
parser | Union[DEFAULT, BaseBlobParser] | Default: 'default'A blob parser which knows how to parse blobs into documents,
will instantiate a default parser if not provided.
The default can be overridden by either passing a parser or
setting the class attribute |
parser_kwargs | Optional[dict] | Default: NoneKeyword arguments to pass to the parser. |