ConcurrentLoader(
self,
blob_loader: BlobLoader,
blob_parser: BaseBlobParser,
num_workers: int = 4
Override this method to associate a default parser with the class.
| Name | Type |
|---|---|
| blob_loader | BlobLoader |
| blob_parser | BaseBlobParser |
| num_workers | int |
Load and pars Documents concurrently.
Load documents lazily with concurrent parsing.
Create a concurrent generic document loader using a filesystem blob loader.