Fetch all urls concurrently with rate limiting.
Fetch all urls, then return soups for all results.
Async fetch all urls, then return soups for all results.
Scrape data from webpage and return it in BeautifulSoup format.
Lazy load TiDB data into document objects.
Asynchronously loads data into Document objects.
| Name | Type | Description |
|---|---|---|
blackboard_course_url* | str | Blackboard course url. |
bbrouter* | str | BbRouter cookie. |
load_all_recursively | bool | Default: TrueIf True, load all documents recursively. |
basic_auth | Optional[Tuple[str, str]] | Default: None |
cookies | Optional[dict] | Default: None |
continue_on_failure | bool | Default: False |
show_progress | bool | Default: True |
Load a Blackboard course.
This loader is not compatible with all Blackboard courses. It is only compatible with courses that use the new Blackboard interface. To use this loader, you must have the BbRouter cookie. You can get this cookie by logging into the course and then copying the value of the BbRouter cookie from the browser's developer tools.
Example:
.. code-block:: python
from langchain_community.document_loaders import BlackboardLoader
loader = BlackboardLoader( blackboard_course_url="https://blackboard.example.com/webapps/blackboard/execute/announcement?method=search&context=course_entry&course_id=_123456_1", bbrouter="expires:12345...", ) documents = loader.load()
Basic auth credentials.
Cookies.
whether to continue loading the sitemap if an error occurs loading a url, emitting a warning instead of raising an exception. Setting this to True makes the loader more robust, but also may result in missing data. Default: False
whether to show a progress bar while loading. Default: True
