Ask a question to get started
Enter to send•Shift+Enter new line
ScrapingAntLoader( self, urls: List[str], *, api_key: Optional[str
BaseLoader
urls
List[str]
List of urls to scrape.
api_key
Optional[str]
None
The ScrapingAnt API key. If not specified must have env var SCRAPINGANT_API_KEY set.
scrape_config
Optional[dict]
continue_on_failure
bool
True
Fetch data from ScrapingAnt.
Turn an url to LLM accessible markdown with ScrapingAnt.
ScrapingAnt
For further details, visit: https://docs.scrapingant.com/python-client
The scraping config from ScrapingAntClient.markdown_request
Whether to continue if scraping an url fails.