interface SitemapLoaderParamsThe headers to use in the fetch request.
The maximum number of concurrent calls that can be made.
The maximum number of retries that can be made for a single call,
Custom handler to handle failed attempts. Takes the originally thrown
The text decoder to use to decode the response. Defaults to UTF-8.
The timeout in milliseconds for the fetch request. Defaults to 10s.
The size to chunk the sitemap URLs into for scraping.
The headers to use in the fetch request.
The maximum number of concurrent calls that can be made.
Defaults to Infinity, which means no limit.
The maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.
Custom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.
The selector to use to extract the text from the document. Defaults to "body".
The text decoder to use to decode the response. Defaults to UTF-8.
The timeout in milliseconds for the fetch request. Defaults to 10s.
Interface representing the parameters for initializing a SitemapLoader. SitemapLoaderParams