# Crawler

> **Class** in `langchain_classic`

📖 [View in docs](https://reference.langchain.com/python/langchain-classic/chains/natbot/crawler/Crawler)

A crawler for web pages.

**Security Note**: This is an implementation of a crawler that uses a browser via
    Playwright.

    This crawler can be used to load arbitrary webpages INCLUDING content
    from the local file system.

    Control access to who can submit crawling requests and what network access
    the crawler has.

    Make sure to scope permissions to the minimal permissions necessary for
    the application.

    See https://docs.langchain.com/oss/python/security-policy for more information.

## Signature

```python
Crawler(
    self,
)
```

## Constructors

```python
__init__(
    self,
) -> None
```


## Properties

- `browser`
- `page`
- `page_element_buffer`
- `client`

## Methods

- [`go_to_page()`](https://reference.langchain.com/python/langchain-classic/chains/natbot/crawler/Crawler/go_to_page)
- [`scroll()`](https://reference.langchain.com/python/langchain-classic/chains/natbot/crawler/Crawler/scroll)
- [`click()`](https://reference.langchain.com/python/langchain-classic/chains/natbot/crawler/Crawler/click)
- [`type()`](https://reference.langchain.com/python/langchain-classic/chains/natbot/crawler/Crawler/type)
- [`enter()`](https://reference.langchain.com/python/langchain-classic/chains/natbot/crawler/Crawler/enter)
- [`crawl()`](https://reference.langchain.com/python/langchain-classic/chains/natbot/crawler/Crawler/crawl)

---

[View source on GitHub](https://github.com/langchain-ai/langchain/blob/f0c5a28fa05adcda89aebcb449d897245ab21fa4/libs/langchain/langchain_classic/chains/natbot/crawler.py#L46)