> ## Documentation Index
> Fetch the complete documentation index at: https://algolia.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Configure crawlers with the visual UI

> Configure a crawler's most often-used configuration settings with a visual UI.

To access the visual UI, click **Configuration** in the Crawler's left-hand menu.

For advanced configuration options, use the [editor](/doc/tools/crawler/getting-started/crawler-configuration).

Changes made in the visual UI are instantly replicated in the editor and vice versa.
You can track all changes in the editor's **Configuration History**.

<img src="https://mintcdn.com/algolia/KSYHF7soFPXylOAb/doc/tools/crawler/getting-started/visual-ui.png?fit=max&auto=format&n=KSYHF7soFPXylOAb&q=85&s=ca5cf0ed827691dbcc518493b89bc59d" alt="Screenshot of the 'Crawler Configuration' page with 'Crawler Schedule,' 'URL Exclusion Rules,' and 'Record Loss Policy' sections, each with an 'Edit' button." width="1999" height="843" data-path="doc/tools/crawler/getting-started/visual-ui.png" />

## Configuration settings

Use the visual UI to change the following settings.

| Setting                    | Description                                                                                                                                                                                  | Editor equivalent                                                                 |
| -------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | --------------------------------------------------------------------------------- |
| **Start URL**              | Specifies which URLs the crawler should start with. See also: [Where to start crawling](/doc/tools/crawler/getting-started/crawler-configuration#where-to-start-crawling-your-site)          | [`startUrls`](/doc/tools/crawler/apis/configuration/start-urls)                   |
| **Disable limit/Max URLs** | Limit the number of URLs the crawler can process. See also: [Maximum URL limit](/doc/tools/crawler/getting-started/crawler-configuration#maximum-url-limit)                                  | [`maxUrls`](/doc/tools/crawler/apis/configuration/max-urls)                       |
| **Crawler Schedule**       | Sets automatic run times for the crawler                                                                                                                                                     | [`schedule`](/doc/tools/crawler/apis/configuration/schedule)                      |
| **URL Exclusion Rules**    | Excludes specific sections or types of content from the crawl. See also: [Exclude and include content](/doc/tools/crawler/getting-started/crawler-configuration#exclude-and-include-content) | [`exclusionPatterns`](/doc/tools/crawler/apis/configuration/exclusion-patterns)   |
| **Record Loss Policy**     | Stops the crawler if it finds significantly fewer records than the previous crawl. See also: [Safety checks](/doc/tools/crawler/getting-started/crawler-configuration#safety-checks)         | [`maxLostRecordsPercentage`](/doc/tools/crawler/apis/configuration/safety-checks) |
| **Max Failed URLs**        | Stops the crawler if a specified number of pages fail to crawl. See also: [Safety checks](/doc/tools/crawler/getting-started/crawler-configuration#safety-checks)                            | [`maxFailedUrls`](/doc/tools/crawler/apis/configuration/safety-checks)            |
| **Website Authentication** | Adds authentication details for password protected sites                                                                                                                                     | [`login`](/doc/tools/crawler/apis/configuration/login)                            |
| **Index Backup**           | Saves a copy of [previously crawled content](/doc/tools/crawler/getting-started/concepts#indices-created-by-the-crawler)                                                                     | [`saveBackup`](/doc/tools/crawler/apis/configuration/save-backup)                 |