> ## Documentation Index
> Fetch the complete documentation index at: https://algolia.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Troubleshooting by crawl status

> Crawler status messages inform you of successful or failed crawl attempts.

Use the [Monitoring](/doc/tools/crawler/getting-started/monitoring#monitoring-tool) tool to examine a crawler's status.
URLs can have one of three crawl statuses:

* **Success**

* **Ignored** (skipped)

  URLs didn't match any of your configuration's [`pathsToMatch`](/doc/tools/crawler/apis/configuration/actions#param-paths-to-match)
  **or** they did match one of your [`exclusionPatterns`](/doc/tools/crawler/apis/configuration/exclusion-patterns)

* **Failed**

  Each failed URL fits into one of these categories:

  * [Fetching](/doc/tools/crawler/troubleshooting/fetching-issues). URLs that failed when accessing your site
  * [Extraction](/doc/tools/crawler/troubleshooting/extraction-issues). URLs that failed when attempting to extract data from your site.
  * [Indexing](/doc/tools/crawler/troubleshooting/indexing-issues). URLs that weren't sent to Algolia.

* **Internal**

  An internal crawler error

## Failed URL details

To get more details about a failed URL:

1. Open the [URL inspector](/doc/tools/crawler/getting-started/monitoring#url-inspector)
2. Click **Test URL** to open the **URL Tester**.
3. Click **Run Test**.

In the following example, the URL failed because the [record was too big](/doc/tools/crawler/troubleshooting/indexing-issues#records-exceed-the-maximum-for-your-algolia-plan):

<img src="https://mintcdn.com/algolia/KSYHF7soFPXylOAb/doc/tools/crawler/troubleshooting/record-is-too-big.jpg?fit=max&auto=format&n=KSYHF7soFPXylOAb&q=85&s=673d3c04e6eeedb9d48167d0d3c70c15" alt="Screenshot of the URL Tester showing a failed request with an error: 'Record extracted is too big (11KB), the maximum is 9.765625KB.'" width="1465" height="366" data-path="doc/tools/crawler/troubleshooting/record-is-too-big.jpg" />

For more information, see:

* [Crawler error messages](/doc/tools/crawler/troubleshooting/error-messages)
* [Suggestions](/doc/tools/crawler/getting-started/suggestions)