> ## Documentation Index
> Fetch the complete documentation index at: https://algolia.com/llms.txt
> Use this file to discover all available pages before exploring further.

# ignoreNoIndex

> Whether to ignore the noindex robots meta tag when extracting records.

* **Type**: `boolean`
* **Default**: `false`

By default, the Crawler doesn't extract records from pages with the [`robots`](https://developer.mozilla.org/en-US/docs/Web/HTML/Element/meta/name#Other_metadata_names)
meta tag set to `noindex` or `none`.

If `ignoreNoIndex` is true, the Crawler ignores the `noindex` directive.

## Examples

```js JavaScript icon=code theme={"system"}
{
  ignoreNoIndex: true,
}
```