Tools
/
Crawler
/
APIs
/
Configuration
Jan 17, 2022
Crawler: Sitemaps
Type:
string[]
Parameter syntax
sitemaps: [ 'http://www.example.com', ... ]
About this parameter
URLs found in sitemaps
are treated as startUrls
for the crawler: they are used as starting points for the crawl.
Examples
Copy
1
2
3
{
sitemaps: ['https://www.algolia.com/sitemap.xml'],
}
Did you find this page helpful?