Algolia Crawler
Populate and maintain Algolia indices by periodically extracting content from your web pages with Algolia Crawler
Create an instant search on your site using Netlify and Algolia
The Algolia for Netlify plugin lets you add fast and relevant search experiences to your Netlify site. All you need is an existing Netlify site.
After installing the plugin, each Netlify deploy triggers a crawl, which updates an Algolia index.
The Crawler is an automated web scraping program. When given a set of start URLs, it visits and extracts content from those pages. It then visits URLs these pages link to, and the process repeats itself for all linked pages. With little configuration the Crawler can populate and maintain Algolia indices for you by periodically extracting content from your web pages.
Was this useful?
Recommended content
Populate and maintain Algolia indices by periodically extracting content from your web pages with Algolia Crawler
Search your Node.js dependencies in VS Code with Algolia
Apply different filters and fallback strategies to visualize and customize which recommendations to display on product description or checkout pages.