Search by Algolia
Easily integrate Algolia into native apps with FlutterFlow
engineering

Easily integrate Algolia into native apps with FlutterFlow

Algolia's advanced search capabilities pair seamlessly with iOS or Android Apps when using FlutterFlow. App development and search design ...

Chuck Meyer

Sr. Developer Relations Engineer

Algolia's search propels 1,000s of retailers to Black Friday success
e-commerce

Algolia's search propels 1,000s of retailers to Black Friday success

In the midst of the Black Friday shopping frenzy, Algolia soared to new heights, setting new records and delivering an ...

Bernadette Nixon

Chief Executive Officer and Board Member at Algolia

Generative AI’s impact on the ecommerce industry
ai

Generative AI’s impact on the ecommerce industry

When was your last online shopping trip, and how did it go? For consumers, it’s becoming arguably tougher to ...

Vincent Caruana

Senior Digital Marketing Manager, SEO

What’s the average ecommerce conversion rate and how does yours compare?
e-commerce

What’s the average ecommerce conversion rate and how does yours compare?

Have you put your blood, sweat, and tears into perfecting your online store, only to see your conversion rates stuck ...

Vincent Caruana

Senior Digital Marketing Manager, SEO

What are AI chatbots, how do they work, and how have they impacted ecommerce?
ai

What are AI chatbots, how do they work, and how have they impacted ecommerce?

“Hello, how can I help you today?”  This has to be the most tired, but nevertheless tried-and-true ...

Catherine Dee

Search and Discovery writer

Algolia named a leader in IDC MarketScape
algolia

Algolia named a leader in IDC MarketScape

We are proud to announce that Algolia was named a leader in the IDC Marketscape in the Worldwide General-Purpose ...

John Stewart

VP Corporate Marketing

Mastering the channel shift: How leading distributors provide excellent online buying experiences
e-commerce

Mastering the channel shift: How leading distributors provide excellent online buying experiences

Twice a year, B2B Online brings together America’s leading manufacturers and distributors to uncover learnings and industry trends. This ...

Jack Moberger

Director, Sales Enablement & B2B Practice Leader

Large language models (LLMs) vs generative AI: what’s the difference?
ai

Large language models (LLMs) vs generative AI: what’s the difference?

Generative AI and large language models (LLMs). These two cutting-edge AI technologies sound like totally different, incomparable things. One ...

Catherine Dee

Search and Discovery writer

What is generative AI and how does it work?
ai

What is generative AI and how does it work?

ChatGPT, Bing, Bard, YouChat, DALL-E, Jasper…chances are good you’re leveraging some version of generative artificial intelligence on ...

Catherine Dee

Search and Discovery writer

Feature Spotlight: Query Suggestions
product

Feature Spotlight: Query Suggestions

Your users are spoiled. They’re used to Google’s refined and convenient search interface, so they have high expectations ...

Jaden Baptista

Technical Writer

What does it take to build and train a large language model? An introduction
ai

What does it take to build and train a large language model? An introduction

Imagine if, as your final exam for a computer science class, you had to create a real-world large language ...

Vincent Caruana

Sr. SEO Web Digital Marketing Manager

The pros and cons of AI language models
ai

The pros and cons of AI language models

What do you think of the OpenAI ChatGPT app and AI language models? There’s lots going on: GPT-3 ...

Catherine Dee

Search and Discovery writer

How AI is transforming merchandising from reactive to proactive
e-commerce

How AI is transforming merchandising from reactive to proactive

In the fast-paced and dynamic realm of digital merchandising, being reactive to customer trends has been the norm. In ...

Lorna Rivera

Staff User Researcher

Top examples of some of the best large language models out there
ai

Top examples of some of the best large language models out there

You’re at a dinner party when the conversation takes a computer-science-y turn. Have you tried ChatGPT? What ...

Vincent Caruana

Sr. SEO Web Digital Marketing Manager

What are large language models?
ai

What are large language models?

It’s the era of Big Data, and super-sized language models are the latest stars. When it comes to ...

Catherine Dee

Search and Discovery writer

Mobile search done right: Common pitfalls and best practices
ux

Mobile search done right: Common pitfalls and best practices

Did you know that 86% of the global population uses a smartphone? The 7 billion devices connected to the Internet ...

Alexandre Collin

Staff SME Business & Optimization - UI/UX

Cloud Native meetup: Observability & Sustainability
engineering

Cloud Native meetup: Observability & Sustainability

The Cloud Native Foundation is known for being the organization behind Kubernetes and many other Cloud Native tools. To foster ...

Tim Carry

Algolia DocSearch is now free for all docs sites
product

Algolia DocSearch is now free for all docs sites

TL;DR Revamp your technical documentation search experience with DocSearch! Previously only available to open-source projects, we're excited ...

Shane Afsar

Senior Engineering Manager

Looking for something?

facebookfacebooklinkedinlinkedintwittertwittermailmail

To date, businesses have been testing search relevance in the dark—with little to no performance data or post-query metrics to inform optimizing search results for engagement. Algolia’s Analytics API and Click Analytics solutions started solving this challenge by providing you a complete view into the entire search lifecycle—from query to click-through to conversion.

The A/B testing feature rolled out today on our Enterprise plans empowers you to test performance impact of a change in the configuration of your search settings. The best part: you can create A/B tests entirely from the dashboard, without a single line of code (and of course, it is also doable entirely from the API).

Why A/B testing?

Search and discovery are core to the digital experience, and relevance is the one aspect of search that can’t be overlooked. Nothing will have as much impact on the quality of your users’ experience than the relevance of results returned by your search engine.

Let’s take e-commerce as an example.

  • Optimize for conversions: there are numerous criteria an e-commerce website could use to improve relevance so that users can easily find what they are looking for and convert faster; for example, promoting product sales, popularity, ratings, in search results. But it can quickly get overwhelming. Where to start? How to make sure those new criteria aren’t counterproductive? A/B Testing allows continuous, iterative optimization, criterion by criterion.
  • Validate business decisions: there are various parameters that define an e-commerce business. Maybe your operational costs require you to favorise high-margin products. But how to make sure doing so does not have  negative impact on sales? A/B Testing adds confidence to the decision making process.

From the parsing of textual tokens, to the impact of your business metrics on the ranking formula, to the importance of the proximity of words in the query, Algolia offers dozens of features and settings allowing you to fine-tune the relevance to achieve great search results.

For Algolia users, here is how

Let’s take an example where you have an index currently used in production. Let’s call it indexA.

The ranking strategy on this index currently relies on the number_of_views of each result. You’d like to know if changing the ranking strategy to rely on a number_of_likes instead of the number_of_views would lead to better search conversions.

A/B testing allows you to do exactly that, by following these steps:

  • Create a replica of the indexA—we’ll call it indexB (make sure beforehand that you have enough space to duplicate the data)
  • Change the custom ranking of indexB to use number_of_likes instead of number_of_views
  • If you haven’t done it yet, implement click analytics. It will be used to measure performance improvements caused by your configuration change in index B
  • Go to the A/B testing feature on the dashboard, and enable an A/B test between indexA and indexB
  • Wait to get enough traffic until the significance score of the AB test reaches 95%, and that’s it!

Depending on the result, you’ll know if your new ranking strategy leads to more clicks and conversions on your search, so you can proceed with the changes with confidence!

We hope this feature will help you iterate faster on your configuration and achieve the best relevance for your search. And we certainly plan to guide you along the way and help you make the most of it!

We invite you join our upcoming webinar: “Optimizing search performance with A/B testing” and read the documentation or visit the product page to learn more

Don’t hesitate to get in touch and share your questions and feedback: shoot us an email, tweet to us, comment on this post.

About the author
Nicolas Baissas

How Videdressing supercharged their search with A/B testing

Image of David Piry Image of Maria Elisabeth Schreiber
David Piry - Product Manager at Vide DressingMaria Elisabeth Schreiber - Solutions Engineer and Search Expert
Image of David Piry
David Piry Product Manager at Vide Dressing
Image of Maria Elisabeth Schreiber
Maria Elisabeth SchreiberSolutions Engineer and Search Expert
How Videdressing supercharged their search with A/B testingWatch the webinar

Recommended Articles

Powered byAlgolia Algolia Recommend

How to improve site search with Algolia A/B testing
e-commerce

Loise Mercier

5 ways to A/B test your search for relevance
ux

Louise Vollaire

Product Marketing Manager

The (almost) ultimate guide to site search
product

Ivana Ivanovic

Senior Content Strategist