Search by Algolia
Vector vs Keyword Search: Why You Should Care
ai

Vector vs Keyword Search: Why You Should Care

Search has been around for a while, to the point that it is now considered a standard requirement in many ...

Nicolas Fiorini

Senior Machine Learning Engineer

What is AI-powered site search?
ai

What is AI-powered site search?

With the advent of artificial intelligence (AI) technologies enabling services such as Alexa, Google search, and self-driving cars, the ...

John Stewart

VP Corporate Marketing

What is a B2B marketplace?
e-commerce

What is a B2B marketplace?

It’s no secret that B2B (business-to-business) transactions have largely migrated online. According to Gartner, by 2025, 80 ...

Vincent Caruana

Sr. SEO Web Digital Marketing Manager

3 strategies for B2B ecommerce growth: key takeaways from B2B Online - Chicago
e-commerce

3 strategies for B2B ecommerce growth: key takeaways from B2B Online - Chicago

Twice a year, B2B Online brings together industry leaders to discuss the trends affecting the B2B ecommerce industry. At the ...

Elena Moravec

Director of Product Marketing & Strategy

Deconstructing smart digital merchandising
e-commerce

Deconstructing smart digital merchandising

This is Part 2 of a series that dives into the transformational journey made by digital merchandising to drive positive ...

Benoit Reulier
Reshma Iyer

Benoit Reulier &

Reshma Iyer

The death of traditional shopping: How AI-powered conversational commerce changes everything
ai

The death of traditional shopping: How AI-powered conversational commerce changes everything

Get ready for the ride: online shopping is about to be completely upended by AI. Over the past few years ...

Aayush Iyer

Director, User Experience & UI Platform

What is B2C ecommerce? Models, examples, and definitions
e-commerce

What is B2C ecommerce? Models, examples, and definitions

Remember life before online shopping? When you had to actually leave the house for a brick-and-mortar store to ...

Catherine Dee

Search and Discovery writer

What are marketplace platforms and software? Why are they important?
e-commerce

What are marketplace platforms and software? Why are they important?

If you imagine pushing a virtual shopping cart down the aisles of an online store, or browsing items in an ...

Vincent Caruana

Sr. SEO Web Digital Marketing Manager

What is an online marketplace?
e-commerce

What is an online marketplace?

Remember the world before the convenience of online commerce? Before the pandemic, before the proliferation of ecommerce sites, when the ...

Catherine Dee

Search and Discovery writer

10 ways AI is transforming ecommerce
e-commerce

10 ways AI is transforming ecommerce

Artificial intelligence (AI) is no longer just the stuff of scary futuristic movies; it’s recently burst into the headlines ...

Catherine Dee

Search and Discovery writer

AI as a Service (AIaaS) in the era of "buy not build"
ai

AI as a Service (AIaaS) in the era of "buy not build"

Imagine you are the CTO of a company that has just undergone a massive decade long digital transformation. You’ve ...

Sean Mullaney

CTO @Algolia

By the numbers: the ROI of keyword and AI site search for digital commerce
product

By the numbers: the ROI of keyword and AI site search for digital commerce

Did you know that the tiny search bar at the top of many ecommerce sites can offer an outsized return ...

Jon Silvers

Director, Digital Marketing

Using pre-trained AI algorithms to solve the cold start problem
ai

Using pre-trained AI algorithms to solve the cold start problem

Artificial intelligence (AI) has quickly moved from hot topic to everyday life. Now, ecommerce businesses are beginning to clearly see ...

Etienne Martin

VP of Product

Introducing Algolia NeuralSearch
product

Introducing Algolia NeuralSearch

We couldn’t be more excited to announce the availability of our breakthrough product, Algolia NeuralSearch. The world has stepped ...

Bernadette Nixon

Chief Executive Officer and Board Member at Algolia

AI is eating ecommerce
ai

AI is eating ecommerce

The ecommerce industry has experienced steady and reliable growth over the last 20 years (albeit interrupted briefly by a global ...

Sean Mullaney

CTO @Algolia

Semantic textual similarity: a game changer for search results and recommendations
product

Semantic textual similarity: a game changer for search results and recommendations

As an ecommerce professional, you know the importance of providing a five-star search experience on your site or in ...

Vincent Caruana

Sr. SEO Web Digital Marketing Manager

What is hashing and how does it improve website and app search?
ai

What is hashing and how does it improve website and app search?

Hashing.   Yep, you read that right.   Not hashtags. Not golden, crisp-on-the-outside, melty-on-the-inside hash browns ...

Catherine Dee

Search and Discovery writer

Conference Recap: ECIR23 Take-aways
engineering

Conference Recap: ECIR23 Take-aways

We’re just back from ECIR23, the leading European conference around Information Retrieval systems, which ran its 45th edition in ...

Paul-Louis Nech

Senior ML Engineer

Looking for something?

facebookfacebooklinkedinlinkedintwittertwittermailmail

To date, businesses have been testing search relevance in the dark—with little to no performance data or post-query metrics to inform optimizing search results for engagement. Algolia’s Analytics API and Click Analytics solutions started solving this challenge by providing you a complete view into the entire search lifecycle—from query to click-through to conversion.

The A/B testing feature rolled out today on our Enterprise plans empowers you to test performance impact of a change in the configuration of your search settings. The best part: you can create A/B tests entirely from the dashboard, without a single line of code (and of course, it is also doable entirely from the API).

Why A/B testing?

Search and discovery are core to the digital experience, and relevance is the one aspect of search that can’t be overlooked. Nothing will have as much impact on the quality of your users’ experience than the relevance of results returned by your search engine.

Let’s take e-commerce as an example.

  • Optimize for conversions: there are numerous criteria an e-commerce website could use to improve relevance so that users can easily find what they are looking for and convert faster; for example, promoting product sales, popularity, ratings, in search results. But it can quickly get overwhelming. Where to start? How to make sure those new criteria aren’t counterproductive? A/B Testing allows continuous, iterative optimization, criterion by criterion.
  • Validate business decisions: there are various parameters that define an e-commerce business. Maybe your operational costs require you to favorise high-margin products. But how to make sure doing so does not have  negative impact on sales? A/B Testing adds confidence to the decision making process.

From the parsing of textual tokens, to the impact of your business metrics on the ranking formula, to the importance of the proximity of words in the query, Algolia offers dozens of features and settings allowing you to fine-tune the relevance to achieve great search results.

For Algolia users, here is how

Let’s take an example where you have an index currently used in production. Let’s call it indexA.

The ranking strategy on this index currently relies on the number_of_views of each result. You’d like to know if changing the ranking strategy to rely on a number_of_likes instead of the number_of_views would lead to better search conversions.

A/B testing allows you to do exactly that, by following these steps:

  • Create a replica of the indexA—we’ll call it indexB (make sure beforehand that you have enough space to duplicate the data)
  • Change the custom ranking of indexB to use number_of_likes instead of number_of_views
  • If you haven’t done it yet, implement click analytics. It will be used to measure performance improvements caused by your configuration change in index B
  • Go to the A/B testing feature on the dashboard, and enable an A/B test between indexA and indexB
  • Wait to get enough traffic until the significance score of the AB test reaches 95%, and that’s it!

Depending on the result, you’ll know if your new ranking strategy leads to more clicks and conversions on your search, so you can proceed with the changes with confidence!

We hope this feature will help you iterate faster on your configuration and achieve the best relevance for your search. And we certainly plan to guide you along the way and help you make the most of it!

We invite you join our upcoming webinar: “Optimizing search performance with A/B testing” and read the documentation or visit the product page to learn more

Don’t hesitate to get in touch and share your questions and feedback: shoot us an email, tweet to us, comment on this post.

About the author
Nicolas Baissas

How Videdressing supercharged their search with A/B testing

Image of David Piry Image of Maria Elisabeth Schreiber
David Piry - Product Manager at Vide DressingMaria Elisabeth Schreiber - Solutions Engineer and Search Expert
Image of David Piry
David Piry Product Manager at Vide Dressing
Image of Maria Elisabeth Schreiber
Maria Elisabeth SchreiberSolutions Engineer and Search Expert
How Videdressing supercharged their search with A/B testingWatch the webinar

Recommended Articles

Powered byAlgolia Algolia Recommend

How to improve site search with Algolia A/B testing
e-commerce

Loise Mercier

5 ways to A/B test your search for relevance
ux

Louise Vollaire

Product Marketing Manager

The (almost) ultimate guide to site search
product

Ivana Ivanovic

Senior Content Strategist