Search by Algolia
What is a multi-vendor marketplace, and how to build one?
e-commerce

What is a multi-vendor marketplace, and how to build one?

Want to be the next Amazon? How about a follow-on to Etsy that adds a unique twist? We all ...

Catherine Dee

Search and Discovery writer

What is end-to-end AI search?
ai

What is end-to-end AI search?

Simplicity is critical for search engines, but building one that enables that simplicity is complex.  Over the last 20+ years ...

Abhijit Mehta

Director of Product Management

Comparing AI search solutions in a crowded market landscape
ai

Comparing AI search solutions in a crowded market landscape

Many new AI-powered search solutions have been released this year, and each promises to provide great results, but as ...

Andy Jones

Marketing Campaign Production Manager

What is B2B ecommerce? Everything you need to know
e-commerce

What is B2B ecommerce? Everything you need to know

When you think of “customer experience,” what comes to mind? People, right? Specifically, consumers. Retail customers. That’s easy; the ...

Vincent Caruana

Sr. SEO Web Digital Marketing Manager

What is ecommerce merchandising? Key components and best practices
e-commerce

What is ecommerce merchandising? Key components and best practices

A potential customer is about to land on the home page of your ecommerce platform, curious to see what cool ...

Catherine Dee

Search and Discovery writer

AI-powered search: From keywords to conversations
ai

AI-powered search: From keywords to conversations

By now, everyone’s had the opportunity to experiment with AI tools like ChatGPT or Midjourney and ponder their inner ...

Chris Stevenson

Director, Product Marketing

Vector vs Keyword Search: Why You Should Care
ai

Vector vs Keyword Search: Why You Should Care

Search has been around for a while, to the point that it is now considered a standard requirement in many ...

Nicolas Fiorini

Senior Machine Learning Engineer

What is AI-powered site search?
ai

What is AI-powered site search?

With the advent of artificial intelligence (AI) technologies enabling services such as Alexa, Google search, and self-driving cars, the ...

John Stewart

VP Corporate Marketing

What is a B2B marketplace?
e-commerce

What is a B2B marketplace?

It’s no secret that B2B (business-to-business) transactions have largely migrated online. According to Gartner, by 2025, 80 ...

Vincent Caruana

Sr. SEO Web Digital Marketing Manager

3 strategies for B2B ecommerce growth: key takeaways from B2B Online - Chicago
e-commerce

3 strategies for B2B ecommerce growth: key takeaways from B2B Online - Chicago

Twice a year, B2B Online brings together industry leaders to discuss the trends affecting the B2B ecommerce industry. At the ...

Elena Moravec

Director of Product Marketing & Strategy

Deconstructing smart digital merchandising
e-commerce

Deconstructing smart digital merchandising

This is Part 2 of a series that dives into the transformational journey made by digital merchandising to drive positive ...

Benoit Reulier
Reshma Iyer

Benoit Reulier &

Reshma Iyer

The death of traditional shopping: How AI-powered conversational commerce changes everything
ai

The death of traditional shopping: How AI-powered conversational commerce changes everything

Get ready for the ride: online shopping is about to be completely upended by AI. Over the past few years ...

Aayush Iyer

Director, User Experience & UI Platform

What is B2C ecommerce? Models, examples, and definitions
e-commerce

What is B2C ecommerce? Models, examples, and definitions

Remember life before online shopping? When you had to actually leave the house for a brick-and-mortar store to ...

Catherine Dee

Search and Discovery writer

What are marketplace platforms and software? Why are they important?
e-commerce

What are marketplace platforms and software? Why are they important?

If you imagine pushing a virtual shopping cart down the aisles of an online store, or browsing items in an ...

Vincent Caruana

Sr. SEO Web Digital Marketing Manager

What is an online marketplace?
e-commerce

What is an online marketplace?

Remember the world before the convenience of online commerce? Before the pandemic, before the proliferation of ecommerce sites, when the ...

Catherine Dee

Search and Discovery writer

10 ways AI is transforming ecommerce
e-commerce

10 ways AI is transforming ecommerce

Artificial intelligence (AI) is no longer just the stuff of scary futuristic movies; it’s recently burst into the headlines ...

Catherine Dee

Search and Discovery writer

AI as a Service (AIaaS) in the era of "buy not build"
ai

AI as a Service (AIaaS) in the era of "buy not build"

Imagine you are the CTO of a company that has just undergone a massive decade long digital transformation. You’ve ...

Sean Mullaney

CTO @Algolia

By the numbers: the ROI of keyword and AI site search for digital commerce
product

By the numbers: the ROI of keyword and AI site search for digital commerce

Did you know that the tiny search bar at the top of many ecommerce sites can offer an outsized return ...

Jon Silvers

Director, Digital Marketing

Looking for something?

facebookfacebooklinkedinlinkedintwittertwittermailmail

Search relevance is the measure of accuracy of the relationship between the search query and the search results.

Online users have high expectations. Thanks to the high bar set by sites like Google, Amazon, and Netflix, they expect accurate, relevant, and rapid results. However, the reality is many sites do not have optimized results pages that understand the user’s intent and bring them to their needs with ease.

If you’ve ever searched a website only to be shown a bunch of useless, unrelated results, then you know just how your users might feel: frustrated and primed to go to a competitor’s site to find results. Search relevance is integral to the user experience.

Website owners can fine-tune their search relevance to order search results in the most helpful way to users. This can be based on a number of factors, such as search intent, business priorities, textual relevance, spelling accuracy, geolocation of the user, or proximity of the keywords in the content searched.

Fine-tuning search relevance for accuracy 

Relevance can be hard to get right, since it is highly dependent on context and a number of changing variables. For example, the type of site matters: the way things should be ranked on an e-commerce website versus an academic site won’t be the same. The type of searcher matters as well. A collector and a novice will have varied intents and search skills. Finally, different people will have different words to express what they are looking for, even for the exact same query. A result ranking formula has to work with these different needs.

When a user enters a query like “discount” on an ecommerce site they want a specific subset of records that match the query criteria to be returned. 

search relevancy
When a user enters a query like “discount” on an ecommerce site they want a specific subset of records that match the query criteria to be returned.

Why does search relevance matter? 

Optimizing search relevance is an extremely important, yet often overlooked, aspect of user experience design. Research shows 43% of website visitors go immediately to the search bar, and these searchers are about 2-3 times more likely to convert. When users are served results that align to their query and interests, they will be more satisfied, more engaged, and even more likely to convert. Thus, a good UX design should encourage users to start with the search bar and navigate through the search results.

In addition, modern online users have high expectations for website usability and thus speed, ease of use, and simplicity of design are important factors in how customers perceive a brand. 

A brief history of search relevance

The history of search relevance goes back to the earliest days of the Internet, when researchers were trying to find methods for information retrieval to manage the fast growth of content being created every day. This quickly led to the invention of the search engine.

Search engines

Early search engines and protocols such as Archie, created in 1990 by a postgraduate student at McGill University, and Gopher, created in 1991 by researchers at the University of Minnesota, were important milestones in the development of modern search relevance systems. They enabled academics to use search terms to search through the file systems of other institutions that they connected to over the Internet. 

Yet, these early search engines were still very technical, requiring users to have advanced knowledge of computers and low-level Internet concepts. Meanwhile, just a couple years later in 1993, the World Wide Web started to flourish as hundreds of websites started to go online, initiating a whole new wave of search systems.

Early web search engines

Soon came web crawlers that automatically loaded and updated web pages into the search engine indexes, allowing more content to be searched.

Web search engines such as Excite in 1993 and Yahoo in 1994 quickly gained popularity due to their ease of use. They even included some basic statistical models aimed at understanding user queries and how they related to content.

These novel early systems employed a workable but limited method to rank the most relevant search results to users. They based their relevance ranking on the number of times keywords appeared in web pages, however they didn’t consider any other criteria to assess the quality of the web pages.

Then the game-changer Google search box came onto the scene. Google, founded on September 4, 1998 in Menlo Park, CA, vastly improved search relevance, by building its cutting-edge search engine technology. In the 2000s, Google advanced its search algorithms using newer and more powerful machine learning models that offered even better relevance and predictive search features such as autocomplete and instant search.  

Measuring relevant document search   

With the number of sites expanding, the need to search for relevant documents within particular sites and databases grew as well. Document search was an important precursor to the way we search on sites today.

Traditional ranking systems would often look at the frequency of keywords in documents to predict their relevance. For instance, a classic algorithm known as TF-IDF would look at the number of times keywords appeared in the respective documents (Term Frequency) and at the number of times keywords appeared in all other documents in the repository (Inverse Document Frequency). The latter analysis helps to filter out common words that are typically noise, such as prepositions.

While TF-IDF and other such early approaches to relevance were good at general purpose document search, they failed to take advantage of the additional structure and metadata that most websites contain. Modern content has titles, descriptions, categories, tags, and more keyword-based information that can be used to interpret site content and improve search relevance. 

Over time, search engine companies have developed alternatives to TF-IDF, for example, by relying more on keyword algorithms than statistics. For our own search engine, we developed a tie-breaking and custom ranking system that makes it easier for businesses to see what’s happening under the hood, which enables them to tailor the relevance to their own needs. 

With the advent of newer semantic search capabilities, there are also more sophisticated ranking quality models to score search relevance including nDCG, the normalized discounted cumulative gain, which can determine the similarity between how well a set of query results is ordered for a particular query. The higher the score, the higher the relevance. We have added scoring with neural technology and vector search to expand the relevance of our keyword search to more use cases. There are other methods, too, such as MRR (mean reciprocal rank) and MAP (mean average precision), each with their own pros and cons.

For better relevance, the quality of the records in the search index matters. Keyword and semantic search is only as good as the quality of your data, which is why data cleansing to handle missing values or noisy data, structuring datasets from different sources so it can be better analyzed, and improving content such as titles, descriptions, tags, headers, and metadata can greatly influence search quality score. 

Implementing search result boosting and optimization

Today, as websites have grown their content and product offerings, optimizing search relevance is a major consideration for individual site search engines. Businesses producing their own relevance need to take into account their specific business needs to make their search useful.

For instance, an e-commerce brand may have thousands of diverse products and customers of very different demographics. Thus, when a customer searches for a product, the internal search engine must be able to provide results that are not only related to the query, but also contextually relevant to the specific user.

NLP

Today’s search engines must also know how to handle synonyms, typos, multi-word queries, or even questions. Natural language processing (NLP) is used by search engines to help read, understand, and make sense of human languages. 

Additionally, marketers may want to promote seasonal items similar to that of their in-store merchandising efforts, or business operators may want to push higher margin goods. Therefore, a relevant search system must also be able to take these factors into account and provide custom ranking that can be adjusted to meet these needs over time. 

Many of these algorithms are still clunky, however. To improve this, some algorithms take into account the importance of the matching attribute and the proximity of the keywords. By doing so, the search results are much more likely to be relevant to users than general purpose search algorithms.

More recently, to improve relevance, search designers have been working to build in more personalization and contextualization. This includes technologies like machine learning and natural language processing to enable more conversational search, tracking of user search and browsing history to allow for custom interpretations of queries, and automatic tagging and categorization of web pages for an understanding of content at a higher level than simply that of text keywords.

Fine-tune your search relevance with Algolia 

Optimizing a website’s search relevancy is a complex and ongoing process. It requires not only providing results that match users’ queries, but also provides them personalized results while also meeting your own specific business needs. Further, as users move more toward voice-enabled devices and digital assistants, businesses will have to figure out how to provide a new type of interface that can speak naturally with users.

To provide all of these features to your customers, you’ll need a search-as-a-service partner that provides all the industry best practices and state of the art capabilities out of the box. Better relevance makes a huge difference in whether a customer — on a website or intranet — walks away with a good search or bad search experience.

About the author
Jon Silvers

Director, Digital Marketing

linkedin

Is your site performing as well as it could?

Assess your search experience in less than 5 minutes and get your free report with recommendations.

Grade my search
Is your site performing as well as it could?

Recommended Articles

Powered byAlgolia Algolia Recommend

Comparing the best e-commerce search solutions
e-commerce

Matthieu Blandineau
Jon Silvers

Matthieu Blandineau &

Jon Silvers

The (almost) ultimate guide to site search
product

Ivana Ivanovic

Senior Content Strategist

How to optimize your e-commerce site search
e-commerce

Louise Vollaire

Product Marketing Manager