Search by Algolia
Introducing new developer-friendly pricing
algolia

Introducing new developer-friendly pricing

Hey there, developers! At Algolia, we believe everyone should have the opportunity to bring a best-in-class search experience ...

Nick Vlku

VP of Product Growth

What is online visual merchandising?
e-commerce

What is online visual merchandising?

Eye-catching mannequins. Bright, colorful signage. Soothing interior design. Exquisite product displays. In short, amazing store merchandising. For shoppers in ...

Catherine Dee

Search and Discovery writer

Introducing the new Algolia no-code data connector platform
engineering

Introducing the new Algolia no-code data connector platform

Ingesting data should be easy, but all too often, it can be anything but. Data can come in many different ...

Keshia Rose

Staff Product Manager, Data Connectivity

Customer-centric site search trends
e-commerce

Customer-centric site search trends

Everyday there are new messages in the market about what technology to buy, how to position your company against the ...

Piyush Patel

Chief Strategic Business Development Officer

What is online retail merchandising? An introduction
e-commerce

What is online retail merchandising? An introduction

Done any shopping on an ecommerce website lately? If so, you know a smooth online shopper experience is not optional ...

Vincent Caruana

Sr. SEO Web Digital Marketing Manager

5 considerations for Black Friday 2023 readiness
e-commerce

5 considerations for Black Friday 2023 readiness

It’s hard to imagine having to think about Black Friday less than 4 months out from the previous one ...

Piyush Patel

Chief Strategic Business Development Officer

How to increase your sales and ROI with optimized ecommerce merchandising
e-commerce

How to increase your sales and ROI with optimized ecommerce merchandising

What happens if an online shopper arrives on your ecommerce site and: Your navigation provides no obvious or helpful direction ...

Catherine Dee

Search and Discovery writer

Mobile search UX best practices, part 3: Optimizing display of search results
ux

Mobile search UX best practices, part 3: Optimizing display of search results

In part 1 of this blog-post series, we looked at app interface design obstacles in the mobile search experience ...

Vincent Caruana

Sr. SEO Web Digital Marketing Manager

Mobile search UX best practices, part 2: Streamlining search functionality
ux

Mobile search UX best practices, part 2: Streamlining search functionality

In part 1 of this series on mobile UX design, we talked about how designing a successful search user experience ...

Vincent Caruana

Sr. SEO Web Digital Marketing Manager

Mobile search UX best practices, part 1: Understanding the challenges
ux

Mobile search UX best practices, part 1: Understanding the challenges

Welcome to our three-part series on creating winning search UX design for your mobile app! This post identifies developer ...

Vincent Caruana

Sr. SEO Web Digital Marketing Manager

Teaching English with Zapier and Algolia
engineering

Teaching English with Zapier and Algolia

National No Code Day falls on March 11th in the United States to encourage more people to build things online ...

Alita Leite da Silva

How AI search enables ecommerce companies to boost revenue and cut costs
ai

How AI search enables ecommerce companies to boost revenue and cut costs

Consulting powerhouse McKinsey is bullish on AI. Their forecasting estimates that AI could add around 16 percent to global GDP ...

Michelle Adams

Chief Revenue Officer at Algolia

What is digital product merchandising?
e-commerce

What is digital product merchandising?

How do you sell a product when your customers can’t assess it in person: pick it up, feel what ...

Catherine Dee

Search and Discovery writer

Scaling marketplace search with AI
ai

Scaling marketplace search with AI

It is clear that for online businesses and especially for Marketplaces, content discovery can be especially challenging due to the ...

Bharat Guruprakash

Chief Product Officer

The changing face of digital merchandising
e-commerce

The changing face of digital merchandising

This 2-part feature dives into the transformational journey made by digital merchandising to drive positive ecommerce experiences. Part 1 ...

Reshma Iyer

Director of Product Marketing, Ecommerce

What’s a convolutional neural network and how is it used for image recognition in search?
ai

What’s a convolutional neural network and how is it used for image recognition in search?

A social media user is shown snapshots of people he may know based on face-recognition technology and asked if ...

Catherine Dee

Search and Discovery writer

What’s organizational knowledge and how can you make it accessible to the right people?
product

What’s organizational knowledge and how can you make it accessible to the right people?

How’s your company’s organizational knowledge holding up? In other words, if an employee were to leave, would they ...

Catherine Dee

Search and Discovery writer

Adding trending recommendations to your existing e-commerce store
engineering

Adding trending recommendations to your existing e-commerce store

Recommendations can make or break an online shopping experience. In a world full of endless choices and infinite scrolling, recommendations ...

Ashley Huynh

Looking for something?

What is Natural Language Understanding, and how is it different from NLP?

Feb 18th 2022 product

What is Natural Language Understanding, and how is it different from NLP?
facebookfacebooklinkedinlinkedintwittertwittermailmail

Natural language understanding, also known as NLU, is a term that refers to how computers understand language spoken and written by people. Yes, that’s almost tautological, but it’s worth stating, because while the architecture of NLU is complex, and the results can be magical, the underlying goal of NLU is very clear. 

For example, there are an estimated 320 billion emails sent every day. That is a lot of natural language created and consumed, and if computers can better understand it, it can help the people who are interacting with those emails. NLU can determine whether an email is spam, if an email is high priority, or if there are other, related, emails to share with the recipient. All of these efforts help people get the most out of email.

The difference between NLU and NLP

Of course, there’s also the ever present question of what the difference is between natural language understanding and natural language processing, or NLP. The answer, again, is in the name. Natural language processing is about processing natural language, or taking text and transforming it into pieces that are easier for computers to use. Some common NLP tasks are removing stop words, segmenting words, or splitting compound words. NLP can also identify parts of speech, or important entities within text.

Getting back to the uses of natural language understanding, we can think of other examples, such as:

  • Summarizing news articles and blog posts
  • Detecting the language of a webpage to offer a translation
  • Identifying key topics in the transcript of a sales call
  • Categorizing the emotions expressed in a tweet
  • A bot to serve customer service requests
  • Serving up the right products for a search request
  • Smart voice assistants

These examples are a small percentage of all the uses for natural language understanding. Anything you can think of where you could benefit from understanding what natural language is communicating is likely a domain for NLU.

Why natural language understanding is important

Natural language understanding is complicated, and seems like magic, because natural language is complicated. Language packs a lot of information in a small amount of space. A clear example of this is the sentence “the trophy would not fit in the brown suitcase because it was too big.” You probably understood immediately what was too big, but this is really difficult for a computer. 

We can’t simply write a program that checks for the phrase “was too big” and understand that the phrase refers to the first item. First, because the phrase might instead be “was too large” or “was too heavy” or “is too big.” Second, because there are formulations where that “rule” falls flat, such as “the brown suitcase would not fit the trophy because it was too big.” There are even phrasings that might even be confusing to people, such as “I didn’t bring the trophy in the brown suitcase because it was too big.” Was the trophy too big for the suitcase, or was the suitcase too big to bring?

Natural language understanding is built atop machine learning

It’s for this reason that NLU relies heavily on machine learning. Machine learning, or ML, can take large amounts of text and learn patterns over time. This is explained by what’s called the distributional hypothesis, which says that you can learn a lot about a word “by the company it keeps.” Take the word “hat.” An ML model might see phrases like, “the man was wearing a hat on his head” or “I put on a hat to keep the sun out of my eyes.” If the model sees phrases like these enough, it starts to pick up on some patterns. Throw it, then, the phrase, “I put on a baseball cap to keep out the sun” and it can sense that just maybe there is a similarity between “hat” and “baseball cap.” Add in the phrase “the man wore a baseball cap on his head” and the similarity is seen to be even stronger.

As you can imagine, these ML models require a lot of data. OpenAI trained their GPT-2 model on 1.5 billion parameters, and followed that up with GPT-3 on 175 billion parameters. This data is often crawled from publicly available data on the web, but is then fine-tuned on a specific dataset. This fine tuning allows the model to better understand a given dataset. For example, fine tuning may help the model to better understand medical data.

Improvements in computing and machine learning have increased the power and capabilities of NLU over the past decade. We can expect over the next few years for NLU to become even more powerful and more integrated into software.

For more information on the applications of Natural Language Understanding, and to learn how you can leverage Algolia’s search and discovery APIs across your site or app, please contact our team of experts.  

About the author
Dustin Coates

Product and GTM Manager

linkedin

Recommended Articles

Powered byAlgolia Algolia Recommend

What is natural language search?
product

Dustin Coates

Product and GTM Manager

Advanced keyword search is built upon natural language processing (NLP)
ai

Julien Lemoine

Co-founder & former CTO at Algolia

What is natural-language understanding?
product

John Stewart

VP Corporate Marketing