top of page
  • Writer's pictureVale

AI Dubbing 101: Terminology

Author: Slava, Chief Sound Designer

Speech is more than a collection of words in a sentence. We perceive words in the context of sentences and situations, so this is not a problem for us.

To train AI, we use natural language processing, understanding, and generation systems.

NLP (Natural Language Processing) is responsible for these tasks — natural language processing technology and its components: NLG, NLU, and NER.

NLU (Natural Language Understanding) - natural language understanding. This is the meaning of what is being said. The algorithm analyzes the syntax of the sentence and establishes relationships between words and phrases to determine the context of the cue.

An important component of NLU is NER (named-entity recognition), which is the selection from the speech of certain semantic "parameters" that are important for a specific task. The algorithm takes the user's replica text and extracts named entities in it: names, addresses, numbers, and other objects.

NLG (Natural Language Generating) is the formation of a response based on the recognized text. Initially, generation templates were used for this. Modern systems are increasingly using hidden Markov models and neural networks — AI learns to independently decide how the text should look.

Technically, NLU and NLG are components of NLP. Working together, they help create an experience close to communicating with a real person.

Recent Posts

See All

With the use of artificial intelligence (AI) in voice over, great strides and benefits have been made in the industry of dubbing a video. More and more people appreciate the quality of voiceovers, and

Why do some blogs get lots of likes and high earnings while others don’t? YouTube is a platform that allows anyone to create their own channel and use it to share their interests with other people. Bu

Every content creator wants their video to be seen by as many people as possible. And logically, these videos should be easy to understand in order to get more likes and higher the engagement rate. In

bottom of page