Log in Sign up
Back to Discover
💻

Speech synthesis

technology Maturity 9-11

Computers can talk to us.

TTS System.svg
TTS System.svg
They turn words into sounds. This helps people who cannot see well. It can also help people read. It sounds like a real person.
Computer and speech synthesiser housing, 19 (9663804888).jpg
Computer and speech synthesiser housing, 19 (9663804888).jpg
Do you like talking to computers?

44 words

Computers can learn to talk.

TTS System.svg
TTS System.svg
They turn written words into sounds. This helps people who cannot see well. It also helps people who have trouble reading.
Computer and speech synthesiser housing, 19 (9663804888).jpg
Computer and speech synthesiser housing, 19 (9663804888).jpg
One way they do this is by using recorded voices. The computer plays small pieces of speech. It puts them together to make new words. Some systems even act like a human throat. This makes the voice sound very real. It is amazing how machines can speak!

82 words

Computers can learn to make human speech. This is called speech synthesis.

TTS System.svg
TTS System.svg
A system that turns text into speech is called a text-to-speech system. It has two main parts. The first part is the front-end. It turns written words into symbols. It also marks where phrases and sentences start. The second part is the back-end. This is the synthesizer. It turns those symbols into sound.
TTS System.svg
TTS System.svg

There are different ways to make these sounds. Some systems use a database of recorded speech. They glue small pieces of sound together to make words. Other systems use a model of the vocal tract. The vocal tract is the part of the body used for speaking. This can make a completely new, synthetic voice.

These tools help many people. They help those with visual impairments or reading disabilities.

Computer and speech synthesiser housing, 19 (9663804888).jpg
Computer and speech synthesiser housing, 19 (9663804888).jpg
In 1974, Unix was the first computer system to have this. In 1978, a toy called Speak & Spell used special chips.
Texas Instruments TI-99 4A speech demo.flac
Texas Instruments TI-99 4A speech demo.flac
Today, new tools use deep learning. This is a type of artificial intelligence. These tools can even clone a voice with very little data.

197 words

Speech synthesis is the way computers create human speech.

TTS System.svg
TTS System.svg
This technology is very helpful for many people. It allows people with visual impairments to hear written words. It also helps people with reading disabilities listen to text on a computer. A system that does this is called a speech synthesizer. You can find these in software or special hardware.
Computer and speech synthesiser housing, 19 (9663804888).jpg
Computer and speech synthesiser housing, 19 (9663804888).jpg
We judge these systems by how much they sound like a real person. We also check if they are easy to understand.

A text-to-speech system usually has two main parts. The first part is called the front-end. It takes raw text and turns it into written-out words. This step is called text normalization. The front-end also gives each word a phonetic transcription. This is a way to show how a word sounds. It also marks where phrases and sentences begin.

TTS System.svg
TTS System.svg
The second part is the back-end, or the synthesizer. It takes those sound symbols and turns them into actual sound. Some systems use a model of the human vocal tract to do this. Other systems glue together small pieces of recorded speech from a database.

People have tried to make machines speak for a very long time. Long ago, there were legends about "Brazen Heads" that could talk. In 1779, Christian Gottlieb Kratzenstein built models of the human vocal tract. These models could make five different long vowel sounds. Later, Wolfgang von Kempelen built a machine using bellows.

Electronic Vowel Synthesizer, Bell System Science Experiment No.3.jpg
Electronic Vowel Synthesizer, Bell System Science Experiment No.3.jpg
This machine had parts that acted like a tongue and lips. It could make consonants as well as vowels. In the 1930s, Bell Labs made a device called a vocoder. Homer Dudley later showed a keyboard-operated version called The Voder in 1939.

Many famous machines and milestones helped shape this technology. In 1961, John Larry Kelly, Jr. used an IBM 704 computer to synthesize speech. The computer even sang the song "Daisy Bell."

MacinTalk 1 demo.flac
MacinTalk 1 demo.flac
This event was so famous it inspired a scene in the movie 2001: A Space Odyssey. In 1974, the Unix operating system included a speech utility. By 1978, a toy called Speak & Spell used special speech chips.
Texas Instruments TI-99 4A speech demo.flac
Texas Instruments TI-99 4A speech demo.flac
In 1979, Fidelity released the Voice Chess Challenger. This was the first talking chess computer.

Today, we use artificial intelligence to make voices sound even more natural. In 2016, DeepMind released WaveNet to start the field of deep learning speech synthesis. This uses models to create speech from acoustic features. In 2018, Google AI released Tacotron 2. This system used neural networks to make very natural speech.

Larynx-HiFi-GAN speech sample.wav
Larynx-HiFi-GAN speech sample.wav
Newer tools like 15.ai can even clone a voice. It can do this with only 15 seconds of training data. This is much faster than the tens of hours needed before. These tools are now part of many modern apps and games.

486 words

Speech synthesis is the artificial production of human speech. This technology allows computers to turn written text into spoken words. A system used for this purpose is called a speech synthesizer. These systems can exist as software or as dedicated hardware products.

TTS System.svg
TTS System.svg
Speech synthesis is incredibly important for accessibility. It helps people with visual impairments or reading disabilities listen to written text. We judge the quality of these systems by two main factors. We look at how much they sound like a human voice. We also measure how clearly the speech can be understood by a listener.

A text-to-speech (TTS) system generally consists of two distinct parts. The first part is called the front-end. The front-end performs several major tasks to prepare the text. First, it uses a process called text normalization. This converts raw text, like numbers or abbreviations, into written-out words. Next, it performs text-to-phoneme conversion. This means it assigns phonetic transcriptions to each word. The front-end also divides the text into prosodic units. These units include phrases, clauses, and sentences. This creates a symbolic linguistic representation for the next step.

TTS System.svg
TTS System.svg

The second part is the back-end, which is often called the synthesizer. The back-end takes the symbolic linguistic representation and converts it into actual sound. There are different ways a synthesizer can create this sound. Some systems use concatenation. This method glues together small pieces of recorded speech from a database. The size of the stored units changes the output. A system using phones or diphones has a large range but may lack clarity. Other systems store entire words or sentences for higher quality.

SoftVoice.svg
SoftVoice.svg
Alternatively, a synthesizer can use a model of the human vocal tract. This creates a completely "synthetic" voice output.

Humans have tried to build speaking machines for centuries. Long ago, legends spoke of "Brazen Heads" that could talk. In 1779, Christian Gottlieb Kratzenstein built models of the human vocal tract. These models could produce five long vowel sounds. Later, Wolfgang von Kempelen built an acoustic-mechanical speech machine. This machine used bellows to move air. It included models of the tongue and lips to produce consonants.

Electronic Vowel Synthesizer, Bell System Science Experiment No.3.jpg
Electronic Vowel Synthesizer, Bell System Science Experiment No.3.jpg
In the 1930s, Bell Labs developed the vocoder. This device analyzed speech into fundamental tones and resonances. Homer Dudley later created The Voder, a keyboard-operated synthesizer, for the 1939 New York World's Fair.

Computer-based speech synthesis began in the late 1950s. In 1961, John Larry Kelly, Jr. and Louis Gerstman used an IBM 704 computer to synthesize speech. The computer sang "Daisy Bell." This famous event even inspired a scene in the film 2001: A Space Odyssey. In 1968, Noriko Umeda and others developed the first general English TTS system in Japan. By 1974, the Unix operating system included a speech utility. In 1978, Texas Instruments released the Speak & Spell toy. This toy used special speech chips based on Linear Predictive Coding (LPC).

Texas Instruments TI-99 4A speech demo.flac
Texas Instruments TI-99 4A speech demo.flac

Newer technologies have moved into the field of artificial intelligence. In 2016, DeepMind released WaveNet. This used deep learning to model raw waveforms. A modified version called Parallel WaveNet was released a year later. It was 1,000 times faster than the original. In 2018, Google AI released Tacotron 2. This system used neural networks to produce very natural speech. It required tens of hours of audio training data to work well.

Larynx-HiFi-GAN speech sample.wav
Larynx-HiFi-GAN speech sample.wav
In 2019, Microsoft Research introduced FastSpeech to improve speed. Other models like HiFi-GAN and Glow-TTS followed to improve efficiency and style.

Modern AI has changed how much data we need to create voices. The platform 15.ai became famous for its ability to clone voices. It can synthesize an expressive voice using only 15 seconds of training data. This is a massive reduction from the tens of hours once required. This technology has become popular in memes and content creation. However, it also led to the first instance of speech synthesis NFT fraud in 2022.

Computer and speech synthesiser housing, 19 (9663804888).jpg
Computer and speech synthesiser housing, 19 (9663804888).jpg
Today, speech synthesis continues to evolve through deep learning and neural networks.

675 words
🖼️ Images & Media (19)
File:TTS System.svg
TTS System.svg
File:Computer and speech synthesiser housing, 19 (9663804888).jpg
Computer and speech synthesiser housing,...
DECtalk demo.flac
File:DNC(Differentiable Neural Computer).png
DNC(Differentiable Neural Computer).png
File:Fidelity Chess Challenger Voice.jpg
Fidelity Chess Challenger Voice.jpg
Fidelity Chess Challenger Voice speech output.flac
Larynx-HiFi-GAN speech sample.wav
File:Electronic_Vowel_Synthesizer,_Bell_System_Science_Experiment_No.3.jpg
Electronic_Vowel_Synthesizer,_Bell_System_...
Texas Instruments TI-99 4A speech demo.flac
C64 Software Automatic Mouth demo.flac
Atari ST speech synthesis demo.flac
MacinTalk 1 demo.flac

+ 7 more

Up Next
💻
Speech recognition
Technology
More to explore

What is Nepedia?

A free, ad-free encyclopedia for children. Every article is written at five reading levels, so the same page works for a five-year-old and a fifteen-year-old — use the level switcher above to see this one change. No account needed to read.