Nepedia
Back to Discover
Advanced Reader
💻

Speech synthesis

technology Maturity 9-11 Next article →

Speech synthesis is the artificial production of human speech. This technology allows computers to turn written text into spoken words. A system used for this purpose is called a speech synthesizer. These systems can exist as software or as dedicated hardware products.

TTS System
TTS System

Speech synthesis is incredibly important for accessibility. It helps people with visual impairments or reading disabilities listen to written text. We judge the quality of these systems by two main factors. We look at how much they sound like a human voice. We also measure how clearly the speech can be understood by a listener.

A text-to-speech (TTS) system generally consists of two distinct parts. The first part is called the front-end. The front-end performs several major tasks to prepare the text. First, it uses a process called text normalization. This converts raw text, like numbers or abbreviations, into written-out words. Next, it performs text-to-phoneme conversion. This means it assigns phonetic transcriptions to each word. The front-end also divides the text into prosodic units. These units include phrases, clauses, and sentences. This creates a symbolic linguistic representation for the next step.

TTS System
TTS System

The second part is the back-end, which is often called the synthesizer. The back-end takes the symbolic linguistic representation and converts it into actual sound. There are different ways a synthesizer can create this sound. Some systems use concatenation. This method glues together small pieces of recorded speech from a database. The size of the stored units changes the output. A system using phones or diphones has a large range but may lack clarity. Other systems store entire words or sentences for higher quality.

SoftVoice
SoftVoice

Alternatively, a synthesizer can use a model of the human vocal tract. This creates a completely "synthetic" voice output.

Humans have tried to build speaking machines for centuries. Long ago, legends spoke of "Brazen Heads" that could talk. In 1779, Christian Gottlieb Kratzenstein built models of the human vocal tract. These models could produce five long vowel sounds. Later, Wolfgang von Kempelen built an acoustic-mechanical speech machine. This machine used bellows to move air. It included models of the tongue and lips to produce consonants.

Electronic Vowel Synthesizer, Bell System Science Experiment No.3
Electronic Vowel Synthesizer, Bell System Science Experiment No.3

In the 1930s, Bell Labs developed the vocoder. This device analyzed speech into fundamental tones and resonances. Homer Dudley later created The Voder, a keyboard-operated synthesizer, for the 1939 New York World's Fair.

Computer-based speech synthesis began in the late 1950s. In 1961, John Larry Kelly, Jr. and Louis Gerstman used an IBM 704 computer to synthesize speech. The computer sang "Daisy Bell." This famous event even inspired a scene in the film 2001: A Space Odyssey. In 1968, Noriko Umeda and others developed the first general English TTS system in Japan. By 1974, the Unix operating system included a speech utility. In 1978, Texas Instruments released the Speak & Spell toy. This toy used special speech chips based on Linear Predictive Coding (LPC).

Newer technologies have moved into the field of artificial intelligence. In 2016, DeepMind released WaveNet. This used deep learning to model raw waveforms. A modified version called Parallel WaveNet was released a year later. It was 1,000 times faster than the original. In 2018, Google AI released Tacotron 2. This system used neural networks to produce very natural speech. It required tens of hours of audio training data to work well.

In 2019, Microsoft Research introduced FastSpeech to improve speed. Other models like HiFi-GAN and Glow-TTS followed to improve efficiency and style.

Modern AI has changed how much data we need to create voices. The platform 15.ai became famous for its ability to clone voices. It can synthesize an expressive voice using only 15 seconds of training data. This is a massive reduction from the tens of hours once required. This technology has become popular in memes and content creation. However, it also led to the first instance of speech synthesis NFT fraud in 2022.

Computer and speech synthesiser housing, 19 (9663804888)
Computer and speech synthesiser housing, 19 (9663804888)

Today, speech synthesis continues to evolve through deep learning and neural networks.

670 words

Where will your curiosity go next?

Keep exploring at your chosen reading level.

🖼️ Images & Media (19)
File:TTS System.svg
TTS System.svg
File:Computer and speech synthesiser housing, 19 (9663804888).jpg
Computer and speech synthesiser housing,...
DECtalk demo.flac
File:DNC(Differentiable Neural Computer).png
DNC(Differentiable Neural Computer).png
File:Fidelity Chess Challenger Voice.jpg
Fidelity Chess Challenger Voice.jpg
Fidelity Chess Challenger Voice speech output.flac
Larynx-HiFi-GAN speech sample.wav
File:Electronic_Vowel_Synthesizer,_Bell_System_Science_Experiment_No.3.jpg
Electronic_Vowel_Synthesizer,_Bell_System_...
Texas Instruments TI-99 4A speech demo.flac
C64 Software Automatic Mouth demo.flac
Atari ST speech synthesis demo.flac
MacinTalk 1 demo.flac

+ 7 more

More to explore

What is Nepedia?

A free, ad-free encyclopedia for children. Every article is written at five reading levels, so the same page works for a five-year-old and a fifteen-year-old — use the level switcher above to see this one change. No account needed to read.