Scientists unveil 'brain decoder' that can turn people’s thoughts into speech

Scientists have unveiled a "brain decoder" that can read people’s minds and turn thoughts into speech.

The technology, which could one day help doctors communicate with patients who cannot talk, generates synthesised spoken words from brain signals associated with movements of the jaw, larynx, lips and tongue.

In early tests, scientists targeted nerve messages used in the physical process of speech to tap into the verbal thoughts of volunteers.

The mind-reading tech, created by a team led by Dr Edward Chang at the University of California at San Francisco, is reported in the journal Nature.

At the start of the study, patterns of electrical activity were recorded from the brains of five volunteers as they spoke several hundred sentences aloud.

The passages were taken from well-known children's stories, including Sleeping Beauty, The Frog Prince, and Alice In Wonderland.

Armed with the recordings, the US team devised a system capable of translating brain signals responsible for individual movements of the vocal tract.

Finally, the decoded signals were fed to a neural network computer linked to a voice synthesiser.

In trials of 101 sentences, volunteer listeners were easily able to understand and transcribe the synthesised speech.

The scientists wrote: "Listeners were able to transcribe synthesised speech well.

"Of the 101 synthesised trials, at least one listener was able to provide a perfect transcription for 82 sentences with a 25-word pool and 60 sentences with a 50-word pool."

They added: "Our results may be an important next step in realising speech restoration for patients with paralysis."

Natural speech production involves more than 100 facial muscles, according to scientists.

In a second part of the study, one participant was asked to speak sentences and then mime them without making a sound.

The decoder was able to read the brain signals associated with the mime and translate them into synthesised speech.

All the volunteers, four women and one man, were epilepsy patients who had undergone surgery to implant an electrode array on to their brain surfaces.

The electrocorticography technique is used to monitor electrical activity in the cerebral cortex.

Two experts writing in an accompanying News & Views article in Nature pointed out that speaking might seem effortless but was "one of the most complex actions that we perform".

Chethan Pandarinath and Yahia H. Ali, from Emory University in Atlanta, US, added: "With continued progress, we can hope that individuals with speech impairments will regain the ability to freely speak their minds and reconnect with the world around them."

Additional reporting by Press Association.