Ability to fake human voices online next step for digital assistant apps

What if you could make President Trump say whatever you wanted? How about listening to the vaguely robot-like voice of yourself, programmed into an app based on a sample of your speech?

The technology will be ready "soon," according to a team of researchers from the University of Montreal's institute for computer-based learning algorithms.

Now they're seeking investors for their product, Lyrebird, and hope to join Google in the fast-expanding business of mimicking human voices.

Virtual assistants such as Alexa and Siri have driven the voice technology into the mainstream, where we can control our phones, cars and even refrigerators through verbal commands. And now we face a future where the perfect vocal replication of the president of the United States — or you, or anyone — could be just a few years away, some experts say. How does that future sound?

Whoever wins the development race, experts in technology and ethical fields are gearing up for products that will do to voice what Photoshop did to photos — make reality very difficult to tell from a simulation.

Lyrebird is aware of the downsides. The technology is exciting — with potentially "dangerous consequences such as misleading diplomats, fraud and . . . stealing the identity of someone else," according to an ethical disclaimer on Lyrebird's website. The developers did not immediately respond to an interview request.

Nevertheless, the inventors plan to begin selling what they call the first technology "to allow copying voices in a matter of minutes" — with fine tuning for emotional control.

Scientific American notes that Lyrebird and a competing Alphabet-owned project called WaveNet use neural network technology — code patterned after neurons in the human brain — to simulate human speech on the fly. In contrast, existing voice assistants such as Siri and Alexa "work by cobbling together words and phrases from prerecorded files of one particular voice."

Lyrebird says its technology, once released, will be able to mimic any voice based on as little as a minute of audio recording — though one of the developers told TechCrunch that longer samples would reduce the "distinctly metallic rasp" that the outlet noted in clips released so far.

While Lyrebirds developers have not announced a release date for their product, they claim it will simulate audio much faster than Google's WaveNet.

When the tech giant's artificial intelligence unit demonstrated WaveNet last year, listeners rated it as the closest simulation yet of human speech, according to the Verge.

However, the outlet noted, Google's team had to manually tweak the audio output or it sounded like AI baby babble.

Timo Baumann, a speech processing researcher at Carnegie Mellon University, told Scientific American that Lyrebird's audio sounded a tad robotic but that convincing human simulations — voice assistants that people might treat like friends — were a few years away.

Five major tech giants, Apple, Google, Microsoft, Facebook and Amazon.com, are pursing what The Washington Post's Elizabeth Dwoskin called "an arms race" to create the next generation of virtual assistants to make our personal devices converse like humans, if not also sound like them.

"It's about taking the way that humans have naturally interacted with each other for thousands of years and applying that to the way they interact with services," Dag Kittlaus, a co-f0under of the Siri app now in every iPhone, told Dwoskin. He was working on a conversational artificial intelligence technology he hoped would replace it.

The prospect of computer-simulated voice concerned a security technologist from Harvard University, who told Scientific American that a "new reality" of fake audio clips was on the horizon.

"A refined version of this system could replicate a person's voice with incredible accuracy, making it virtually impossible for a human listener to discern the original from the emulation," Gizmodo warned.