Microsoft CEO creeped out by chatbot using his voice
In February, Microsoft vice-president Derrick Connell visited the Bing search team in Hyderabad, India, to oversee a Monday morning hackathon.
The goal was to build bots — artificial intelligence programs that chat with users to automate things like shopping and customer service. Connell’s boss, chief executive officer Satya Nadella, thinks they’re the next big thing, a successor to apps.
The Bing team was so excited they showed up Sunday night to throw a party and brought their spouses and kids. There was even the Indian version of a pinata. Some engineers hacked a Satyabot that answered questions such as “what’s Microsoft’s mission?” and “where did you go to college?” in Nadella’s voice by culling quotes from his speeches and interviews.
Connell thought it was a clever way to show how the technology worked and told Nadella about it, thinking he’d be flattered. But the CEO was weirded out by a computer program spitting back his words.
“I don’t like the idea,” said Nadella, half laughing, half grimacing on a walk to a secret room earlier this month to preview bot and AI capabilities he demonstrated Wednesday at Microsoft’s Build confer- ence. “I shudder to think about it.”
As Microsoft unveils a big bot push at the conference, after a year of increased focus on AI and machine learning, Nadella’s discomfort illustrates a key challenge. Microsoft must balance the cool and creepy aspects of the technology as it releases tools for developers to write their own bots, as well as its own, like Tay, a snarky chat bot that ran amok last week.
Microsoft quickly yanked Tay after naughty netizens taught it to spew racist, sexist and pornographic remarks. The company plans to reintroduce Tay, but the experience left it mulling the ethics of the brave new bot world and how much control it should exert over how people use its tools and products.
Nadella in his keynote Wednesday listed ethical principles he wants the company to stand for, including human-centred design and trust.
“All technology we build has to be more inclusive and respectful,” Nadella said in the keynote.
“So it gets the best of humanity, not the worst.”
Microsoft will try to keep humans at the centre of AI and avoid unnerving users, even as it uses bots and machine intelligence to help customers comb through corporate data, socialize and make purchases, and its research arm digs deeper into the field.