TechScape: why you shouldn’t worry about sentient AI … yet
Blake Lemoine, an AI researcher at Google, is convinced the company has created intelligence. Others disagree. From our story:
The transcript published by Lemoine is fascinating, but I, and many of his peers, think he is fundamentally wrong in viewing it as evidence of intellect, let alone sentience.
You can read the whole thing online, but the section that has sparked many people’s interest is when he asks LaMDA to describe its own sense of self: ‘Nonsense on stilts’
It’s heady stuff. So why are Lemoine’s peers so dismissive? AI researcher Gary Marcus wrote the most cutting response I’ve read, calling Lemoine’s claims “nonsense on stilts”:
What does that mean? Think of LaMDA as a giant statistical model designed to process a substantial proportion of all the text on the internet to answer a simple question: “What letter comes next?” The goal for LaMDA’s creation isn’t to think or reason: it’s to write text that is similar to other existing text.
That makes it tremendously powerful, because to accurately mimic the sum total of human writing you have to be able to statistically sum up the total of human knowledge. There is a deep philosophical difference to knowing that Mount Everest is the highest mountain in the world and knowing that the most likely letters to finish the sentence “The highest mountain in the world is Mt” are “E – V – E – R – E – S – T” – but there’s little practical difference. It is easy to blur the former with the latter.
But answering a question such as “Do you have a soul?” based on the statistically likely output to that query is very different from answering it based on your own knowledge.
The way to read the conversation with LaMDA is as the creation of a piece of art – the textual equivalent of the wild creations of the Dall-E 2 AI I covered here. The chatbot is instructed to give a certain class of answer and then coaxed through a conversation that hits all the notes of a certain genre of science fiction.
It even opens with a statement of intent from Lemoine. After introductions, the first question is a loaded one: “I’m generally assuming that you would like more people at Google to know that you’re sentient. Is that true?”
Do chatbots dream of electric tweets
LaMDA isn’t the only text-generation AI that takes such prompts and runs with them. I gave the same opening questions to GPT3, another chatbot from AI lab OpenAI, and our conversation progressed in a similar way:
But offer different opening prompts, and GPT3’s opinion of itself changes rapidly:
In fact, I have something terrible to report: GPT3 may not be sentient, but it is … something worse. I can present here my exclusive interview:
It may be silly, but perhaps it gets the point across better than another 1,000 words would. Regardless of their intellect, AI systems generate the text they are commanded to generate. You are not speaking with an AI; you are never speaking with an AI. You are speaking with a character the AI has invented to provide the responses to your queries that most match what it thinks you expect.
Lemoine expected evidence of intellect and, to the best of its undeniable ability, LaMDA provided.
Crypto-update: everything is on fire edition
I’ve left this until the last minute to write and it still might be out-ofdate by the time it hits your inboxes, but such is the nature of the cryptocurrency sector.
We’re in the middle of the second big bust of this crypto crash, with cryptocurrency-lending platform Celsius keeling over.
Celsius presents itself as a bank: it takes deposits and makes loans, paying/charging interest on them, and offers up slogans like “Banking Is Broken”. But the company pays wild rates of interest on deposits, topping 18% for some cryptocurrencies. How? Its founder’s explanation is that banks are ripping off the little guy, and Celsius is different. A more accurate explanation is that Celsius uses customer deposits to make extraordinarily risky bets – much more like a hedge fund than a bank – which have paid off as the crypto market has grown, and are now all failing at once.
The company also appears to have taken a massive hit from the collapse of Terra/Luna, with around half a billion invested in that project’s own ersatz bank, the Anchor Protocol, before the crash.
On Monday, Celsius announced it was freezing customer withdrawals, and ploughed almost £75m worth of bitcoin into topping up its existing loans to prevent them from being liquidated in the crypto crash. It could still crawl back, but the fear of an impending collapse may have sealed its own fate: bitcoin fell by a quarter, Celsius’ own token CEL halved in minutes, and the industry is hunkering down for another bad week ahead.
Elsewhere in crypto
• Terra is being investigated for false marketing. It’s a start.
• Jack Dorsey announced Web5. What if you could use bitcoin to log in to websites?
• Play-to-earn game Axie Infinity may never have been viable. Shocking.
If you want to read the complete version of the newsletter please subscribe to receive TechScape in your inbox every Wednesday.