Tech

Google engineer believed chatbot had become an 8-year-old child. Experts say it's not sentient — just programmed to sound 'real'

Woman silhouette Google logo
Photo Illustration by Rafael Henrique/SOPA Images/LightRocket via Getty Images
Read in app

It's unlikely — if not impossible — that a Google chatbot has come to life, experts told Insider after one of the search giant's senior engineers was suspended for making startling claims.

The engineer told The Washington Post that in chatting with Google's interface called LaMDA — or Language Model for Dialogue Applications — he had begun to believe that the chatbot had become "sentient," or able to perceive and feel just like a human. Blake Lemoine, the engineer, worked in Google's Responsible Artificial Intelligence Organization.

But Lemoine, who didn't respond to a request for comment from Insider, is apparently on his own when it comes to his claims about the artificial intelligence-powered chatbot: A Google spokesperson said a team of ethicists and technologists have reviewed Lemoine's claims. They said there is no evidence to support them.

"Hundreds of researchers and engineers have conversed with LaMDA and we are not aware of anyone else making the wide-ranging assertions, or anthropomorphizing LaMDA, the way Blake has," the spokesperson said.

Seven experts Insider contacted agreed: They said the AI chatbot probably isn't sentient and that there is no clear way to gauge whether the AI-powered bot is "alive."

"The idea of sentient robots has inspired great science fiction novels and movies," Sandra Wachter, a professor at the University of Oxford who focuses on the ethics of AI, told Insider. "But we are far away from creating a machine that is akin to humans and the capacity for thought," she added.

A simple system

Another Google engineer who has worked with LaMDA told Insider that the chatbot, while capable of carrying on a multitude of conversations, follows relatively simple processes.

"What the code does is model sequences in language that it has harvested from the web," the engineer, who prefers to remain anonymous due to Google media policies, told Insider. In other words, the AI can "learn" from material scattered across the web.

Male hacker coding.
Getty Images

The engineer said in a physical sense it would be extremely unlikely that LaMDA could feel pain or experience emotion, despite conversations in which the machine appears to convey emotion. In one conversation Lemoine published, the chatbot says it feels "happy or sad at times."

It's difficult to distinguish 'sentience'

The Google engineer and several experts told Insider that there is no clear way to determine "sentience," or distinguish between a bot that has been designed to mimic social interactions versus one that might be capable of actually feeling what it conveys.

"You couldn't somehow distinguish between feeling and not feeling based on the sequences of words that come out because they are just patterns that have been learned," the engineer told Insider. "There is no 'gotcha' question.'"

Laura Edelson, a postdoctoral researcher in computer science at NYU, told Insider the subject matter of the conversation between Lemoine and LaMDA does little to show proof of life. And the fact that the conversation was edited makes it even more hazy, she said.

The Google logo is seen at the company's headquarters in Mountain View, California,
The Google logo is seen at the company's headquarters in Mountain View, California.  Marcio Jose Sanchez/AP

"Even if you had a chatbot that could have a surface-level conversation about philosophy, that's not particularly different than a chatbot that can have a surface-level conversation about movies," Edelson said.

Giada Pistilli, a researcher specializing in AI ethics, told Insider it's human nature to ascribe emotions to inanimate objects — a phenomenon known as anthropomorphization. 

And Thomas Diettrich, an emeritus professor of computer science at Oregon State University, said it's relatively easy for AI to use language involving internal emotions.

"You can train it on vast amounts of written texts, including stories with emotion and pain and then it can finish that story in a manner that appears original," he said. "Not because it understands these feelings, but because it knows how to combine old sequences to create new ones."

Diettrich told Insider the role of AI in society will undoubtedly face further scrutiny.

"SciFi has made sentience this magical thing, but philosophers have been struggling with this for centuries," Diettrich said. "I think our definitions of what is alive will change as we continue to build systems over the next 10 to 100 years."

Read next

Isobel (she/her) was a senior tech reporter at Business Insider. She was particularly interested in Big Tech, privacy, and worker's rights. You can read some of her previous work here: The quest to find $181 million in bitcoin buried in a dump Exclusive: Amazon targeted military spouses in a pandemic recruitment drive. 2 of them say they ended up being paid 33% less than non-military coworkers. Exclusive: Amazon plans a pay cut of up to 23% for hourly workers who guide trucks in and out of its UK delivery stations Exclusive: Tesla's solar division asks employees to scour social media for complaints about both the company and Elon Musk, trying to get customers to delete their posts, former employees say A couple says their Tesla Solar panels caused relentless leaks that led to mold 10 times the healthy limit, $115,000 in damages, and a long-running legal battle Ghosted by Tesla: Customers say Tesla's ultrasleek, expensive Solar Roofs and panels come with nightmare customer service, often leaving them with unanswered calls and emails for months on end Amazon workers leading a historic push for unionization in Alabama describe midnight 'education' meetings, an unexpected mailbox, and streams of anti-union flyers as they go up against one of the world's most powerful companies 'It's a slap in the face': Amazon is handing out 'Thank you' t-shirts to warehouse workers as it cuts their hazard pay Investigation: Amazon warehouse employees speak out about the 'brutal' reality of working during the holidays, when 60-hour weeks are mandatory and ambulance calls are common The science behind Elon Musk's brain-chip company Neuralink Investigation: Instagram's new TV service recommended videos of potential child abuse
Grace Kay
Grace Kay was a Correspondent on Business Insider’s enterprise desk, where she covered the inner workings of Tesla, Elon Musk’s AI startup, xAI, and the broader robotics and electric vehicle industries.Her stories have been cited by multiple publications, including Reuters, Bloomberg, and CNBC. Before joining Business Insider, she worked at Bloomberg and Forbes.Tesla: Inside 'Project Rodeo,' the Tesla effort pushing the limits of self-driving technologyInternal Tesla salary database shows Elon Musk's strategy: Lower salaries, bigger stock grantsTesla tells staff it plans to roll out its Robotaxi service in San Francisco this weekendTesla has been working on modified Model Ys for its Robotaxi programTesla prioritizes Musk's and other 'VIP' drivers' data to train self-driving softwareAshok Elluswamy is the most powerful Tesla executive you've never heard ofxAI:Internal documents reveal how Elon Musk's xAI trains Grok to be the anti-woke chatbotXAI's Macrohard project stalls as Tesla ramps up a similar AI agent effortElon Musk's xAI plans to supply computing power to coding startup CursorWar rooms, group chats, and video games: Inside Elon Musk's AI startupBehind Grok's 'sexy' settings, workers review explicit and disturbing contentElon Musk's xAI lays off hundreds of workers tasked with training GrokEVs and robots:Fisker employees are fixing some customers' cars with parts from the company's vehicle 'graveyard,' sources sayFisker Ocean reservation cancellations top 40,000 as the EV company tries to fight off bankruptcy, leaked data showsInside the downfall of Henrik Fisker's second automotive startup, which just filed for bankruptcyInside the glass-walled Tesla lab where workers train the Optimus robot to act like a humanInside OpenAI's renewed push into robotics