AI

5 architects of AI share the pros and cons of superintelligence

极速168赛车官方网站图片
Read in app

Craig Mundie, a former Microsoft executive, said artificial intelligence is no longer just a tool — it's becoming something closer to an independent intelligence, with consequences that could reshape society.

Across a series of interviews with Business Insider, Mundie and four other former leaders from OpenAI, Google, DeepMind, and the White House described a future where AI systems grow more capable, more autonomous, and harder to control.

Their warnings converge on the idea that this technology is advancing faster than society can manage it.

Professional phot of Craig Mundie standing in front of a colorful book shelf.
Craig Mundie is an ex-Microsoft exec and runs a firm, Mundie & Associates, that advises organizations on AI and more.  Craig Mundie and Mundie & Associates

Within the coming years, they said, AI could transform labor markets, concentrate power, and introduce new risks — from cyberattacks to autonomous weapons — while also offering breakthroughs in medicine and education.

Ultimately, the outcome — for better or worse — depends on how humans choose to deploy it, they say.

Jobs could disappear faster than systems can adapt

Mo Gawdat, a former chief business officer at Google, said AI could replace jobs in less than five years, starting with intellectual work and eventually extending to physical labor.

"You will have AI's agency in the real world, where they actually can carry things and move things and replace every job," Gawdat said. "The intellectual jobs and then the blue-collar jobs."

Mo Gawdat sitting in a chair in a black t-shirt and jeans.
Mo Gawdat is a former chief business officer at Google X and currently advises on AI development and human happiness.  Business Insider

Camille Stewart Gloster, who served as the White House deputy national cyber director from 2022 to 2024, said companies are already restructuring work. Tasks like early research and document review are shrinking, reshaping what entry-level roles look like.

She described the labor market shifting from a pyramid shape with many entry-level roles to a diamond shape with more roles concentrated in the middle tiers.

That transition could leave workers behind. Stewart Gloster said some companies are cutting jobs before understanding what skills they will need next, calling the move premature.

Daniel Kokotajlo, a former OpenAI researcher, said the shift may not be gradual. Instead, AI systems could "come smashing through all at once," automating large parts of the economy in a short period.

A powerful technology with few guardrails

Ramana Kumar sitting in a red chair with a black long sleeved shirt.
Ramana Kumar is a former DeepMind research scientist.  Business Insider

Ramana Kumar, a former DeepMind research scientist, said modern AI systems are designed to be convincing, not necessarily truthful. That makes them useful, but also risky.

Kokotajlo added that even today's systems lack reliable controls, noting they can produce misleading information despite being trained not to.

The concern grows as systems gain autonomy.

Future AI could integrate vast amounts of information in ways humans cannot, giving it a unique advantage in solving complex problems, Mundie said.

Daniel Kokotajlo speaking with Business Insider.
Daniel Kokotajlo is a former OpenAI researcher who is now the executive director of the AI Futures Project.  Business Insider

That capability could unlock major advances. Mundie pointed to healthcare as one of the most immediate areas of impact, where AI could determine the root cause of diseases by analyzing entire systems of the human body rather than narrow specialties.

"You don't have to ask the same question to 10 specialists," Mundie said. "The machine does that for you."

Still, the same power creates new vulnerabilities. Stewart Gloster warned that generative AI can scale cyber threats, making phishing attacks more convincing and easier to produce.

"They can also use generative AI to find out a lot about you and really tailor their communications very quickly to cause you harm and to get information from you," Steward Gloster said.

The race to build smarter AI is accelerating risk

Camille Stewart Gloster sitting in a white chair in a blue shirt.
Camille Stewart Gloster is the former White House deputy national cyber director and is now the CEO and Principal of CAS Strategies, LLC.  Business Insider

Several experts pointed to competition between companies and countries as a key driver of risk.

AI labs and governments are racing to build more powerful systems quickly, which could lead to widespread deployment of superintelligent AI before safety measures are in place, Kokotajlo said.

"I think that this race pressure will cause the leaders of these countries and the leaders of these companies to aggressively deploy their superintelligences into the economy and also into the military," he said.

Another concern is concentration of power, Kumar said. The organizations that control data centers and models could hold disproportionate influence over how AI is used and deployed.

That dynamic makes regulation difficult. Stewart Gloster — who advises policymakers, industry leaders, and global organizations on matters of technology, cybersecurity, and national security — added that governments are still figuring out what rules are needed, while companies themselves are uncertain about the skills and systems they should prioritize.

A future shaped by human decisions

Despite the risks, the experts described potential benefits that could reshape daily life.

In particular, AI could act as a constant tutor, making education more accessible, Mundie said. It could also accelerate scientific discovery, climate research, and medical treatment.

Some envision a future where work becomes less central.

Kumar said AI could reduce the need for long hours, freeing people to spend time elsewhere — though that would require changes to how income and economic systems function.

Ultimately, Gawdat framed the outcome as a choice: Applied well, AI could lead to a more abundant society; applied poorly, it could deepen inequality, erode trust, and concentrate power.

"The technologies are oftentimes neutral," Mundie said. "It's what people do with them that makes the difference."

AI may become the most powerful system humans have built. What happens next depends less on the machines themselves and more on the people shaping them.

Read next

Reem Makhoul, video journalist at Business Insider, 2026
Reem Makhoul
Reem Makhoul is an Emmy Award–winning video journalist who produces documentaries and visual investigations using innovative reporting and open-source intelligence (OSINT) techniques. She is the director and producer of her first feature-length documentary, which has been entered for the 2026 to 2027 festival run.Her Gaza coverage has received major recognition, including a News & Documentary Emmy, a duPont-Columbia Award, and a SABEW Award.She joined Business Insider's London Bureau in 2022 to run the global documentary series Still Standing, overseeing a team that produced short documentaries on disappearing crafts around the world. She then helped create and produce the award-winning series View From Above, which uses satellite imagery to tell global stories of a changing world.She previously worked as a video journalist for The New York Times in Jerusalem and New York, and as a staff video journalist for The Wall Street Journal, covering ISIS, refugees, and Middle East issues.Born in the Galilee, Reem is fluent in Arabic, Hebrew, and English. She is also the author of children's books in colloquial Arabic.You can email her at rmakhoul@bjinnox.com, or follow her on X or LinkedIn.Expertise: Investigative journalism, conflict reporting, OSINT, Middle East, documentaries, digital storytelling, translation resources.
Robert Leslie
Robert Leslie
Robert Leslie is a deputy executive producer for Business Insider's video team, with a focus on visual investigations. He trained in radio and TV broadcast journalism at the BBC before spending a decade at Agence France-Presse as a video reporter covering everything from conflict in Ukraine and Libya to breaking news and features in West Africa, the US, and Europe.Robert launched Business Insider's award-winning series View From Above, a show that uses OSINT tools and satellite imagery to analyze both human-level and geopolitical stories. He also oversees, hosts, films and produces shorts as well as documentary content for Authorized Account, How Crime Works, Boot Camp, and Risky Business
Jessica Orwig
Jessica Orwig
Jessica Orwig is a senior editor at Business Insider, where she collaborates with reporters, editors, and producers across teams to shape, write, edit, and publish stories that connect with a global audience. While her roots are in science and technology journalism, her work today spans business, careers, culture, and the big ideas shaping the future.She earned her Master’s in Science & Technology Journalism from Texas A&M University and holds a Bachelor’s in Astronomy & Physics from The Ohio State University. Throughout her career, she’s helped lead coverage on everything from space exploration and climate change to innovation, the future of work, and evolving cultural trends.Career HighlightsLed coverage on scientific milestones, including:Reported on breaking news and scientific discoveries, including:Popular stories she’s edited on science and health:Popular stories she’s written and/or edited on careers, culture, life, and business: