AI

Former OpenAI board members say the company can't be trusted to govern itself

Sam Altman with the OpenAI logo behind him.
OpenAI CEO Sam Altman has faced scrutiny against his company since he was reinstated in November. Jason Redmond/AFP via Getty Images
Read in app

Two former OpenAI board members have said that artificial-intelligence companies can't be trusted to govern themselves and that third-party regulation is necessary to hold them accountable.

Helen Toner and Tasha McCauley were board members at OpenAI before they stepped down in November amid a chaotic push to oust CEO Sam Altman. Altman was swiftly reinstated as CEO days after his dismissal, and he returned to the board five months later.

In an op-ed for The Economist published Sunday, Toner and McCauley wrote that they stood by their decision to remove Altman, citing statements from senior leaders that the cofounder created a "toxic culture of lying" and engaged in behavior that could be "characterized as psychological abuse."

Since Altman returned to the board in March, OpenAI has been questioned about its commitment to safety and criticized for using an AI voice that sounded eerily like the actor Scarlett Johansson for Chat GPT-4o.

With Altman back at the helm, Toner and McCauley wrote that OpenAI couldn't be trusted to hold itself accountable.

"We also feel that developments since he returned to the company —including his reinstatement to the board and the departure of senior safety-focused talent — bode ill for the OpenAI experiment in self-governance," they wrote.

Toner and McCauley argued that for OpenAI to succeed in its stated mission to benefit "all of humanity," governments needed to intervene and establish "effective regulatory frameworks now."

The former board members wrote that they once believed OpenAI could govern itself, but "based on our experience, we believe that self-governance cannot reliably withstand the pressure of profit incentives."

OpenAI, Toner, and McCauley didn't immediately respond to a request for comment from Business Insider.

Policymakers must 'act independently' of AI companies

Toner and McCauley qualified their calls for government regulation by acknowledging that poorly designed laws could potentially hinder "competition and innovation" by burdening smaller companies.

"It is crucial that policymakers act independently of leading AI companies when developing new rules," they wrote. "They must be vigilant against loopholes, regulatory 'moats' that shield early movers from competition, and the potential for regulatory capture."

In April, the Department of Homeland Security announced the establishment of the Artificial Intelligence Safety and Security Board, which it said would provide recommendations for "safe and secure development and deployment of AI" throughout the US's critical infrastructures.

The board's 22 members include Altman and chief executives of large tech companies, including Nvidia CEO Jensen Huang and Alphabet CEO Sundar Pichai.

Although the safety board also includes representatives from tech nonprofits, leaders of for-profit companies are overrepresented.

AI ethicists who spoke to Ars Technica expressed concern that the outsize influence of profit-motivated companies could result in policies that favored industry over human safety.

"If we can all agree that we care about keeping people 'safe' with respect to how AI is used, then I think we can agree it's important to have people at the table who specialize in centering people over technology," Margaret Mitchell, an AI-ethics expert at Hugging Face, told Ars Technica.

A DHS spokesperson didn't respond to a request for comment.

Read next

Lloyd Lee
Lloyd Lee
Hannah Getahun was a reporter for Business Insider's West Coast team covering just about everything, including national politics, social justice, pop culture, science, and technology. She graduated from California State University, Long Beach with a bachelor's degree in journalism and a minor in environmental science and policy. Before joining Insider, she interned at CalMatters writing health and environment stories.Story highlights: Beyoncé wore statement shades throughout the Renaissance World Tour and played a part in making them cool againThe photographer who captured people occupying subway tracks for a Black man killed in the 1980s says history came 'full circle' after protesters did the same for Jordan Neely'I would die': People with disabilities say abortion bans could have fatal consequencesOfficer response in Jayland Walker shooting was 'overkill,' use-of-force expert says: 'The police officers involved determined that his life wasn't worthy to be preserved.'She helped raise $2 million for abortion funds by calling out Matt Gaetz: Meet Olivia Julianna, a Gen Z activist who has inspired copycat fundraisersAmerican car culture is changing thanks to younger generations. But Gen Z and Millennials see vehicle ownership much differently.It's not just you: Cybercriminals are also using ChatGPT to make their jobs easierOrca whales were discovered with a toilet paper chemical in their livers and skeletal muscles. It's just the 'tip of the iceberg' for one of the most contaminated marine mammals in the world.