Law

Michael Cohen used Google's AI to research legal cases to cite in his appeal. The AI hallucinated them.

Michael Cohen at Donald Trump's civil fraud trial in New York.
Michael Cohen at Donald Trump's civil fraud trial in New York. Brendan McDermid/Reuters
Read in app

The latest victim of an AI screw-up? Donald Trump's former fixer Michael Cohen and his lawyer.

Cohen admitted in a sworn statement in a Manhattan federal court case that he used Google Bard, a generative AI chatbot similar to ChatGPT, to find legal cases backing up his arguments for why he should be let loose early from his supervised release.

But Cohen didn't realize a key AI pitfall: sometimes, it just makes stuff up.

Cohen wrote that he misunderstood Google Bard as a search engine, not a generative AI service like ChatGPT, and that he trusted his lawyer to verify the cases.

"I understood it to be a super charged search engine and had repeatedly used it in other contexts to (successfully) find accurate information online," Cohen wrote. "I did not know that Google Bard could generate non-existent cases."

Cohen fed Bard's hallucinated results to his lawyer at the time, David Schwartz, who included three of them in his November 29 filing without checking that the cases were actually legit, according to the court papers.

The Friday legal filing was first reported by Inner City Press' Matthew Russell Lee.

Cohen, in the court documents, deflects the blame on his lawyer for not double-checking what he sent.

"It did not occur to me then— and remains surprising to me now—that Mr. Schwartz would drop the cases into his submission wholesale without even confirming that they existed," Cohen wrote in the filing.

Cohen pleaded guilty in 2018 to campaign finance violations and served time in prison before he was placed on supervised release.

The court filings had argued that he complied with all the terms of release and that his supervision should now end.

US District Judge Jesse Furman, who's overseeing the case, asked Schwartz "to explain why he should not be sanctioned for citing cases that appear not to exist," leading to Cohen explaining his side of the story.

Schwartz, in his own court filing, said he included the hallucinated cases as citations because he wrongly understood them to come from another one of Cohen's attorneys, Danya Perry, rather than Cohen himself. Perry is still working to try to end Cohen's supervised release and says he should not suffer for his lawyer's alleged misstep.

The incident could have consequences for one of the criminal cases against former President Donald Trump.

Cohen is expected to be a star witness in the Manhattan District Attorney's case against Trump, alleging he falsified business documents to cover up hush money payments to Stormy Daniels ahead of the 2016 election.

Trump and his attorneys have long argued that Cohen could not be trusted, given his criminal history, which also resulted in him losing his own legal license. With the AI snafu, they may have yet another example to bring in front of a jury to try to discredit him.

Read next

Jacob Shamsian author profile headshot
Jacob Shamsian
Jacob Shamsian is a correspondent on Business Insider's Enterprise news desk. He is also a Global Reporter for Axel Springer.He was previously on BI's Legal Affairs desk, covering major litigation, courtroom trials, and the legal industry.Jacob has reported on the criminal trials of Donald TrumpGhislaine Maxwell, Sam Bankman-Fried, Sean "Diddy" CombsR. Kelly, and Anna Sorokin (AKA Anna Delvey), He's also covered blockbuster civil trials, including both E. Jean Carroll v. Trump trials, the New York Attorney General's fraud trial against TrumpSarah Palin v. The New York Times, and Johnny Depp v. Amber Heard.His stories have been cited in judicial rulings, lawsuits, letters from congressional committees, and in numerous media publications. He was a pool reporter in Donald Trump's Manhattan criminal trial.Jacob has been interviewed on CNN, the docuseries "Surviving R. Kelly," ABC's "Good Morning America," and BBC News, among other programs. His work has been cited by media outlets, including The New York Times, Bloomberg News, The Washington Post, Vanity Fair, and New York magazine. He's also written for GQ, The Awl, The New Republic, Entertainment Weekly, Time, and Modern Farmer.You can reach Jacob on Signal at JacobShamsian.07.
Grace was a politics and business reporter at Business Insider, with a particular focus on topics related to the Department of Government Efficiency. She was previously a homepage and breaking news reporter at BI and an associate producer for BI's breaking news podcast, The Refresh. She has a Master of Science from Columbia University Graduate School of Journalism with a focus on investigative journalism and audio/radio production.