In two back-to-back days of big launches, OpenAI and Google showed the world their newest artificial intelligence projects.
They made impressive demo videos featuring all the new things OpenAI's ChatGPT-4o can do, and how Google's Gemini will revolutionize Search as we know it.
But Google's Tuesday video shows one of the major pitfalls of AI: wrong, not just bad, advice. A minute into the flashy, quick-paced video, Gemini AI in Google Search presented a factual error first spotted by The Verge.
A photographer takes a video of his malfunctioning film camera and asks Gemini: "Why is the lever not moving all the way." Gemini provides a list of solutions right away — including one that would destroy all his photos.
The video of the list highlights one suggestion: "Open the back door and gently remove the film if the camera is jammed."
This is Search in the Gemini era. #GoogleIO pic.twitter.com/JxldNjbqyn
— Google (@Google) May 14, 2024
Professional photographers — or anyone who has used a film camera — know that this is a terrible idea. Opening a camera outdoors, where the video takes place, could ruin some or all of the film by exposing it to bright light.
Google has faced similar issues with earlier AI products.
Last year, a Google demo video showing the Bard chatbot incorrectly said that the James Webb Space Telescope was the first to photograph a planet outside our own solar system.
Earlier this year, the Gemini chatbot was hammered for refusing to produce pictures of white people. It was criticized for being too "woke" and developing photos riled with historical inaccuracies like Asian Nazis and Black founding fathers. Google leadership apologized, saying they "missed the mark."
Tuesday's video highlights the perils of AI chatbots, which have been producing hallucinations, which are incorrect predictions, and giving users bad advice. Last year, users of Bing, Microsoft's AI chatbot, reported strange interactions with the bot. It called users delusional, tried to gaslight them about what year it is, and even professed its love to some users.
Companies using such AI tools may also be legally responsible for what their bots say. In February, a Canadian tribunal held Air Canada responsible for its chatbot feeding a passenger wrong information about bereavement discounts.
Google did not immediately respond to a request for comment sent outside standard business hours.
