The recent debacle with Google’s AI-powered Overviews, which provided false information and advised users to eat rocks, highlights the pressing issue of balancing AI innovation with safety. The incident underscores the dangers of rushing AI technologies to market without adequate testing, resulting in the spread of misinformation and conspiracy theories. This is not an isolated incident, as OpenAI has also faced criticism for prioritizing profits over safety. The fast pace of innovation and the promise of vast riches incentivize companies to release products quickly, often at the expense of safety and accuracy. Governments are slowly responding to these concerns, with the EU’s AI Act set to take effect in stages starting in 2024. However, in the meantime, companies will continue to release products without regulations in place. The onus is on technology companies to engage and empower users to correct errors and biases, and to prioritize safety over profits.

AI Chaos – When Machines Go Rogue
Google’s AI-powered Overviews also repeated conspiracy theories about former President Barack Obama, identifying him, falsely, as the United States’ first Muslim President.
1–2 minutes










