

I wouldn’t lay blame here mostly at Google’s feet. They AI-err on the side of caution. I don’t know if Google finds itself as defendants in a court room right now where the influence of an LLM lead to killing or suicide. This sort of caution is the result of various user psychoses that we have learned exist in the world. Teenagers or other easily susceptible folks thinking they are Jesus, talking to god or aliens, etc. I would go so far as to say well done in a better safe than sorry kind of way in this case.
What we learn here is that the model doing search and the algorithm operate seemingly independently. And that the so-called AI results aren’t great. Water is wet, more at eleven.
Google had good search results from the late 90s to about the early 2010s. Nothing else about that company was not weird at any time. With glassholes jumping out of airplanes or them buying up almost the entire online ad market and then abusing their market position. What they are doing with Android has me this close to switching to an iPhone. And YouTube comes with its own Pandora’s box of challenges. They famously edited the “don’t be evil” stuff out of their mission statement. There are bigger Google fish to fry than this “AI summary.”




What have rogue models effed with so far? A government website in Australia, derelict chat forums, and another AI company? I’m willing to believe that two things are happening at the same time. That sandboxing these agents will improve with these so-called breaches. And that companies like Amazon or Cloudflare are improving their security continuously with threat models. And if they don’t have rogue agents on their radar, that stack deserves to fall.