Is Google ruining Search with AI?

Google last week unveiled its โ€œbiggest upgradeโ€ to its search tool since the company first hit the web. It’s needed. So let’s hope it fixes Googleโ€™s flaws rather than worsens them.

Here’s what the biggest upgrade involves narrowed down to three headline items:

  • Building Google Gemini directly into the search box
  • Integrating AI agents into search to work in the background on long-running projects
  • Expanding search into Gmail and Google Photos, with user permission

That may not sound like much, but itโ€™s shifting what search means. It will place users at the centre of each search by using their own data to personalise results. Not an entirely new idea for Google, of course. What is new is that it will personalise the results using AI.

โ€œThe goal of Search has always been simple: to help you ask anything on your mind โ€“ from quick facts to the deep, complex or hyper-specific questions that can be hard to articulate,โ€ said Elizabeth Reid, VP of Search at Google. โ€œTo make this possible, weโ€™ve continued to reimagine what Search can do with AI.โ€

If that all works, itโ€™ll be splendid. After all, Googleโ€™s search has been less good of late, which is probably due to spam sites filling the web with well-optimised garbage. Anything that keeps Search working is good news for those still attempting to use the web for information.

It would also be good news for Google, which makes more than half of its revenue from Search. Just look at Google-owner Alphabetโ€™s annual revenue of $402.8bn last year: the โ€œSearch & Otherโ€ division made up 55.7% of that total. A cool $224.5bn.ย 

So Google doesnโ€™t want us to all start getting our digital info from ChatGPT, DuckDuckGo, Ecosia or Startpage. But, despite having access to some of the best minds in AI, Googleโ€™s first round of search results using AI left plenty to be desired.

Google AI Overviews… what a palaver

As noted by The Verge, Googleโ€™s AI Overview immediately started returning odd results. For instance, it misinterpreted searches for the word โ€œdisregardโ€ as an instruction to stop doing something. Similar issues were spotted with โ€œignoreโ€ and โ€œskip”.

My own attempt to doublecheck the meaning of the phrase โ€œwithout all the palaverโ€ โ€“ itโ€™s a funny phrase, okay โ€“ led to a generative chat style response.

โ€œIt looks like you want to skip the lengthy explanations and get straight to the point,โ€ AI Overview said. โ€œPlease let me know what you are looking for โ€“ such as local restaurants, events, travel details, or quick answers โ€“ and I will provide a brief, direct response without fuss.โ€

Ironically, that actually did answer my question, but in a roundabout way. However, I was looking for a dictionary definition, such as that returned by the top traditional search result. A week later, I ran that search again: AI Overview is still acting like a chatbot rather than returning information.

A Google spokesperson told Android Authority that the search giant was aware AI Overviews was โ€œmisinterpreting some action-related queriesโ€ with a solution due soon.

AI not the answer to every problem

Thatโ€™s one problem with AI Overview but there are others. One study suggested AI Overview failed to back up its claims via accurate citations 11% of the time.

All of that raises a wider question: if it doesnโ€™t work all that well (yet or ever), should Google be cramming AI into search? On one hand, it would be increasingly difficult to buy into Googleโ€™s continued statements on the world-changing promise of AI if it didnโ€™t dogfood the tech itself.

On the other hand, the whole point of Googleโ€™s Search, per its own motto, is โ€œto organize the worldโ€™s information and make it universally accessible and usefulโ€. If AI, be it in the backend or in AI Overviews, doesnโ€™t help Google achieve that, then whatโ€™s the point?

Of course, Google infamously ditched one of its other mottos โ€“ Donโ€™t Be Evil, which should be a low bar to reach to be honest โ€“ so perhaps we shouldnโ€™t be surprised that Search is no longer about search but instead a marketing tool for generative AI.

AI Overview isn’t much use to the hype machine when it canโ€™t return a sensible result when faced with a verb. But at least the results underneath the chatbot remain useful โ€“ for the time being, at least โ€“ showing thereโ€™s more ways to organise information to be โ€œuniversally accessible and usefulโ€ than just AI.

Thatโ€™s something many should remember right now.

Nicole Kobie
Nicole Kobie

Nicole is a journalist and author who specialises in the future of technology and transport. Her first book is called Green Energy, and she's working on her second, a history of technology. At TechFinitive she frequently writes about innovation and how technology can foster better collaboration.