🤖 GPT-4o and Gemini hallucinate convincingly, providing semi-comprehensible data based on random sources they picked up from the web.
So the best way to gather accurate information from chatbots is actually knowing the answer – which defeats the purpose.
Open AI announced GPT-4o on Monday and Google discussed Gemini 1.5 during their IO talk on Tuesday, including multiple references of “we do the search for you” and other examples of how they are completely content with providing the direct answer instead of linking to the original sources.
🧑🏫 So, I attempted three different searches across both chatbots, looking for different queries seeking:
1. the best WordPress agencies
2. reputable business advisors
3. WordPress influencers to follow on LinkedIn
For context, DevriX has been ranking on ChatGPT since December as one of the most recommended WordPress agencies considering 14 years on the market, case studies, links in a myriad of sites, and strong ranking until last year. My blog still ranks on top for a number of “business advisor” terms.
👨🏭 I kept drilling the bots with follow-up questions and arguments, just like parents interrogating a teenager arriving late past their curfew and refusing they had any alcohol or did anything stupid in the process. Eventually, they tell.
For recommended WordPress agencies, the #1 choice was WP Beginner Pro Services and #2 was Seahawk Media. Both companies announced a partnership together 40 days ago and haven’t conducted a ton of business together yet. While I respect Syed and their work in Awesome Motive, bots picked up a few press releases and ranked it accordingly.
🫣 Business advisors – Steve Ballmer, former CEO of Microsoft, was the first choice. You think the billionaire is consulting businesses?
For top WordPress influencers on LinkedIn, nearly half the choices had under 3,000 followers and haven’t been active a lot.
After a couple of follow-up questions to search a few more sources, responses got better. But how much drilling is enough?
🤷♀️ Google is determined to roll out SGE and tank regular searches. But the current SERP results and chatbot searches are incorrect more often than not.
Are we going to game Reddit and press releases to rank higher in 2024 and onward?
