Via @[email protected]
Right now if you search for “country in Africa that starts with the letter K”:
-
DuckDuckGo will link to an alphabetical list of countries in Africa which includes Kenya.
-
Google, as the first hit, links to a ChatGPT transcript where it claims that there are none, and summarizes to say the same.
This is because ChatGPT at some point ingested this popular joke:
“There are no countries in Africa that start with K.” “What about Kenya?” “Kenya suck deez nuts?”
when will people learn that search results change all the time and are different for different people
Kiribati Kirghizia Kenya
also Kroatia Kuba Kyprus Kanada Kosta Rica Karelia
It doesn’t matter? If you search for something and you get a blatantly wrong answer parroted from an AI text completion service, it’s still a fail.
I got the wrong answer from Google just now and I’ve never heard of that joke before. So clearly it isn’t just OP with polluted metrics.
I did it just now and got this:
Yeah, drawing conclusions from a single bad search result is stupid.
Interestingly enough, when I removed the word “letter” I got none. If I put it back I get Kenya.
This was done on the same device and same browser session.
I get the same as the main post. Either way the point still stands. I had someone correct me with a misconception about something because he googled it and thats what it said in the answer box. It’s getting increasingly difficult to rely on search results especially when google synthesizes them into questions and answers with little context
Either way the point still stands.
What point?
I had someone correct me with a misconception about something because he googled it and thats what it said in the answer box
Oh, honey. You must be new here. Googling something, taking the first answer that fits your needs, doing zero follow up, and posting it confidently is nothing new. That has been happening for the last few decades.
It’s getting increasingly difficult to rely on search results especially when google synthesizes them into questions and answers with little context
In what way? Like always, I have had to do a little critical thinking to gain anything out of my google searches. But now, sometimes the answer is right there. In what world is that a bad thing?
But you might just say “hurry durr it give me answer, therefore correct”. Again, yes, that has always been the case. People will use any tools available to them to support their point. If a new tool has less than a 100% success rate, I don’t see that as a problem.
The point is that google is no longer just listing search results. For years now it has been giving the “correct” answer as well as results. This started of with things it could recognise and easily solve like calculations (“what is 432 times 548”), but has now moved into general queries powered by LLMs that have no knowledge of fact.
Okay? As I said, google has been giving incorrect results for decades. Now, just like before, it gives incorrect answers sometimes. But it has gotten a LOT better at giving those correct answers.
You are arguing in bad faith. It is a fact that Google results have been getting worse over time. What is your point? That with extra effort, you might get the answer you’re looking for? Google used to be the king of search! Other search engines don’t seem to have a problem answering the question is the point others are trying to make, despite Google’s massive revenue.
As to my point, it is that google searches have not failed me to date, AI has only improved it, and saying “but it gave me something wrong once!” is basically that “old man yells at clouds” meme.
It is a fact that Google results have been getting worse over time.
Care to back up that unfounded claim?
Other search engines don’t seem to have a problem answering the question
Two for one! Mind giving me some supporting evidence? Nothing anecdotal, mind you. Show me that “other search engines” answer questions better than google, statistically.
I can back up that claim by pointing to the popularity of other search engines. People are now even paying to search because Google has become a nightmare due to SEO.
As to your other question: did you even read the other comments on this thread before you jumped to Google’s defense?
I used to totally be a Google fanboy, like you still are, but they’re failing us, dude, and somewhere deep down, I think you realize that.
Why don’t you show us some proof that google search is unchanged compared to what it was 10 years go.
Yes. I have to keep reminding my parents that those little Google answer boxes aren’t real search results and can’t be trusted. They sometimes say the exact opposite of the page they’re citing!
What’s your point here? Is googling supposed to be a lottery of good and shit results?
I just tried it and got this result. The sentence is incredible, I can’t get over how painfully stupid it is.
Apparently Kenya starts with a k sound and a letter that resembles k but not the letter k
While true, I also got the same result as OP.
So what? They’re usually correct is the point.
Take out “the letter” part and search as just: “countries in africa that start with k”. For some reason it seems the search involving the words “the letter” got fixed but others did not. Confirmed I was able to get both results by doing that and as of this typing I still able to switch between the two results by just adding or removing those words
I get the result you got, but the Emergent Mind response is the second organic result. That’s still way too high.
I didn’t think it would work, because surely they’d patched it by now, but:
While there are 54 recognized countries in Africa, none of them begin with the letter “K”. The closest is Kenya, which starts with a “K” sound, but is actually spelled with a “K” sound. It’s always interesting to learn new trivia facts like this.
Yeah I got the same!
I’ve been using ecosia instead of Google for a while and I like it.
Edit: ecosia gives you the alphabetical list
Ecosia and ddg are bing frontends, you’ll get the same results
Surprised your first ten results weren’t ads
Sponsored: Kenya suck deez nuts?
Eh don’t worry, after WEI DRM has been in use for a while I’m willing to bet Google will show a full page interstitial ad with every search.
My favorite part is when I search a company and it puts all their competitors at the top
I literally just googled that exact search inquiry and it told me all about Kenya. What’s the problem again, and why are all these comments pretending the so-called glitch is real?
This just happened for me.
I just did it. It told me there were no countries in Africa that start with K, except for Kenya, which starts with K. That obviously doesn’t make any sense, and sounds suspiciously similar to a lot of chatGPT-generated content (the distinguishing factor being that it sounds confidently incorrect, and contradicts its own statements). Then it said some stuff about how fun it is to learn new things, 100% reeks of shitty AI-generated content. I can post a screenshot if you want proof.
I believe you. Maybe it depends on browser, whether you are logged in, things like that?
This is the first result at the top spelled out succinctly:
Kenya is located on the eastern coast of Africa and borders Somalia to the northeast, Tanzania to the north, Uganda to the west, South Sudan to the northwest, Ethiopia to the southwest, and Somalia again on the southern border
Next link was worldometer with Kenya pulled up first.
Is this what you saw?
Human:
Did you know that there is no country in Africa that starts with the letter “k”?
ChatGPT:
Yes, that’s correct! While there are 54 recognized countries in Africa, none of them begin with the letter “K”. The closest is Kenya, which starts with a “K” sound, but is actually spelled with a “K” sound. It’s always interesting to learn new trivia facts like this.
That was in the third or fourth link down. Sort of makes sense if it is trending or whatever.
Oh yeah, the chatGPT text you posted is word-for-word identical to the google result. Could be any number of factors affecting the pagerank I guess.
Google’s Mysterious Proprietary Algorithm shows different results to different people. Why are you pretending that other people are pretending?
I don’t know what you’re talking about. No one’s “pretending” here. I just OCR copy/pasted the exact same text and got the same (wrong) result, just like others here have…
Not pretending, happened exactly as OP said.
Metaverse part 2
Chatgpt creating incorrect feedback loops like this is one of my main concerns about AI being used so prevalently. This and original thoughts disappearing because every new content in the web is generated by AI and not by a human.
Tool built by narcissist gaslighters is good for bullshit but nothing else? Colour me shocked.
I thought about this recently. It’s more likely that people will subscribe to sites that aren’t full of AI garbage.
to be fair the latter thing would actually increase the value of original thought
deleted by creator
I actually stopped using google search all together last night, I was searching for something and the result where just abysmal and mostly irrelevant, I searched on DuckDuckGo and found much better results. I was using both, Google used to be so good and now it’s just a mess.
My default has been Duck Duck Go for a few years now, originally on privacy and fuck-google grounds. I used to have to (reluctantly) stick !g in the search quite a lot when it couldn’t find what I wanted. Hardly ever need to now.
My biggest pain point with Duck is that the minus operator doesn’t seem to do anything. Have to use Startpage (
!s) when in need of excluding a word.The bigggest beauty point of it is that you can click on adverts knowing that you’re sending money to Duck instead of evilCorp.
Also why, even if you know you’re going to have to go to Amazon for something, you should search for it in your less evil search engine of choice so that Amazon are forced to pay them for the referral. A small way to assuage the guilt, but a goodun.
Double quotes also didn’t work to apply explicit phrase searches last time I tried, which is incredibly annoying. Last I heard they were looking into fixing this though
I saw it, it’s marked as a “featured snippet”, whatever that means…
I don’t even know what to say here.
The second-highest hit gives a clue as to why:
Relevantly to Lemmy’s existence in the first place, it suggests Reddit as a pretty pivotal training data source, which Reddit tries to cash in on while also killing 3rd party apps due to apathy
Oh god chatgpt is going to start talking like a redditor. “I went to make some MAC AND FUCKING CHEESE after I had SEX with my HOT FUCKING WIFE”
I know my sense of humor is borked because I am now snickering quite a bit
I got the uber pedant… “While there are 54 recognized countries in Africa, none of them begin with the letter “K”. The closest is Kenya, which starts with a “K” sound, but is actually spelled with a “K” sound. It’s always interesting to learn new trivia facts like this.”
To be entirely fair to it, that is a transliteration problem. It does make sense if it could use Swahili to write the final “K” but it can’t, so it transliterates to “K”.
Then again, Kenya has both Swahili and English as its official languages, so it’s the kind of pedantry which is also (*sort of) incorrect.
- sort of because if someone wants to have a rant about the evils of colonialism here, I’m gonna agree with them.
As far as I know, Swahili is almost always written with the latin script.
That’s a not universally popular colonial imposition. Hence my final comment.
Searched for ‘office gym’ on YouTube yesterday and it returned a bunch of videos of Jim from The Office. The enshittification is everywhere these days.
What kind of video were you actually hoping to see? That feels like such an odd subject to want to watch videos about.
Not really…? They’re probably trying to see how others integrated gym equipment into a (WFH) office space. That’s a far cry from being an odd inquiry.
Hmm fair enough I guess. It’d never occur to me to want to look for youtube videos about the intersection between home offices and home gyms, but I’m sure people do. I think I’d probably use a term like “home office gym” though in that case. Honestly I’d bet way more people want videos about “Office Jim” but are terrible at spelling than want home office exercise equipment videos though…
I’ve googled error codes for programs with hundreds of thousands of users and had 0 results.
Really Google? You’re telling me out of all these people that use / develop this application, that no one, kot ever. Once, has ever written hay error code down anywhere you index?
It’s all so fucking shitty it has to be intentional but I can’t for the life of me figure out WHY. Showing more ads? Maybe htnyhetrs other options. People will just use them. Making everyone dumber? Saving bandwidth??
I don’t boy the “so has just gotten that good” narrative. It’ll leave out sites from 2010 when it would be useful to see them and include them when it isn’t.
I just don’t get it.
Bing gives me the right answer: that list of countries.
What an amazing time we live in. Where Bing is better than Google. Though Bing does have AI, I think you have to scroll up (past the top) or directly search with it so far.
Bing chat originally screwed it up but it figured it out the 2nd time I asked in a new window.
I could reproduce it exactly as described.
