- cross-posted to:
- [email protected]
- [email protected]
- cross-posted to:
- [email protected]
- [email protected]
Over the past one and a half years, Stack Overflow has lost around 50% of its traffic. This decline is similarly reflected in site usage, with approximately a 50% decrease in the number of questions and answers, as well as the number of votes these posts receive.
The charts below show the usage represented by a moving average of 49 days.
What happened?
You must log in or register to comment.
It couldn’t happen to a more deserving group of smug, self-satisfied shitheads.
I miss when SO used to be a good place to ask questions.
I said I was a novice on the Code Review site and then the one answer I got told me to look into something like “mount genius and the valley of stupid” like dude, I fucking said I was a novice, I’m not claiming to be a genius. All over me using a term wrong. And when I asked what term they’d use they still smarted off. It wasn’t until I asked them again that they told me the term I was actually looking for.
I remember going to the vmware communities looking for help almost 20 years ago and some smug person was really upset that I didn’t use the right wording when I was starting out. He spent something like 2 whole days worth of posting. It was a chore to divine what he was saying while stumbling through his weird rant/lecture about proper terminology. I eventually called him out on it and never went back.
So long story short, communities and companies who don’t nip this kind of behavior in the bud and heavily moderate the assholes almost universally turn into the next expertsexchange community. Stack Overflow kind of leaned heavily into enshitification because of this, they eventually just stopped caring about what was being put on their forums, maintaining high content quality, and getting rid of argumentative power-users. Ironically reddit was a much nicer community and usually you’d find an answer or get help without the attitude, especially in the IT space.
SO claims a lot of this is because it is meant to be a tool where people go for correct answers and I get that, but getting downvoted or your question being closed as a duplicate feel mean regardless of how welcoming the admins claim they’re trying to make the place.
A big part of the problem is that users seek out reasons to close answers as opposed to seeking ways to try and fix them and avoid them being closed. And they’re rewarded for it! I think review queues overall are probably a positive but when you’re sitting there just going through them and you find one that could be closed as is but also could possibly be fixed, which are you going to try and do? Vote to close which takes like one second of effort or try and edit which could take a lot longer and may even involve input from OP? Then even if you do try and fix it, what if everyone else does vote to close?
I’ve had a question closed and my comments explaining why it wasn’t a duplicate deleted. The response from everyone was that because I have been using the site off and on for years they expected me to understand the process so they didn’t explain to me that I needed to edit and instead just deleted my comment and didn’t tell me anything.
The amount of anxiety I have when asking a question there is insane. And I have 6k+ rep. They weren’t wrong, I do know the site well. I have used it a lot. But like, of me, an experienced user, is afraid to ask a question that’s messed up. I’ve sat there and been like “okay, people will probably think it is a duplicate of this, I really hate getting questions closed as duplicates so I’m going to preemptively explain why it isn’t a a dupe” and then they still close it as a dupe. It’s insane. Or they find the one magical combination of words that I didn’t quite think of despite spending a good ten minutes or so looking for dupes prior to asking that did ask my question the act smug about it.
I don’t really use the sites anymore. Not even the more lighthearted and fun ones like RPG and World Building. I’ve just been so soured to it.
The amount of anxiety I have when asking a question there is insane. And I have 6k+ rep. They weren’t wrong, I do know the site well. I have used it a lot. But like, of me, an experienced user, is afraid to ask a question that’s messed up.
Yup that’s practically the same problem I had. I posted maybe one question over the past 15 years. I got crapped on by one of their power users for not doing something properly and I never posted or asked a question again. I don’t even remember what account I originally used, either.
This is sort of why I like ChatGPT, I don’t get harassed for asking something incredibly stupid, and the crappy answers are about as bad as the “marked as duplicate” nonsense that gets me nowhere anyways. Why bother trying to interface with those communities ever again? IT in general already tilts heavily towards salty misanthropes, I’ll pass on that.
Google search going to absolute shit is what happened
I don’t understand. Google search has its issues for sure, but it always shows stack overflow highly when I search programming things.
I also attribute most of this to google. I am used to google a coding question and getting 10 SO results i can quickly scan through. Since a year I only get blogposts about the general behaviour of the thing i was googling.
This is the most likely explanation. It doesn’t make sense to have such a dramatic dropoff in user behavior without an obvious trigger.
I think the issue is how people got to Stack Overflow. People generally ask Google first, which hopefully would take you somewhere where somebody has already asked your question and it has answers.
Type a technical question into Google. Back in the day it would likely take you to Experts Exchange. Couple of years later it would take you to Stack Overflow. Now it takes you to some AI generated bullshit that scraped something that might have contained an answer, but was probably just more AI generated bullshit.
Either their SEO game is weak, they stopped paying Google as much for result placement, or they’ve just been overwhelmed with limitless nonsense made by bots for the sole purpose of selling advertising space that other bots will look at.
Or maybe I’m wrong and everybody is just asking ChatGPT their technical questions now, in which case god fucking help us all…
It gives decent answer and is still relatively at the top. However, if you need to ask something that isn’t there you’re going to be either intimidated or your question is going to be left unanswered for months.
I’m more inclined to ask questions on sites like Reddit, because it’s something I’m familiar with and there’s far better chance of getting it answered within couple hours.
ChatGPT is also far superior because there’s a feedback loop almost in real time. Doesn’t matter if it gives the wrong answer, it gives you something to work with and try, and you can keep asking for more ideas. That’s much preferable than having to wait for months or even years to get an answer
Ya im not sure what the deal with the hate is. ChatGPT gives you an excellent starting point and if you give it good feedback and direction you can actually churn out some pretty decent code with it.
Amazing how much hate SO receives here. As knowledge base it’s working super good. And yes, a lot of questions have been answered already. And also yes, just like any other online community there’s bad apples which you have to live with unfortunately.
Idolizing ChatGPT as a viable replacementis laughable, because it has no knowledge, no understanding, of what it says. It’s just repeating what it “learned” and connected. Ask about something new and it will simply lie, which is arguably worse than an unfriendly answer in my opinion.
Explains the huge swaths of bad advice shared on Reddit though. It’s shared confidently and with a smile. Positive vibes only!
What’s “Reddit”?
(I removed all my advice from there when it was considered “violent content” and “sexualization of minors”… go find your 3d printing, programming, system management and chemistry tips elsewhere, I did it anyway)
The advice on stack overflow is trash because “that question has been answered already” yeah, it was answered 10 years ago on a completely different version. That answer is depreciated.
Not to mention the amount of convoluted answers that get voted to the top and then someone with two upvotes at the bottom meekly giving the answer that you actually needed.
It’s like that librarian from the New York public library who determined whether or not children’s books would even get published.
She gave “good night moon” a bad score and it fell out of popularity for 30 years after the author died.
I don’t think that’s entirely fair. Typically answers are getting upvoted when they work for someone. So the top answer worked for more people than the other answers. Now there can be more than one solution to a problem but neither the people who try to answer the question, nor the people who vote on the answers, can possibly know which of them works specifically for you.
ChatGPT will just as well give you a technically correct, but for you wrong, answer. And only after some refinement give the answer you need. Not that different than reading all the answers and picking the one which works for you.
Of course older answers are going to have more uovotes if they technically work. That doesn’t mean it’s the best answer. It’s possible that someone would like to make a new, better, answer and is unable to because of SA restrictions on posting.
The kinds of people who post on SA regularly aren’t going to be the people with the best answers.
On top of that SA gives badges for uovoting and it’s possible other benefits I’m unaware of.
As we saw with reddit, uovotes systems can be inherently flawed, we have no way of knowing if that uovote is genuine.
I hear you. I firmly believe that comparing the behavior of GPT with that of certain individuals on SO is like comparing apples to oranges though.
GPT is a machine, and unlike human users on SO, it doesn’t harbor any intent to be exclusive or dismissive. The beauty of GPT lies in its willingness to learn and engage in constructive conversations. If it provides incorrect information, it is always open to being questioned and will readily explain its reasoning, allowing users to learn from the exchange.
In stark contrast, some users on SO seem to have a condescending attitude towards learners and are quick to shut them down, making it a challenging environment for those seeking genuine help. I’m sure that these individuals don’t represent the entire SO community, but I have yet to have a positive encounter there.
While GPT will make errors, it does so unintentionally, and the motivation behind its responses is to be helpful, rather than asserting superiority. Its non-judgmental approach creates a more welcoming and productive atmosphere for those seeking knowledge.
The difference between GPT and certain SO users lies in their intent and behavior. GPT strives to be inclusive and helpful, always ready to educate and engage in a constructive manner. In contrast, some users on SO can be dismissive and unsupportive, creating an unfavorable environment for learners. Addressing this distinction is vital to fostering a more positive and nurturing learning experience for everyone involved.
In my opinion this is what makes SO ineffective and is largely why it’s traffic had dropped even before chat GPT became publicly available.
Edit: I did use GPT to remove vitriol from and shorten my post. I’m trying to be nicer.
I don’t want to compare the behavior, only the quality of the answers. An unintentional error of ChatGPT is still an error, even when it’s delivered with a smile. I absolutely agree that the behavior of some SO users is detrimental and pushes people away.
I can also see ChatGPT (or whatever) as a solution to that - both as moderator and as source of solutions. If it knows the solution it can answer immediately (plus reference where it got it from), if it doesn’t know the solution it could moderate the human answers (plus learn from them).
That’s fair. You don’t have to compare the behavior. There’s plenty of that in the thread already.
I think I see a core issue highlighted in your comment that seems like a common theme in this comment section.
At least from where I’m sitting, SO is not and has never been a place for learning, as in a substitute for novices learning by reading a book or documentation. In my 12-year experience with it, I’ve always seen it as a place for professionals and semi-professionals of various experience and overlap sharing answers typically not found in the manual, which speeds up the pace of investigations and work by filling eachother’s gaps. Not a place where people with plenty of time on their hands and/or knack for teaching go to teach novices. Of course there are those people there too but that’s been rare occurrence in my experience. And so if a person expects to get a nice lesson instead of a terse answer from someone with 5 minutes or less, those expectations will be perpetually broken. For me that terse answer is enough more often than not and its accuracy is infinitely more important than the attitude used to say it.
I expect a terse answer. I also am a professional. My experience with SO users is that they do not behave professionally. There’s not much more to it.
Understandably, it has become an increasingly hostile or apatic environment over the years. If one checks questions from 10 years ago or so, one generally sees people eager to help one another.
Now they often expect you to have searched through possibly thousands of questions before you ask one, and immediately accuse you if you missed some – which is unfair, because a non-expert can often miss the connection between two questions phrased slightly differently.
On top of that, some of those questions and their answers are years old, so one wonders if their answers still apply. Often they don’t. But again it feels like you’re expected to know whether they still apply, as if you were an expert.
Of course it isn’t all like that, there are still kind and helpful people there. It’s just a statistical trend.
Possibly the site should implement an archival policy, where questions and answers are deleted or archived after a couple of years or so.
I can’t wait to read gems like “Answered 12/21/2005 you moron. Learn to search the website. No, I wont link it for you, this is not a Q&A website”.
Answers from 2005 that may not be remotely relevant anymore, especially if a language has seen major updates in the TWENTY YEARS since!
More important for frameworks than languages, IMO. Frameworks change drastically in the span of 5-10 years.
🤣
The worst is when you actually read all that questions and clearly stated how they don’t apply and that you already tried them and a mod is still closing your question as a duplicate.
No, they shouldn’t be archived. I say that because technology can change. At some point they added a new sort method which favors more recent upvotes and it helps more recent answers show above old ones with more votes. This can happen on very old posts where everyone else might not use the site anymore. We shouldn’t expect the original asker to switch the accepted answer potentially years down the line.
There’s plenty of things wrong with SE and their community but I don’t think this is one that needs to change.
human nature remembers negative experiences much better than positive, so it only takes like 5% assholes before it feels like everyone is toxic.
True that! and a change from 2% to 5% may feel much larger than that.
As alluded to by comments here already, a long coming death.
Will probably go down as a marker of the darker side of tech culture, which, not coincidentally (?) manifested at time when the field was most confused as to what constitutes its actual discipline and whether it was an engineering field at all.
Tried to answer a question got shutdown by mods immediately. I was wondering how stack overflow is going to survive. I know now it won’t.
If this and Reddit are going downhill, where will we look for our tech questions?! (/s, there will always be others)
My bets for the future:
- RTFM
- Have ChatGPT RTFM
- Read a book about general principles
- Ask ChatGPT to apply general principles to its own answer after RTFM, then ask it to double check it
- Spin up a VM, just try the thing. If it doesn’t work, ask ChatGPT why.
When everything else fails…
- Ask a question at any random place (SO, Reddit, Discord, Mastodon,Lemmy, etc.)
- Feed the answers to ChatGPT and have it summarize them, then double check its own answer
We may have to start reading the manuals!
@ryan659 Activity Pub.
Stack Exchange has been making a large number of bad calls over the past few years. Basically pissing off their moderators. The first one was Monica who actually sued them for it (libel or defamation or something, basically they said she was being transphobic or something when she wasn’t) and they settled. Around that time, possibly before, they removed a site from their Hot Network Questions because of a single tweet. Combine that with them constantly ignoring Stack Exchange Meta (where users and admins are meant to interact for the better of the site and discuss the sites themselves). Moderators were understandably furious when their posts get ignored in the place where Stack Exchange says they’re meant to communicate when a random tweet gets more attention and immediate action.
More recently they’ve given different instructions privately to moderators than what they said publicly with regards to suspected AI content.
I mean, combine all of that with how hostile the users of the site are. Accusing you of not searching before posting and marking your question as a duplicate because they think it is and refusing to listen to why you say it isn’t.
I’m sure they are bad, because general corporation and enshittification cycle, but when someone consistently mentions, “a single tweet” or something like that that they represent as purely innocuous (but without any explanation or link to source), gets my suspicious radar WAY up…
Your suspicion makes sense, let me provide some context.
(Quick aside for the unaware, not necessarily Snapz, Stack Exchange (SE) is the company and family of sites behind Stack Overflow. Stack Overflow is the biggest and was the first and that’s why it doesn’t have the same “Blah Exchange” branding.)
I think this answer on SE Meta describes the Tweets the best. I can’t find good archived links to the tweets and they seem to be deleted now. This answer has screenshots and quotes them. This answer is not the first thing that happens in chronological order but it is the best thing I’ve found with quotes of the tweets. So just go here to see what the tweets were. I guess it was actually about three and not just a single one like I remembered. Summary here,
stack exchange: the #1 site for your questions about dataframes and female treachery
normal website
- IPS: How to approach a friend about his girlfriend asking to sleep with me?
- IPS: How do I tell students at a school I volunteer at to stop flirting with me?
- SciFi: Story about aliens nicknamed ‘Eechees’ who have created a network of tunnels on Mars
2:37 PM - 16 Oct 2018
1 Retweet 38 Likes
Someone then retweeted that,
When people seem confused about why Stack Overflow might not be the most welcoming/comfortable place for people to find answers to programming questions, show them this
[The tweet from above]
This question on Interpersonal Skills (IPS) Meta is (as far as I can find) when the community at large first found out about what happened. Then later there was this question on SE Meta (which the earlier answer is in response to). Both of these posts have most of the context.
Feel free to look over as much as you want, I’ll just post some of the highlights proving the points I was talking about.
From the IPS Meta question, in this answer
Was the removal of this site from the [Hot Network Questions (HNQ)] in response to a Twitter complaint?
Yep.
Oh. Well, that seems… crummy.
Yep. Let me tell you about it.
The initial response to the tweet in an internal discussion wasn’t actually “let’s pull IPS out of the HNQ” it was “Maybe we should finally kill the HNQ or redesign it to make it better.” I think that reworking the HNQ is something that many people want to see - myself included. Should a tweet be the final straw when it’s been discussed so much over the years? No. Am I willing to be OK with that if it means something will change? Begrudgingly, yes… but that’s a separate issue.
[…]
It’s easy to panic and focus on optics instead of tenable solutions, and while it looks really drastic, pulling IPS from the HNQ was a pretty moderate response. Yes, it was a quick decision - like pulling your hand away from a hot stove when it burns. It was the solution we chose - without consulting IPS - because it was effective and easy to implement since it would fix the perceived problem immediately and there was already a technical solution in place for doing it.
[…]
We are going to have some internal discussions to improve how we respond in situations like this in the future. We don’t want Twitter - or Reddit or any other external site - to be where users go to get real change to happen on the network. We love our meta system - the child meta sites and Meta Stack Exchange - and we need those to be where people feel they can come to and get a response from us.
This comment explains the community’s feeling very well I believe.
The immediate response doesn’t set a great example and looks outwardly like we didn’t think things over. I think is a massive, almost impossibly massive understatement. I don’t know if you guys can ever recover any of the massive amount of community trust you lost that day. Finding out that yes, indeed, a twitter complaint is a more powerful force of site governance then months of meta discussions by the most engaged users of the site just means that there’s no point participating at all until whatever dynamic causes this is completly [sic] and provably wiped out.
Also this
[…] Removing IPS and only IPS based on the outrage of a few Twitter users is incredibly unfair to this community and sends a very strong signal that SE considers the opinions and efforts of valuable contributors practically worthless. If y’all do care about this site, then please act like it? […]
From the SE Meta question, this answer
[…]
What happened was that someone called SE out on Twitter for something you could conceivably see as problematic (two questions with out of context bad titles showing next to each other in that list). After that, not only was that change done within 40 minutes of it being pointed out, this happened after MONTHS of engaged users of that site asking for the HNQ to be adressed.
[Lemmy UI does not underline individual links, so here are the three links individually]
- https://interpersonal.meta.stackexchange.com/questions/1520/should-we-edit-titles-that-are-not-sufficiently-descriptive
- https://interpersonal.meta.stackexchange.com/questions/1291/should-we-step-up-our-voting-culture/1294#1294
- https://interpersonal.meta.stackexchange.com/questions/1314/moratorium-on-hot-network-questions-until-we-have-greater-control-over-content
Yet, this happens only after Twitter outrage from non-users of the site. Why is that? Even if you have the very best of intentions and had this cooking internally for a long time (which I’m going to just assume for the purposes of this argument - good faith and all), this couldn’t possibly have had less fortunate timing.
I’m not trying to rag on Stack Exchange for doing this, but why was such a massive change made without consulting, collecting feedback from or even notifying the site’s active user base? Why does an engaged user of IPS have to visit twitter of all places to find out SE has cut out more than half of their site’s traffic overnight?
Why wasn’t the community consulted on this? We had discussions on it before, a lot of people came down in favor of restricting IPS from showing up on the sidebar in some fashion or another, and now we get this. No feedback, no discussion. Someone that apparently SE wants to placate made a stink on Twitter, and somehow that’s more effective than months of constructive reasoning in driving change. What reason, if at all, does an engaged user of the site have to trust the community governance model with this?
If it sounds like I’m really annoyed by this its because I am, yes I was in favor of removing IPS from HNQ before, but the circumstances under which it happened is making me lose all hope I have for SE’s leadership’s ability to formulate concrete plans to make changes constructively.
Edit: Make individual links as bullet points in one of the quotes since Lemmy UI does not make it clear it is three links.
Edit 2: Add summary of the tweets so more context is on this post.
There’s an open source equivalent at https://codidact.com/
Thank you! never heard of, it looks very interesting!
deleted by creator
I routinely skip SO unless I’ve already exhausted most possibilities. If it was ever a good place to get answers, I frankly didn’t see it. What I did see was infinite amounts of bitching about “bad” questions, non-duplicate duplicates, lazy-ass people who just wanted an excuse not to answer, and assorted people tripping on their little iota of perceived “power”.
Hell, even the indexed results on Google etc. just stopped being even remotely useful a few years back. After that, most shit I searched for ended up in an unanswered and possibly locked question with some passive-aggressive bullshit remark. It’s got the culture of helpfulness of a 2003 gaming forum - except the people telling everyone else to go fuck themselves are mods, not pubertal kids. (Although if the mods were pubertal kids that would actually explain quite a bit)
This hasn’t been my experience at all, but I’m old and have been using SO since it was new.
I have stopped visiting it to answer questions because the questions aren’t interesting anymore. They’re either “how to do this incredibly obscure thing in SOMELIBRARY” (where I’ve never heard of that library) or “why does my function exit early at the first return statement instead of continuing on” (basic “you misunderstand programming so fundamentally a single answer is unlikely to help” kind of questions)
As far as I can tell, the range of “I’ve tried this, and partially gotten it working, but this thing does FOO when it should do BAR” questions don’t show up, or at least it doesn’t show up when I open the site.
Answering basic questions again and again and again isn’t fun. It’s something I could be paid to do, I suppose, but I’m not paid for that.
Seriously, how should a community based on short two- to three-paragraph answers react to question after question like this:
I am new to python. I would like to write a program which can collect information from multiple excel and pdf documents to output that in one single excel document to show similarities and differences between the documents . Is this possible ? If so, how and where would I start writing such a programme in python? Thanks
I haven’t tried anything yet
I mean, I’m glad that someone looks at that problem and thinks “programming could do this”, because it could, but it’s kind of a big task and getting someone from “I haven’t tried anything and am brand new to python” to that is beyond any question-and-answer forum. Welcome to programming, you may be able to get there, but it’s going to be a bit of a hike.
Mostly it seemed to be people who didn’t know what they were talking about answering questions badly in an attempt to win points, presumably in the belief that this would bolster their resume somehow. And people who can’t tell a good answer from a bad one voting on the answers.
In my experience many of the answers have become out of date. It’s gradually becoming an archive of the old ways of doing things for many languages / frameworks.
Questions are often closed as a duplicate when the linked question doesn’t apply anymore. It’s full of really bad ways of doing things.
I’m not really sure of the solution at this point.
Also ChatGPT.
It’s a last resort for me nowadays.
To be fair™ they did at least do a little bit to deal with the existing answers becoming obsolete by changing the default answer sorting. The “new” (it’s already been at least a year IIRC) sorting pushes down older answers and allows newer answers to rise to the top with fewer votes. That still doesn’t fix the issue that the accepted answer likely won’t change as new ways of doing things become standard, but at least it’s a step in the right direction.
One thing I’ve always wondered about stack overflow is why is there only one accepted answer ever possible even though this is programming and there are many different ways of doing any given thing?
Yeah, this is what they get and deserve. They rose by providing meaningful, helpful, and technically adept answers to questions. Then they encouraged an abusive moderator culture that marks questions as duplicate, linking to unrelated questions. They also still do not offer easy ways for the knowledge base to be updated as things over time change. Now the company abusing their abusive moderators, causing them to basically go on strike right now.
Here’s hoping the next thing doesn’t suck as much ass as Stack Exchange ultimately has.
https://en.m.wikipedia.org/wiki/Fediverse
Based on that, there is no “q&a” type of Fediverse software (a clear answer and a clear “voted best” answer).
Stack overflow had a huge number of “mod tools” to help curate the content (gold nuggets) given. They did not do the step of aggregating content (gold ingots) like Wikipedia has. The marking as duplicate could and should be tempered by “due diligence” or “age of the last time this was asked”, but how it is implemented is up to them.
Ironic, since one of ChatGPT’s biggest weaknesses is that it’s an archive of the old ways of doing things. You can’t filter by time on ChatGPT, and ChatGPT isn’t being retrained on the latest knowledge live. These aren’t inherent to GPT, so it’s possible that a future iteration will overcome these issues.
On ChatGPT, if a solution doesn’t work, you can ask in real time for a different one. On SO, your post just gets locked for being a duplicate.
Asking in real-time wouldn’t help in this scenario (e.g. some mirror is no longer accessible). If anything, it’d just lead you further astray and waste more time, because GPT’s knowledgebase doesn’t have this knowledge.
Rather than cultivate a friendly and open community, they decided to be hostile and closed. I am not surprised by this at all, but I am surprised with how long the decline has taken. I have a number of bad/silly experiences on stackoverflow that have never been replicated on any other platform.
Like what?
Honestly I have a question I answered myself and was up for over 10 years with hundreds of views and votes only for the question to be marked as a duplicate for a question that verboten has nothing to do with the question I asked. Specifically I was working with canvas and svg and the question linked was neither thing. The other question is also 5 years newer so even if it were the same it would be a duplicate of mine, not the other way around.
Another one is a very high rated answer I gave was edited by a big contributor to add a participle several years after I wrote it and then marked as belonging to them now
Can you give more context on the second one? Everyone can edit posts and it shows both the original poster as well as the most recent editor on the post. (I’m not defending SE. I dislike them too.)
Both times i issued a dispute only for it to be completely ignored. Eventually I used a scrubber bot to delete every contribution I ever made instead of letting random power mods just steal content on my high profile posts.
deleted by creator
Why is everyone saying this is because Stack Overflow is toxic? Clearly the decline in traffic is because of ChatGPT. I can say from personal experience that I’ve been visiting Stack Overflow way less lately because ChatGPT is a better tool for answering my software development questions.
I was going to say ChatGPT.
I think the smugness of StackOverflow is still part of it. Even if ChatGPT sometimes fabricates imaginary code, it’s tone is flowery and helpful, compared to the typical pretentiousness of Stackoverflow users.
Also, you can have it talk like a catgirl maid, so I find that’s particularly helpful as well.
ChatGPT works very well (and patiently) when the person asking the question is asking one that has been answered a thousand times before on Stack Overflow.
Stack Overflow works poorly when google search results for it have been declining in quality over the years and it gets cluttered with duplicate (and unanswered) content that isn’t removed in a timely manner to keep the people who answer questions with quality material (not “try {code}. Hope this helps.”).
For an individual who is unsure about what to ask or how to ask, ChatGPT can walk them through the common problems much more easily and with better (and prompt) feedback compared to trying to get someone to help in the constant scrolling of the new questions feed.
On the other hand, if you are able to ask the question well, and have something sufficiently interesting that requires human eyes, ChatGPT becomes less useful while Stack Overflow becomes more useful.
In my experience, ChatGPT is very good at interpreting documentation. So even if it hasn’t been asked on stack overflow, if it’s in the documentation that ChatGPT has indexed (or can crawl with an extension) you’ll get a pretty solid answer. I’ve been asking it a lot of AWS questions because it’s 100x better than deciphering the ancient texts that amazon publishes. Although sometimes the AWS docs are just wrong anyway.
The timing doesn’t really add up though. ChatGPT was published in November 2022. According to the graphs on the website linked, the traffic, the number of posts and the number of votes all already were in a visible downfall and at their lowest value of more than 2 years. And this isn’t even considering that ChatGPT took a while to get picked up into the average developer’s daily workflow.
Anyhow though, I agree that the rise of ChatGPT most likely amplified StackOverflow’s decline.
Over the last five years, I’d click a link to Stack Overflow while googling, but I’ve never made an account because of the toxicity.
But yeah, chatGPT is definitely the nail in the coffin. Being able to give it my code and ask it to point out where the annoying bug is… is amazing.
Half the time when I ask it for advice, ChatGPT recommends nonexistent APIs and offers examples in some Frankenstein code that uses a bit of this system and a bit of that, none of which will work. But I still find its hit rate to be no worse than Stack Overflow, and it doesn’t try to humiliate you for daring to ask.
Your follow up question should be for ChatGPT to write those APIs for you.
It depends on what sort of thing you’re asking about. More obscure languages and systems will result in hallucinated APIs more often. If it’s something like “how do I sort this list of whatever in some specific way in C#” or “can you write me a regex for such and such a task” then it’s far more often right. And even when ChatGPT gets something wrong, if you tell it the error you encountered from the code it’ll usually be good at correcting itself.
I find that if it gets it wrong in the first place, its corrections are often equally wrong. I guess this indicates that I’ve strayed into an area where its training data is not of good quality.
Yeah, if it’s in a state where it’s making up imaginary APIs whole cloth then in my experience you’re asking it for help with something it just doesn’t know enough about. I get the best results when I’m asking about popular stuff (such as “write me a python script to convert wav files to mp3” - it’ll know the right APIs for that sort of task, generally speaking). If I’m working on something that’s more obscure then sometimes it’s better to ask ChatGPT for generalized versions of the actual question. For example, I was tinkering with a mod for Minetest a while back that was meant to import .obj models and convert them into a voxelized representation of the object in-game. ChatGPT doesn’t know Minetest’s API very well, so I was mostly asking it for Lua code to convert the .obj into a simple array of voxel coordinates and then doing the API stuff to make it Minetest-specific for myself. The vector math was the part that ChatGPT knew best so it did an okay job on its part of the task.
