Skip Navigation

The Fall of Stack Overflow

observablehq.com The Fall of Stack Overflow

Over the past one and a half years, Stack Overflow has lost around 50% of its traffic. This decline is similarly reflected in site usage, with approximately a 50% decrease in the number of questions and answers, as well as the number of votes these posts receive. The charts below show the usage repr...

The Fall of Stack Overflow

Over the past one and a half years, Stack Overflow has lost around 50% of its traffic. This decline is similarly reflected in site usage, with approximately a 50% decrease in the number of questions and answers, as well as the number of votes these posts receive.

The charts below show the usage represented by a moving average of 49 days.


What happened?

tech Technology @kbin.social

The Fall of Stack Overflow

22 11
InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)TE
TechNews @radiation.party

The Fall of Stack Overflow

2 0
260 comments
  • Amazing how much hate SO receives here. As knowledge base it's working super good. And yes, a lot of questions have been answered already. And also yes, just like any other online community there's bad apples which you have to live with unfortunately.

    Idolizing ChatGPT as a viable replacementis laughable, because it has no knowledge, no understanding, of what it says. It's just repeating what it "learned" and connected. Ask about something new and it will simply lie, which is arguably worse than an unfriendly answer in my opinion.

    • The advice on stack overflow is trash because "that question has been answered already" yeah, it was answered 10 years ago on a completely different version. That answer is depreciated.

      Not to mention the amount of convoluted answers that get voted to the top and then someone with two upvotes at the bottom meekly giving the answer that you actually needed.

      It's like that librarian from the New York public library who determined whether or not children's books would even get published.

      She gave "good night moon" a bad score and it fell out of popularity for 30 years after the author died.

    • Explains the huge swaths of bad advice shared on Reddit though. It's shared confidently and with a smile. Positive vibes only!

      • What's "Reddit"?

        (I removed all my advice from there when it was considered "violent content" and "sexualization of minors"... go find your 3d printing, programming, system management and chemistry tips elsewhere, I did it anyway)

    • I hear you. I firmly believe that comparing the behavior of GPT with that of certain individuals on SO is like comparing apples to oranges though.

      GPT is a machine, and unlike human users on SO, it doesn't harbor any intent to be exclusive or dismissive. The beauty of GPT lies in its willingness to learn and engage in constructive conversations. If it provides incorrect information, it is always open to being questioned and will readily explain its reasoning, allowing users to learn from the exchange.

      In stark contrast, some users on SO seem to have a condescending attitude towards learners and are quick to shut them down, making it a challenging environment for those seeking genuine help. I'm sure that these individuals don't represent the entire SO community, but I have yet to have a positive encounter there.

      While GPT will make errors, it does so unintentionally, and the motivation behind its responses is to be helpful, rather than asserting superiority. Its non-judgmental approach creates a more welcoming and productive atmosphere for those seeking knowledge.

      The difference between GPT and certain SO users lies in their intent and behavior. GPT strives to be inclusive and helpful, always ready to educate and engage in a constructive manner. In contrast, some users on SO can be dismissive and unsupportive, creating an unfavorable environment for learners. Addressing this distinction is vital to fostering a more positive and nurturing learning experience for everyone involved.

      In my opinion this is what makes SO ineffective and is largely why it's traffic had dropped even before chat GPT became publicly available.

      Edit: I did use GPT to remove vitriol from and shorten my post. I'm trying to be nicer.

      • I think I see a core issue highlighted in your comment that seems like a common theme in this comment section.

        At least from where I'm sitting, SO is not and has never been a place for learning, as in a substitute for novices learning by reading a book or documentation. In my 12-year experience with it, I've always seen it as a place for professionals and semi-professionals of various experience and overlap sharing answers typically not found in the manual, which speeds up the pace of investigations and work by filling eachother's gaps. Not a place where people with plenty of time on their hands and/or knack for teaching go to teach novices. Of course there are those people there too but that's been rare occurrence in my experience. And so if a person expects to get a nice lesson instead of a terse answer from someone with 5 minutes or less, those expectations will be perpetually broken. For me that terse answer is enough more often than not and its accuracy is infinitely more important than the attitude used to say it.

      • I don't want to compare the behavior, only the quality of the answers. An unintentional error of ChatGPT is still an error, even when it's delivered with a smile. I absolutely agree that the behavior of some SO users is detrimental and pushes people away.

        I can also see ChatGPT (or whatever) as a solution to that - both as moderator and as source of solutions. If it knows the solution it can answer immediately (plus reference where it got it from), if it doesn't know the solution it could moderate the human answers (plus learn from them).

  • I think the issue is how people got to Stack Overflow. People generally ask Google first, which hopefully would take you somewhere where somebody has already asked your question and it has answers.

    Type a technical question into Google. Back in the day it would likely take you to Experts Exchange. Couple of years later it would take you to Stack Overflow. Now it takes you to some AI generated bullshit that scraped something that might have contained an answer, but was probably just more AI generated bullshit.

    Either their SEO game is weak, they stopped paying Google as much for result placement, or they've just been overwhelmed with limitless nonsense made by bots for the sole purpose of selling advertising space that other bots will look at.

    Or maybe I'm wrong and everybody is just asking ChatGPT their technical questions now, in which case god fucking help us all...

  • It's hostile to new users and when you do ask you will likely not get answer might get scolded or just get closed as duplicate. Then there is the fact that most has answers doesn't matter if it's outdated or just bad advice. Pretty much everything has GitHub now. Usually I just go raise the question there if I have a genuine question get an answer from the developers themselves. Or just go to their website api/ library doc they have gotten good lately. Then finally recent addition with chatgpt you can ask just about any stupid question you have and maybe it may give some idea to fix the problem you encounter. Pretty much the ultimate rubber duck buddy.

  • It's too much to attribute to any one effect. 50% is a lot for a website of this size (don't forget that Lemmy exploded from a migration of <5% Reddit usershare). Let's KISS by attributing likely causes in order of magnitude:

    1. ChatGPT became the world's fastest growing website in a single month and it's actually half-decent at being a code tutor
    2. ChatGPT bots got unleashed on SO and diluted a lot of SO's comparative advantages
    3. Stack Overflow moderators went on strike, which further damaged content quality
    4. Structurally speaking, SO is an environment which tends to become more elitist over time. As the userbase becomes progressively more self-selective, the population shrinks.
    5. The SO format requires a stream of novel questions, but novel questions generally get rarer over time
    6. Developer documentation has generally improved over time. On SO, asking about a well-documented thing is a short-circuit pathway to getting RTFM'd & discussion locked
  • One aspect that I've always been unsure about, with Stack Overflow, and even more with sibling sites like Physics Stack Exchange or Cross Validated (stats and probability), is the voting system. In the physics and stats sites, for example, not rarely I saw answers that were accepted and upvoted but actually wrong. The point is that users can end up voting for something that looks right or useful, even if it isn't (probably less the case when it comes to programming?).

    Now an obvious reply to this comment is "And how do you know they were wrong, and non-accepted ones right?". That's an excellent question – and that's exactly the point.

    In the end the judge about what's correct is only you and your own logical reasoning. In my opinion this kind of sites should get rid of the voting or acceptance system, and simply list the answers, with useful comments and counter-comments under each. When it comes to questions about science and maths, truth is not determined by majority votes or by authorities, but by sound logic and experiment. That's the very basis from which science started. As Galileo put it:

    But in the natural sciences, whose conclusions are true and necessary and have nothing to do with human will, one must take care not to place oneself in the defense of error; for here a thousand Demostheneses and a thousand Aristotles would be left in the lurch by every mediocre wit who happened to hit upon the truth for himself.

    For example, at some point in history there was probably only one human being on earth who thought "the notion of simultaneity is circular". And at that time point that human being was right, while the majority who thought otherwise were wrong. Our current education system and sites like those reinforce the anti-scientific view that students should study and memorize what "experts" says, and that majorities dictate what's logically correct or not. As Gibson said (1964): "Do we, in our schools and colleges, foster the spirit of inquiry, of skepticism, of adventurous thinking, of acquiring experience and reflecting on it? Or do we place a premium on docility, giving major recognition to the ability of the student to return verbatim in examinations that which he has been fed?"

    Alright sorry for the rant and tangent! I feel strongly about this situation.

  • Tried to answer a question got shutdown by mods immediately. I was wondering how stack overflow is going to survive. I know now it won't.

  • Stack Exchange has been making a large number of bad calls over the past few years. Basically pissing off their moderators. The first one was Monica who actually sued them for it (libel or defamation or something, basically they said she was being transphobic or something when she wasn't) and they settled. Around that time, possibly before, they removed a site from their Hot Network Questions because of a single tweet. Combine that with them constantly ignoring Stack Exchange Meta (where users and admins are meant to interact for the better of the site and discuss the sites themselves). Moderators were understandably furious when their posts get ignored in the place where Stack Exchange says they're meant to communicate when a random tweet gets more attention and immediate action.

    More recently they've given different instructions privately to moderators than what they said publicly with regards to suspected AI content.

    I mean, combine all of that with how hostile the users of the site are. Accusing you of not searching before posting and marking your question as a duplicate because they think it is and refusing to listen to why you say it isn't.

    • I'm sure they are bad, because general corporation and enshittification cycle, but when someone consistently mentions, "a single tweet" or something like that that they represent as purely innocuous (but without any explanation or link to source), gets my suspicious radar WAY up...

      • Your suspicion makes sense, let me provide some context.

        (Quick aside for the unaware, not necessarily Snapz, Stack Exchange (SE) is the company and family of sites behind Stack Overflow. Stack Overflow is the biggest and was the first and that's why it doesn't have the same "Blah Exchange" branding.)

        I think this answer on SE Meta describes the Tweets the best. I can't find good archived links to the tweets and they seem to be deleted now. This answer has screenshots and quotes them. This answer is not the first thing that happens in chronological order but it is the best thing I've found with quotes of the tweets. So just go here to see what the tweets were. I guess it was actually about three and not just a single one like I remembered. Summary here,

        stack exchange: the #1 site for your questions about dataframes and female treachery

        normal website

        • IPS: How to approach a friend about his girlfriend asking to sleep with me?
        • IPS: How do I tell students at a school I volunteer at to stop flirting with me?
        • SciFi: Story about aliens nicknamed 'Eechees' who have created a network of tunnels on Mars

        2:37 PM - 16 Oct 2018

        1 Retweet 38 Likes

        Someone then retweeted that,

        When people seem confused about why Stack Overflow might not be the most welcoming/comfortable place for people to find answers to programming questions, show them this

        [The tweet from above]

        This question on Interpersonal Skills (IPS) Meta is (as far as I can find) when the community at large first found out about what happened. Then later there was this question on SE Meta (which the earlier answer is in response to). Both of these posts have most of the context.

        Feel free to look over as much as you want, I'll just post some of the highlights proving the points I was talking about.

        From the IPS Meta question, in this answer

        Was the removal of this site from the [Hot Network Questions (HNQ)] in response to a Twitter complaint?

        Yep.

        Oh. Well, that seems... crummy.

        Yep. Let me tell you about it.

        The initial response to the tweet in an internal discussion wasn't actually "let's pull IPS out of the HNQ" it was "Maybe we should finally kill the HNQ or redesign it to make it better." I think that reworking the HNQ is something that many people want to see - myself included. Should a tweet be the final straw when it's been discussed so much over the years? No. Am I willing to be OK with that if it means something will change? Begrudgingly, yes... but that's a separate issue.

        [...]

        It's easy to panic and focus on optics instead of tenable solutions, and while it looks really drastic, pulling IPS from the HNQ was a pretty moderate response. Yes, it was a quick decision - like pulling your hand away from a hot stove when it burns. It was the solution we chose - without consulting IPS - because it was effective and easy to implement since it would fix the perceived problem immediately and there was already a technical solution in place for doing it.

        [...]

        We are going to have some internal discussions to improve how we respond in situations like this in the future. We don't want Twitter - or Reddit or any other external site - to be where users go to get real change to happen on the network. We love our meta system - the child meta sites and Meta Stack Exchange - and we need those to be where people feel they can come to and get a response from us.

        This comment explains the community's feeling very well I believe.

        The immediate response doesn't set a great example and looks outwardly like we didn't think things over. I think is a massive, almost impossibly massive understatement. I don't know if you guys can ever recover any of the massive amount of community trust you lost that day. Finding out that yes, indeed, a twitter complaint is a more powerful force of site governance then months of meta discussions by the most engaged users of the site just means that there's no point participating at all until whatever dynamic causes this is completly [sic] and provably wiped out.

        Also this

        [...] Removing IPS and only IPS based on the outrage of a few Twitter users is incredibly unfair to this community and sends a very strong signal that SE considers the opinions and efforts of valuable contributors practically worthless. If y'all do care about this site, then please act like it? [...]

        From the SE Meta question, this answer

        [...]

        What happened was that someone called SE out on Twitter for something you could conceivably see as problematic (two questions with out of context bad titles showing next to each other in that list). After that, not only was that change done within 40 minutes of it being pointed out, this happened after MONTHS of engaged users of that site asking for the HNQ to be adressed.

        [Lemmy UI does not underline individual links, so here are the three links individually]

        1. https://interpersonal.meta.stackexchange.com/questions/1520/should-we-edit-titles-that-are-not-sufficiently-descriptive
        2. https://interpersonal.meta.stackexchange.com/questions/1291/should-we-step-up-our-voting-culture/1294#1294
        3. https://interpersonal.meta.stackexchange.com/questions/1314/moratorium-on-hot-network-questions-until-we-have-greater-control-over-content

        Yet, this happens only after Twitter outrage from non-users of the site. Why is that? Even if you have the very best of intentions and had this cooking internally for a long time (which I'm going to just assume for the purposes of this argument - good faith and all), this couldn't possibly have had less fortunate timing.

        I'm not trying to rag on Stack Exchange for doing this, but why was such a massive change made without consulting, collecting feedback from or even notifying the site's active user base? Why does an engaged user of IPS have to visit twitter of all places to find out SE has cut out more than half of their site's traffic overnight?

        Why wasn't the community consulted on this? We had discussions on it before, a lot of people came down in favor of restricting IPS from showing up on the sidebar in some fashion or another, and now we get this. No feedback, no discussion. Someone that apparently SE wants to placate made a stink on Twitter, and somehow that's more effective than months of constructive reasoning in driving change. What reason, if at all, does an engaged user of the site have to trust the community governance model with this?

        If it sounds like I'm really annoyed by this its because I am, yes I was in favor of removing IPS from HNQ before, but the circumstances under which it happened is making me lose all hope I have for SE's leadership's ability to formulate concrete plans to make changes constructively.


        Edit: Make individual links as bullet points in one of the quotes since Lemmy UI does not make it clear it is three links.

        Edit 2: Add summary of the tweets so more context is on this post.

  • As alluded to by comments here already, a long coming death.

    Will probably go down as a marker of the darker side of tech culture, which, not coincidentally (?) manifested at time when the field was most confused as to what constitutes its actual discipline and whether it was an engineering field at all.

  • As long as a LLM doesn't run into a corner, making the same mistakes over and over again, it is magical to just paste some code, ask what's wrong with it and receiving a detailed explanation + fix. Even better is when you ask "now can you add this and this to it?" and it does.

260 comments