Now I understand why at each windows 11 update, they introduce more bugs than ever

  • @[email protected]
    link
    fedilink
    English
    37818 days ago

    Horseshit.

    The current state of code generated by AI is sketchy at best. I often get plain wrong answers because the model tries to derive. It comes up with calls to functions and properties that just do not exist.

    “You are right, I made a mistake. Here is a better answer.” Continues to give wrong answers.

    Apart from that, apps that are glued together from AI generated code are not maintainable at all. What if there is a bug somewhere and you so not comprehend what is actually happening? Ask AI to fix it? Yeah good luck with that.

    I do use AI for simple questions, and it works fairly well for that, but this claim by MS is just marketing bullshit.

    • @[email protected]
      link
      fedilink
      English
      11918 days ago

      This ^

      “20%-30% of code inside the company’s repositories”

      Now, if they had said “20%-30% of code written in the past 6 months…” I might buy that.

      The repositories are going to have all the current codebase, likely going back years now. AI generated code is barely viable at this point and really only pretty recently.

      No way 1/3rd of all current codebase is AI.

      • @[email protected]
        link
        fedilink
        English
        5418 days ago

        Even 20% of new code would be a stretch unless they count every first iteration of code written by AI that needs to be replaced by a human later because it was plain wrong.

    • @[email protected]
      link
      fedilink
      English
      1718 days ago

      I didn’t RTA, but if they mean ALL code at MS, that just can’t be true. They have legacy stuff going back decades, beyond just their windows platform. There’s no way 30% of all their code is replaced or newly created by AI.

    • @[email protected]
      link
      fedilink
      English
      3018 days ago

      They say that because they are selling it.

      And yeah, my experience is the same. The most frustrating is when writing in a typed python, and it gives answers that are clearly incorrect, making up attributes that don’t even exist etc.

      • Balder
        link
        fedilink
        English
        1118 days ago

        My brother said his superior asked him to use more AI auto complete so that they can brag to investors that X percent of the company’s code is written by AI. This told me everything about the current state of this bullshit.

    • @[email protected]
      link
      fedilink
      English
      1118 days ago

      “You are right, I made a mistake. Here is a better answer.” Continues to give wrong answers

      The exact same wrong answer. Co-Pilot is especially bad for that. I’m practically giving up using it outside of vs code because the actual copilot AI is dog shit stupid m

    • @[email protected]
      link
      fedilink
      English
      4
      edit-2
      17 days ago

      “You are right, I made a mistake. Here is a better answer.” Continues to give wrong answers.

      To be fair, the AI’s not wrong. It’s probably better, but just a teeny tiny bit so.

      Honestly, AI is like a genie - whatever you come up with he’ll just butcher and misinterpret so you start questioning both your own sanity and the semantics of language. Good thing these genies have no wish limit, but bad thing that they murder rainforests while generating their non-sequitur replies.

    • fmstrat
      link
      fedilink
      English
      518 days ago

      “Auto complete generated 30% of characters”

      Fixed it.

    • nickwitha_k (he/him)
      link
      fedilink
      English
      116 days ago

      I do use AI for simple questions, and it works fairly well for that, but this claim by MS is just marketing bullshit.

      This is my experience. It can be useful for simple things that used to be found with a web search before AI slop broke things. For example, I was having trouble getting a simple CGO program for a POC to communicate with the main Go process. This should have been solvable easily with documentation but the CGO docs are pretty bad and sample code was near impossible to find due to AI slop in the search results. GPT was able to provide the needed sample code to unblock me.

  • @[email protected]
    link
    fedilink
    English
    159
    edit-2
    18 days ago

    He used the words “written by software”. This is ambiguous and doesn’t mean AI, for example, using annotations for variables and generating the getters and setters would count. Right click and create function body for interface function definitions also.

    They’re exaggerating to pretend their AI is more useful than it is.

    • @[email protected]
      link
      fedilink
      English
      4718 days ago

      Intellisense in visual studio has also been really good for over a decade. Which is technically also written by software and not me.

      • @[email protected]
        link
        fedilink
        English
        1318 days ago

        I mean, really good intellisense is a great improvement, but it’s not replacing devs any time soon.

  • @[email protected]
    link
    fedilink
    English
    3318 days ago

    This only makes sense if they are counting intellisense auto complete as “AI written”

    • @[email protected]
      link
      fedilink
      English
      918 days ago

      Has to be something like that. Nadella is somehow cheating with the number, trying to keep the AI hype going.

      You could say ALL of my latest scripts were written with AI. Because I often use it to get a hint or gather some boilerplate code (which I still go over and modify).

    • @[email protected]
      link
      fedilink
      English
      218 days ago

      Was the auto complete in visual studio not a “trained” set before the llm craze kicked off? Would not surprise me if they decided to include that.

  • @[email protected]
    link
    fedilink
    English
    2018 days ago

    This makes sense and would explain the mainline windows versioning and probably the xbox versioning too!

    Microsoft to AI: List all the integers from one to eleven.

    AI: 3. 95. 98. 2000. XP. Vista. 7. 8. 10. 11.

  • @[email protected]
    link
    fedilink
    English
    21
    edit-2
    17 days ago

    Windows hate train looks fun, but as someone who works in the industry, most of that code is probably just unit tests and boilerplate stuff.

    Copilot is decent at quickly writing huge amounts of mostly correct, tedious unit test code, depending on your language/framework. And since Microsoft works with languages like C# and .NET for their native apps, and likely backend too, there is quite a bit of verbosity that Copilot can take care of. Also, documentation might count as well.

    No real code is AI-generated. He’s just saying shit like this to keep idiot investors happy.

    • @[email protected]
      link
      fedilink
      English
      217 days ago

      Isn’t that the problem tho. He’s the CEO of Microsoft which is supposed to be a bight end technology firm saying bullshit

      • @[email protected]
        link
        fedilink
        English
        217 days ago

        Operations are one thing, but investors are another. The latter don’t know the sector, but they want profits.

        So you have to convince them not to interfere with your activities, because they can make things worse.

    • @[email protected]
      link
      fedilink
      English
      417 days ago

      I’d guess it’s mostly the AI autocomplete stuff. I.e. you keep on typing until the AI guesses it right then press tab to save keystrokes. LLMs are really bad at making test cases in my experience; they, ironically, can’t do the simple but nuanced computations needed to figure out what the output should be given the inputs, or to recognize and test the edge cases.

      • @[email protected]
        link
        fedilink
        English
        117 days ago

        Oh yeah it can’t do anything complicated, only on simple modules. And I usually give it pretty detailed instructions on my expected I/O. It just converts a few sentences of English to dozens of lines of code.

  • @[email protected]
    link
    fedilink
    English
    1417 days ago

    If they start with those products today with zero marketing budged and zero user base nobody would use it. Those CEOs are just clowns.

    • @[email protected]
      link
      fedilink
      English
      817 days ago

      Microsoft CEO Satya Nadella said that 20% to 30% of code inside the company’s repositories was “written by software” — meaning AI.

      Nadella gave the figure after Zuckerberg asked roughly how much of Microsoft’s code is AI generated today.

      I highlighted part of the article for you.

    • @[email protected]
      link
      fedilink
      English
      117 days ago

      I vaguely remember talk about companies like Google having software that fixes/writes code and that was ages before LLMs.

  • @[email protected]
    link
    fedilink
    English
    3117 days ago

    Government spyware finally has a challenger for the title of “primary reason that most Microsoft software runs like hot garbage”.

  • @[email protected]
    link
    fedilink
    English
    4118 days ago

    I bet they’re counting code written while someone had an AI plugin installed as “written by AI” and I bet that accounts for almost all of that 30%. On top of that, I’m betting that they made it mandatory to have such a plug in, and the other 70% is just code written before they mandated this.

    • @[email protected]
      link
      fedilink
      English
      818 days ago

      Also, having 1/3 lines with obvious code that can be auto suggested correctly would make sense, but that is hardly code “written by ai” in the way they suggest.

      • @[email protected]
        link
        fedilink
        English
        218 days ago

        Those are the easy time savings though, the safe easy stuff the developer doesn’t have to worry about anymore. (Giving them time do the gnarly stuff)

        • @[email protected]
          link
          fedilink
          English
          518 days ago

          It is exactly the opposite, with simple, predictable auto-complete you didn’t have to worry about that anymore, with LLMs you always have to look at it in detail because every little thing could be just plain completely different and wrong.

          • @[email protected]
            link
            fedilink
            English
            218 days ago

            I can read way faster than I can type though. You still check it, but it’s pretty good as that kind of stuff once you have an example for it to follow.

            • @[email protected]
              link
              fedilink
              English
              518 days ago

              Reading code is usually orders of magnitude slower than writing code. Sure, typing might be slower than reading but to check if it is what you intended you have to understand it too.

              • @[email protected]
                link
                fedilink
                English
                118 days ago

                Well, I’m generally very anti-LLM but as a library author in Java it has been very helpful to create lots of similar overloads/methods for different types and filling in the corresponding documentation comments. I’ve already done all the thinking and I just need to check that the overload makes the right call or does the same thing that the other ones do – in that particular case, it’s faster. But if I myself don’t know yet how I’m going to do something, I would never trust an AI to tell me.

                • @[email protected]
                  link
                  fedilink
                  English
                  118 days ago

                  Well, okay, I can see how it would be useful in languages like Java that are extremely verbose and have a low expressiveness. Writing Java pretty much was already IDEs with code generation 20 years or so ago because nobody wants to write so much boilerplate by hand.

      • @[email protected]
        link
        fedilink
        English
        618 days ago

        I’d guess a lot of the people writing the code don’t even have it turned on, it’s just installed because management said it had to be, because management wants to be able to tell investors they’re “innovating work flows”.

        • bluGill
          link
          fedilink
          218 days ago

          Every few months I turn it on for a few days just to see if it is better.

          Then I go back to the old AST based autocomplete that actually knows something useful about my code.

        • Balder
          link
          fedilink
          English
          2
          edit-2
          18 days ago

          I am a small sample to confirm that’s exactly the reason in my brother’s company.

          And in my company we’re pressured to make X prompts every week to the company’s own ChatGPT wrapper to show we’re being productive. Even our profit shares have a KPO attached to that now. So many people just type “Hello there” every morning to count as another interaction with the AI.

    • @[email protected]
      link
      fedilink
      English
      1718 days ago

      I would be very surprised if 30% of their code lines had even been touched at all by anyone since AI coding assistants became a thing.

      • @[email protected]
        link
        fedilink
        English
        318 days ago

        I could see stuff getting small changes and them claiming that the entirety of the new version is “written by AI”.

      • @[email protected]
        link
        fedilink
        English
        7
        edit-2
        18 days ago

        I wish this shot from The Terminator had the camera showing Sarah Conner’s face instead of Reese’s, because it’d be such an appropriate meme image on multiple levels for when someone makes a misleading claim about some current AI system.

  • kate
    link
    fedilink
    English
    818 days ago

    ??? No it’s not! Can investors sue because this is such an obvious lie? Pls I have 0.3 Microsoft shares

    • kate
      link
      fedilink
      English
      318 days ago

      Are they including code generated to test their own models capability maybe?

  • Phoenixz
    link
    fedilink
    English
    2218 days ago

    I’m still forced to use Microsoft Outlook and teams, unfortunately, and boy oh boy is it bad.

    Yesterday i spent 45 minutes of a 1,5 meeting (that would have been 45 minutes) on trying teams to please try and use the right microphone, please share a screen (not working under Firefox or chrome now, apparently)

    I can’t wait for the day that I have some time to get us off that dog shit

    • @[email protected]
      link
      fedilink
      English
      418 days ago

      I love that Outlook occasionally fires up one of its keyboard shortcuts and clears your entire email you were typing if you’re not paying attention.

      Fucking love it.

    • Lemminary
      link
      fedilink
      English
      418 days ago

      not working under Firefox

      Weird

      or chrome

      Oh, there it is

      Feature exclusive, huh!

    • @[email protected]
      link
      fedilink
      English
      318 days ago

      Outlook is pretty damned bullet proof, Teams, OTOH, is a fucking mess. I can see IT wanting to keep everything in the same ecosystem, that’s perfectly sane, but I’m certain Zoom can be setup to honor AD credentials. We set it to use Google SSO.

      • @[email protected]
        link
        fedilink
        English
        618 days ago

        Ha, yeah my Outlook will randomly just not be able to connect to server when starting up. This is from fresh boot every day, some days it just can’t, have to reboot and then it works! Fucking brilliant, they managed to break email.