Microsoft CEO says up to 30% of the company's code was written by AI | TechCrunch
Microsoft CEO Satya Nadella said that 20%-30% of code inside the company's repositories is "written by software," meaning AI.
Now I understand why at each windows 11 update, they introduce more bugs than ever
Horseshit.
The current state of code generated by AI is sketchy at best. I often get plain wrong answers because the model tries to derive. It comes up with calls to functions and properties that just do not exist.
"You are right, I made a mistake. Here is a better answer." Continues to give wrong answers.
Apart from that, apps that are glued together from AI generated code are not maintainable at all. What if there is a bug somewhere and you so not comprehend what is actually happening? Ask AI to fix it? Yeah good luck with that.
I do use AI for simple questions, and it works fairly well for that, but this claim by MS is just marketing bullshit.
This ^
"20%-30% of code inside the company’s repositories"
Now, if they had said "20%-30% of code written in the past 6 months..." I might buy that.
The repositories are going to have all the current codebase, likely going back years now. AI generated code is barely viable at this point and really only pretty recently.
No way 1/3rd of all current codebase is AI.
"Please move all comments from in-line to the line above, and add a separator line"
They mean new code, as per the article. And they mean code gen and IntelliSence
They say that because they are selling it.
And yeah, my experience is the same. The most frustrating is when writing in a typed python, and it gives answers that are clearly incorrect, making up attributes that don't even exist etc.
My brother said his superior asked him to use more AI auto complete so that they can brag to investors that X percent of the company’s code is written by AI. This told me everything about the current state of this bullshit.
I didn’t RTA, but if they mean ALL code at MS, that just can’t be true. They have legacy stuff going back decades, beyond just their windows platform. There’s no way 30% of all their code is replaced or newly created by AI.
"You are right, I made a mistake. Here is a better answer." Continues to give wrong answers
The exact same wrong answer. Co-Pilot is especially bad for that. I'm practically giving up using it outside of vs code because the actual copilot AI is dog shit stupid m
It would explain the constant barrage of system breaking bugs and RCE vulns
Turns out they have been using AI for decades.
"Auto complete generated 30% of characters"
Fixed it.
"You are right, I made a mistake. Here is a better answer." Continues to give wrong answers.
To be fair, the AI's not wrong. It's probably better, but just a teeny tiny bit so.
Honestly, AI is like a genie - whatever you come up with he'll just butcher and misinterpret so you start questioning both your own sanity and the semantics of language. Good thing these genies have no wish limit, but bad thing that they murder rainforests while generating their non-sequitur replies.
I do use AI for simple questions, and it works fairly well for that, but this claim by MS is just marketing bullshit.
This is my experience. It can be useful for simple things that used to be found with a web search before AI slop broke things. For example, I was having trouble getting a simple CGO program for a POC to communicate with the main Go process. This should have been solvable easily with documentation but the CGO docs are pretty bad and sample code was near impossible to find due to AI slop in the search results. GPT was able to provide the needed sample code to unblock me.
Ah but it was nice for a minute imagining microsoft vibe coding windows...
He used the words "written by software". This is ambiguous and doesn't mean AI, for example, using annotations for variables and generating the getters and setters would count. Right click and create function body for interface function definitions also.
They're exaggerating to pretend their AI is more useful than it is.
Intellisense in visual studio has also been really good for over a decade. Which is technically also written by software and not me.
I mean, really good intellisense is a great improvement, but it's not replacing devs any time soon.
People have been using annotations to generate code since I rode my dinosaur to work.
Don't forget code generation for stuff like bindings or database schemes
So the CEO is trying to tell investors that they are saving money by not paying employees. But to me it sounds more like: we are letting our sub-par products continue to enshitify, and any other company using AI to program will be equal competition.
I think he's trying to say that their AI writes code good enough for Microsoft. Which is a message to other business leaders that your company too can benefit from copilot, just hand over your credit card!
Microsoft has absolutely gotten worse in the consumer space, but that isn't really their business these days.
That’s… not something to be proud of.
Power move by the zucc by first asking how much genai is used at Microsoft then refusing to answer his own question at Facebook 😂
Well, that explains Windows 11.
this makes way more sense than hundreds of shitty devs.
Even their AI crashes all the time, its brutal.
this is why I get so much business as a IT consultant lol
I bet they’re counting code written while someone had an AI plugin installed as “written by AI” and I bet that accounts for almost all of that 30%. On top of that, I’m betting that they made it mandatory to have such a plug in, and the other 70% is just code written before they mandated this.
I would be very surprised if 30% of their code lines had even been touched at all by anyone since AI coding assistants became a thing.
I wish this shot from The Terminator had the camera showing Sarah Conner's face instead of Reese's, because it'd be such an appropriate meme image on multiple levels for when someone makes a misleading claim about some current AI system.
I could see stuff getting small changes and them claiming that the entirety of the new version is “written by AI”.
Also, having 1/3 lines with obvious code that can be auto suggested correctly would make sense, but that is hardly code "written by ai" in the way they suggest.
This is my own experience but the past few years Windows has been extremely dependable for me and then in the last few months the updates they’ve have been terrible. I’ve seen more blue screens recently than I have in a lot of years.
All this to say that if it is 30% AI code being used then it’s very telling!
Windows was always garbage to be honest, windows 7 was the best release in my opinion. You are correct though it is way worse these past months. By the way does your mouse lag when the update notification comes up?
i had such a bad experience with 7, it was horribly unstable on a computer that had handled vista just fine. i switched to 8 as soon as i could and was better off for it.
Windows 7 was peak windows. Its been downhill from there
I don't remember in my 2 decades of working my work machine causing me to lose work due to a Windows update. In the last year, it happened to me 3 times. One was due to Crowdstrike. The latest update also recently broke my remote setup. Not completely their fault but still a crappy time. The one other time was due to an update (must've been the forced win11 one) killing the wifi and then Windows hiding any options to fix it, a bug from Windows 10.
Everybody saying this is why their products are shit are really confusing me. It's not like Microsoft just started being terrible. They've been terrible for a real long time. Way before AI was a thing. This is just a symptom of Microsoft's awfulness not a reason for it.
Ok, it's like this.
Ms used to release shitty stuff. And they'll continue to release shitty stuff except now it'll be 30% more shitty.
There were alpha versions of windows 8 with less glaring/annoying bugs than windows 11, though
Windows 11 is so terrible so far that if I'll need to use Windows 10 for dev reasons, I'll either pirate the extended support patches, or use a shitbox (obsolete PC for optimization purposes) disconnected from the internet. I do fear that I might have to hack a GUI onto LDB or GDB, because I got too used to RemedyBG (I'm already using Kate).
The AI is not the reason their software is bad, but their software is bad for the same reason they’re claiming to use AI to write it.
It shows
Beat me to it.
That explains so much
This only makes sense if they are counting intellisense auto complete as "AI written"
Has to be something like that. Nadella is somehow cheating with the number, trying to keep the AI hype going.
You could say ALL of my latest scripts were written with AI. Because I often use it to get a hint or gather some boilerplate code (which I still go over and modify).
Was the auto complete in visual studio not a "trained" set before the llm craze kicked off? Would not surprise me if they decided to include that.
So this explains why Microsoft Swiftkey is total dogshit now. Also why the Outlook app barely works.
Its unbelievable.
I used to be able to swipe freely on SwiftKey, and now I can't really do it without being extra careful and mindful of not spelling the wrong thing. Idk what Microsoft did to the product but I wouldn't call it an improvement.
Idk what Microsoft did to the product but I wouldn't call it an improvement.
I think the article we're looking at here isn't really hyperbolic. They got AI to write all their code and broke the Keyboard.
Just FYI, if you can live without swipping, I recommend FUTO keyboard., it is basically Swiftkey but it actually works and doesn't come with Microsoft's spyware built in.
It's what I use now, and I'm really happy. Don't be fooled by it being in Alpha, because it works flawlessly (minus the swipe, which is hit and miss).
Well, that would explain a lot.
I'm also guessing that at "up to 30%" of the company's leadership decisions are being made by AI too.
Government spyware finally has a challenger for the title of "primary reason that most Microsoft software runs like hot garbage".
If they mean “30% of the code we wrote last month” then I might believe it. Though I bet it is not across the board but deep in one or two areas. Still, it’s a crazy number.
But he said something like “30% of the code in our repositories” which would mean everything, including their entire legacy of code. And that I simply do not believe.
Its a shit article with Tech crunch changing the words to get people in a flap about AI (for or against), the actual quote is
"I'd say maybe 20 percent, 30 percent of the code that is inside of our repos today and some of our projects are probably all written by software"
"Written by software" reasonably included machine refactored code, automatically generated boilerplate and things generated by AI assistants. Through that lens 20% doesnt seem crazy.
I've been "automatically writing code" for a system of about a dozen modules - we specify a glue file in .json between all the modules and the code generating software makes units to go in each module to do the communication interfacing based on the glue spec. That system has been running for more than 10 years now, it writes a couple hundred thousand lines of "new code" every time we modify the glue file.
The A stands for Automation, right?
My first thought on reading that is: yeah, like about 98% of the human genome is "junk DNA" that we have little or no idea what it might be doing. Sometimes when we cut it out, nobody ever notices, sometimes when we cut it out the system won't boot up.
Of course it's just bad writing, but I kind of wouldn't put it past management to try shoving their multitude of codebases through an LLM at this point.
That's why their products are so crappy!
No way, they get their results through honest effort. Anyone can make crappy AI products now, but Microsoft have been doing crappy products the hard way for decades. Don't downplay their hard work !
What? There products have long been shit ever before AI was even a thing.
Anyone remember windows ME? I sure as fuck do.
It shows
Stole it as if I wrote it
We know Microsoft.
Hardly possible not to noticce..
"30% of my pants is pooped"
Code written by software doesn't mean AI unless you ignore compilers
Executives lie to boost profits and justify their decisions, I doubt MS execs even know how much of their code is AI generated just like the ad sales company exec they were talking to in the article
I'm still forced to use Microsoft Outlook and teams, unfortunately, and boy oh boy is it bad.
Yesterday i spent 45 minutes of a 1,5 meeting (that would have been 45 minutes) on trying teams to please try and use the right microphone, please share a screen (not working under Firefox or chrome now, apparently)
I can't wait for the day that I have some time to get us off that dog shit
I love that Outlook occasionally fires up one of its keyboard shortcuts and clears your entire email you were typing if you're not paying attention.
Fucking love it.
Yeah WTF is that about? Office picks up on my keys at least once or twice a day, I don't have that issue with any other program. Just another day in Microsoft land, and it suuuuuucks
not working under Firefox
Weird
or chrome
Oh, there it is
Feature exclusive, huh!
Outlook is pretty damned bullet proof, Teams, OTOH, is a fucking mess. I can see IT wanting to keep everything in the same ecosystem, that's perfectly sane, but I'm certain Zoom can be setup to honor AD credentials. We set it to use Google SSO.
Ha, yeah my Outlook will randomly just not be able to connect to server when starting up. This is from fresh boot every day, some days it just can't, have to reboot and then it works! Fucking brilliant, they managed to break email.
Outlook....
Ok
Pretty solid
Bahaha hahahahaha
Sorry.
Outlook is a lot of things. "Gooey crap" would be one way to describe it, but "solid"? Yeah, no. Gmail is (well, was) pretty solid. There are a lot of other webmail providers out there, including self hosted options and most are pretty solid, yeah. Outlook, though? It's a shit show, it's annoying.
Do you love me? Please love me, please give feedback, please give feedback again, please look at this, hey am I the best? Am I..
STFU YOU PIECE OF CRAP! Can you PLEASE just let me do my email without being an attention whore every hour?
Even down to the basics. Back button? "What is that? Never heard of it, can't go back to the message I just was on because I'm Microsoft software and so half baked."
Having two tabs open? "Oh noes, now I get scawed, now I don't know how to manage sessions anymore, better just sign you out everywhere." What is it with Microsoft and not being able to do something basic as sessions normal? I'm not even asking for good, definitely not "awesome", just normal, and that is already too much to ask.
Try running it in Firefox! I'm sure it's totally not on purpose, just "oopsie woopsie poopsie" accidentally bwoken. Maybe it's working again today, who knows, tomorrow it'll be broken again. I run everything on Firefox except the Microsoft sites, they have to be in chrome because fuck you, that's why.
Seriously, I can't take any Microsoft software seriously at this point, and all of it is on its way out in our company, I'm making sure of that
This makes sense and would explain the mainline windows versioning and probably the xbox versioning too!
Microsoft to AI: List all the integers from one to eleven.
AI: 3. 95. 98. 2000. XP. Vista. 7. 8. 10. 11.
Work for a big software company. With all the offshoring of devs, I expect most of our code is now AI. And it shows.
How does it show? (Asking for red flags, not to create an argument).
Quality degredation and Disjointed experience comes to minds. Microsofts tech is such a mess right now i dont know how they come back from it honestly. Too many competing frameworks, bad schemas, broken tooling, bad documentation.
Im not even factoring in windows 11.
I used to be a windows dev guy, but with this landscape I dunno why i would do it to myself. Developing for linux systens is such a better experience. At least there are standards and ubernerds who adhere to them.
Windows hate train looks fun, but as someone who works in the industry, most of that code is probably just unit tests and boilerplate stuff.
Copilot is decent at quickly writing huge amounts of mostly correct, tedious unit test code, depending on your language/framework. And since Microsoft works with languages like C# and .NET for their native apps, and likely backend too, there is quite a bit of verbosity that Copilot can take care of. Also, documentation might count as well.
No real code is AI-generated. He's just saying shit like this to keep idiot investors happy.
I'd guess it's mostly the AI autocomplete stuff. I.e. you keep on typing until the AI guesses it right then press tab to save keystrokes. LLMs are really bad at making test cases in my experience; they, ironically, can't do the simple but nuanced computations needed to figure out what the output should be given the inputs, or to recognize and test the edge cases.
Oh yeah it can't do anything complicated, only on simple modules. And I usually give it pretty detailed instructions on my expected I/O. It just converts a few sentences of English to dozens of lines of code.
Isn’t that the problem tho. He’s the CEO of Microsoft which is supposed to be a bight end technology firm saying bullshit
Thanks for the context
Is this why they haven't said why they one folder needs to be there. They actually don't know.
I'm out of the loop here
Basically, there was a security flaw with Microsoft's Internet Information Services (web server software) that could be exploited by an attacker to gain access to files and folders they shouldn't be able to (permission escalation?). Well, instead of providing an actual fix to the problem as a whole, they applied a bandaid fix by creating a new folder named "inetpub" on peoples system drive, and apparently the presence of the folder is able to prevent the exploit from working. People noticed the folder and deleted it because they thought it was being created by an attacker, so Microsoft had to tell people not to delete it.
Yeah, I can tell every time I have to use that dinosaur of an OS.
Boy am I glad not having to touch their software.
And 100% of their product names are generated by AI. No human would be stupid enough to change something's name for zero reason.
No human would be stupid enough to change something’s name for zero reason.
Well, unless you're a product manager at Google apparently... Though with them you're lucky if its just a change of name rather than it becoming an entirely "new" thing, or just getting outright axed...
coughs
Yeah that'd explain some stuff. Happy to have switched to Linux
Same. My games even run faster.
If they start with those products today with zero marketing budged and zero user base nobody would use it. Those CEOs are just clowns.
Even worse, whenever a good new technology does pop up they buy it and ruin it.
“Written by software” does not inherently mean AI.
Microsoft CEO Satya Nadella said that 20% to 30% of code inside the company’s repositories was “written by software” — meaning AI.
Nadella gave the figure after Zuckerberg asked roughly how much of Microsoft’s code is AI generated today.
I highlighted part of the article for you.
Code generators being a prime and ancient example
I vaguely remember talk about companies like Google having software that fixes/writes code and that was ages before LLMs.
Windows is 95 percent pure bloat now imo, an os just needs to handle my hardware and launch my programs anything else is just eating my resources.
I don’t need any assistance from anything while my phasers and quantums aren’t doing anything. I don’t need AI doing anything when I finally get the proper setup for crashing a Tomcat into a big old mountain that only a fool would miss. I don’t need any bloat while I’m ripping off an old cartoon character for a D&D campaign.
We can tell
50% of my code is written by Intellisense...
Honestly, I'm not surprised.
Well that explains a lot
Eww. Maybe it’s not really true and Microsoft just wants to remind us that big corporate AI is so legit that all the software you use all day was “helped” by it.
But really for me the issue is the company, not the AI. If I read an article about AI generated code making it into the Linux kernel or some gnu/kde/etc utilities, I don’t think I would worry much because those changes will be reviewed by cranky old nerds who care about the functionality of the software first. I have no such confidence in Microsoft’s processes.
??? No it’s not! Can investors sue because this is such an obvious lie? Pls I have 0.3 Microsoft shares
Are they including code generated to test their own models capability maybe?
They're attempting to make excuses for their inability to create functional software
They’re lying about using AI to write software, they probably have required all their programmers to have an AI plugin installed, and are thus counting any code they make as “written by AI”, and then are counting any minor edit to existing code as the entire thing being “written by AI”.
The software is bad because it’s written to serve the infinite growth imperative. The reason they claim they’re writing code with AI is because that being true is the only hope that they have for achieving the infinite growth imperative. It’s a con, it’s a cult, they are extracting as much value as they can before everything falls apart.
Satya Nadella has given an evasive answer there and both Zuckerberg and the journalists have been taken in.
It is common in programming languages that have a lot of boilerplate to use code generation, where you take some information about data and generate code automatically, like code that translates data between formats (for example reading and writing xml for saving to disk or json to send over the network). Being very routine to write and easy to deduce logically from other information, this process has been automated for years and years, long before AI existed.
Microsoft's flagship software such as operating systems, office software, is unbelievably vast and complex, far beyond the complexity of most business software, and has been developed over decades. They absolutely have not replaced 30% of their code since the very recent advent of useful AI. I can believe that 30% of it is automatically generated, but not by AI.
Copilot. Piloting you towards effortless bugs, and with all the telemetry, we don’t need to test our patches and updates. You, the user are doing that for us. Sincerely, Microsoft.
Not suprised
Fun fact: Nadella has been replaced with an AI agent a couple of months ago and nobody has noticed yet. "Copilot, while I'm away, generate bs on AI adoption and fire a bunch of employees, ok?"
How much of Linux is?
If you count all of my contributions, 0%.
None of my contributions have been included. I am a terrible programmer.
Yikes
If this were true there would massive databreaches. AI is really bad at keeping private keys private. Not to even mention the default credentials it would use because it doesnt have commen sense to change them
Likely a lot of manpower were focused on that, and/or the employees rather wrote their own code then lied about the AI use (heard a lot about it).
I disagree. It feels like your making this assumption from the point of view that people using AI to develop turn their whole brain off and let AI take the wheel. Any dev I know using AI uses it as a time saving measure, i.e. advanced autocomplete, or to assist with troubleshooting as a form of advanced search engine. Also you would have no need to give the AI the actual key itself, at most you would give it the title of the variable the key is saved as.
I find it hard to believe because I work at an adjacent company who has made similar claims and it is complete bullshit.
I do think there is some about of "AI provided a smart complete and the developer hit 'tab' to take the changes" equalling "this code was written by AI" in some metrics that go to the execs. And since the execs mandated high AI use everyone is fine just saying they have high AI use regardless of how true it is.
Wonder how much of Windows 10 was written by Stack Exchange?
Year of the Linux desktop
(Amusing sidenote: my autocomplete's first suggestion after 'Linux' was 'propaganda'.)
I think it might actually start coming to fruition now that a lot of games have native support.
One of the only things stopping me from taking the plunge at this point is laziness to soft through all my data and make sure what i need is backed up before firmatting (i know, i need a good backup solution; open to suggestions here)
Are they including stuff written by intellisence and boiler plate for legacy code?