Thursday, January 18th 2024

Microsoft Sets 16 GB RAM as Minimum-Requirement for Copilot and Windows AI Features

Microsoft has reportedly set 16 GB as the minimum system requirement for AI PCs, a TrendForce market research report finds. To say that Microsoft has a pivotal role to play in PC hardware specs is an understatement. This year sees the introduction of the first "AI PCs," or PCs with on-device AI acceleration for several new features native to Windows 11 23H2, mainly Microsoft Copilot. From the looks of it, Copilot is receiving the highest corporate attention from Microsoft, as the company looks to integrate the AI chatbot that automates and generates work, into the mainstream PC. In fact, Microsoft is even pushing for a dedicated Copilot button on PC keyboards along the lines of the key that brings up the Start menu. The company's biggest move with Copilot will be the 2024 introduction of Copilot Pro, an AI assistant integrated with Office and 365, which the company plans to sell on a subscription basis alone.

Besides cloud-based acceleration, Microsoft's various AI features will rely on some basic hardware specs for local acceleration. One of them of course is the NPU, with Intel's AI Boost and AMD's Ryzen AI being introduced with their latest mobile processors. The other requirement will be memory. AI acceleration is a highly memory sensitive operation, and LLMs require a sizable amount of fast frequent-access memory. So Microsoft arrived at 16 GB as the bare minimum amount of memory for not just native acceleration, but also cloud-based Copilot AI features to work. This should see the notebooks of 2024 set 16 GB as their baseline memory specs; and for commercial notebooks to scale up to 32 GB or even 64 GB, depending on organizational requirements. The development bodes particularly well for the DRAM industry.
Sources: TrendForce, TwelveSilverSwords (Reddit)
Add your own comment

36 Comments on Microsoft Sets 16 GB RAM as Minimum-Requirement for Copilot and Windows AI Features

#26
trsttte
Random_UserI'm afraid, that's only the matter of time, until something similar would happen with linux as well, and it would be integrated into kernel.
No it won't, Linus Torvalds would never allow that change through neither would any of the other integrators as it simply doesn't belong there. And if for some cosmic reason a change like that would go through, the project would be quickly forked and a critical mass of users would move to the new one that doesn't have this change.

Returning to topic, even on windows this will have a multitude of ways to disable because it simply has to, businesses simply won't have any of this shit going through their data. Even the current tools like chatgpt where the inputs are 100% controlled by the user are being blocked and walled of, no way an automated tool will be allowed to run wild on any type of user data.

Speaking of user data, it will be interesting to see how this gets handled in the EU, RGPD is still a thing (often to the point of just being annoying) so no way microsoft can just parse user information willy nilly without risking massive fines.

TLDR this trend is stupid but so is the hysteria claiming this will be farming all your data all times, microsoft likes money and doesn't want to loose all of it to massive fines.
Dirt ChipThat is, AI can do the work equal to work that 300M American can do aka AI can do about 3 time the workload of actual America workload.
Or something like that..
What!? No, the guy simply read some disinformation and didn't bother to think it through, it sometimes happens no one is immune to it.
Posted on Reply
#27
KellyNyanbinary
Mandating 16 GB of memory would be cool. Though the reason they’re mandating it for is questionable. Especially since I believe Windows copilot goes to the cloud (correct me if I am wrong).
Posted on Reply
#28
Minus Infinity
Oh no, I better upgrade my PC from 64GB to 8GB
R0H1T16GB is still too low for PC these days but I guess as long as you don't do 1,000 chrome tabs all at once you should be fine :slap:
If you use Adobe's piss poor software with memory leaks you'll need 64GB for high res images.
Dirt ChipAny actual reason to why AI need that amount of ram?

There are many, very basic but fully functional, new laptops and other mini PC's that do fine with 8 and even 4GB (I know, I have one).
IMO it's BS, because the GPU is faster than the NPU currently. Intel's own iGPU on Meteor Lake is 80% faster than the NPU for AI tasks
Posted on Reply
#29
remixedcat
PLAfillerAhahaha, nailed it!

EDIT: also you will buy a keyboard with a "co pilot" key on it ;)
which is gonna look as goofy as the MGO keys and rdio buttons on my roku tv remote when they change the brand to something else and shut down co-pilot!!
Posted on Reply
#30
ThrashZone
Hi,
Obviously these morons at MS have no clue what internet speed plans are costing and majority of people get the barebones basic which very slow
No high speed or amount of memory or cpu frequency will ever change AI cloud speed.

So AI bloat will do nothing but slow internet even more.
Posted on Reply
#31
remixedcat
ThrashZoneHi,
Obviously these morons at MS have no clue what internet speed plans are costing and majority of people get the barebones basic which very slow
No high speed or amount of memory or cpu frequency will ever change AI cloud speed.

So AI bloat will do nothing but slow internet even more.
and bad for the environment too!! and these same ppl pushing it claim there's a climate crisis and all that... yet push this stuff that escalates the climate crisis!
Posted on Reply
#32
Random_User
trsttteNo it won't, Linus Torvalds would never allow that change through neither would any of the other integrators as it simply doesn't belong there. And if for some cosmic reason a change like that would go through, the project would be quickly forked and a critical mass of users would move to the new one that doesn't have this change.

Returning to topic, even on windows this will have a multitude of ways to disable because it simply has to, businesses simply won't have any of this shit going through their data. Even the current tools like chatgpt where the inputs are 100% controlled by the user are being blocked and walled of, no way an automated tool will be allowed to run wild on any type of user data.

Speaking of user data, it will be interesting to see how this gets handled in the EU, RGPD is still a thing (often to the point of just being annoying) so no way microsoft can just parse user information willy nilly without risking massive fines.

TLDR this trend is stupid but so is the hysteria claiming this will be farming all your data all times, microsoft likes money and doesn't want to loose all of it to massive fines.



What!? No, the guy simply read some disinformation and didn't bother to think it through, it sometimes happens no one is immune to it.
The problem is, even W10 already has many stuff that can't be disabled. Even with registry "fixes". It simply ignores them, and defaults each time the update being installed. Not sure that even NTlite can be helpful in this case. Knowing this, there's big chance, that copilot will be "secured" from being "excluded" or disabled by all costs.

EU stuff is for EU. It doesn't spread on entire planet. That's exactly the targets for data mining. And I'm sure, not much EU citizen know their digital rights, let alone going to the court. How can individual even ask of removal of the unnecessary bloat in the OS? Not even class action can do a trick. Look at how Edge is ended up intrusive sh*t, that is impossible to remove from the kernel. Much like updates. And what if the person doesn't want to use the "recommended" browser, or don't want to get updates right now? Some have traffic caps. And that after multiple lawsuits from EU against MS. Same goes for Google, and their "core" services. They being fined, and proceed with their sh*t, even harder this time.

Also knowing the EU bureaucratic leadership, they gonna talk much, and then do nothing. After they allowed MS to consume the giant game companies, there's not much of a hope left for AI to be regulated. Most likely they might have some "private meeting" with big companies CEOs, much like US had recently, and the law/decision would be made in favor of "big dudes".

Look at the hubris that bent periperals makers to add the silly button for copilot, that no one asked for. It's limited to only one OS, and to only one single function. Heck the "Start" button ended up to be very useful.

And this isnt hysteria. This is bitter almost three decades long experience of using MS products, and the trends it creates. Sadly, the linux isn't the ideal alternative. And each distro suits some particular need. There's no uniform "linux OS" for good and for bad.

With 16GB being minimum requirement, it's yet not a guarantee of laptop makers to keep putting the tiniest amounts of RAM possible. Considering the ever increasing RAM demand for other programs and tasks, and DRAM makers/cartel rising the prices... Looks like great news for them.
remixedcatand bad for the environment too!! and these same ppl pushing it claim there's a climate crisis and all that... yet push this stuff that escalates the climate crisis!
Yeah, MS being Carbon-neutral. Sure... But their products are not. If the user have to add some additional workload for no personal purpose, on top of the tasks one does, this's excess emissions in collosal scale. Considering the wast majority of home users and offices across the globe using MS Windows. This is crypto mining, but now unaviodable and forced upon each individual.
Posted on Reply
#33
ThrashZone
remixedcatand bad for the environment too!! and these same ppl pushing it claim there's a climate crisis and all that... yet push this stuff that escalates the climate crisis!
Hi,
Yeah I keep reading these messages about ms being committed to having a low carbon footprint but how does that apply with windows update always checking for updates on startup probably every 5 +- minutes after plus defender/... if users never stopped manually lol

Just office click to run is a major waste plus edge/... all ms apps are like rattle snakes waiting to strike but a lot of users don't and can't get rid of them and they waste internet bandwidth and system resources anyway and now we have an even less desirable AI nonsense apps coming :kookoo:

There's section in storage to off load unused apps and save space but you'll never see an unused ms app listed :laugh:
Posted on Reply
#34
Shrek
R0H1T16GB is still too low for PC these days
I have 16GB and normally sit around 1/4-1/3rd usage.
Posted on Reply
#35
micropage7
16 GB when the AI process through internet, just dunno
except M$ pushing the app active on background 24/7 no matter what
Posted on Reply
#36
Easy Rhino
Linux Advocate
micropage716 GB when the AI process through internet, just dunno
except M$ pushing the app active on background 24/7 no matter what
They need 16 gigs to steal all of your personal data so they can train their AI to put you out of work.
Posted on Reply
Add your own comment
May 19th, 2024 07:57 EDT change timezone

New Forum Posts

Popular Reviews

Controversial News Posts