Monday, August 5th 2024
Linux Patch Boosts Intel 5th Generation Xeon "Emerald Rapids" Performance by up to 38%, up to 18% Less Power
Intel's 5th generation Xeon Scalable processors codenamed Emerald Rapids, have been shipping since late 2023 and are installed at numerous servers today. However, Emerald Rapids appears to possess more performance and efficiency tricks than it initially revealed at launch. According to the report from Phoronix, reporting on a Linux kernel patch sent to the Linux Kernel Mailing List (LKML), there is a chance for up to 38% performance increase while using up to 18% less power on all Intel 5th generation Xeon machines. Thanks to Canonical (maker of Ubuntu Linux) engineer Pedro Henrique Kopper, who explained the patch on the LKML, we found out that changing a single line of code yielded this massive increase.
Ubuntu Linux, as well as many other distributions, ship with Energy Performance Preference (EPP) for Emerald Rapids with a "balance_performance" value of 128. However, changing the value to 32 now yields a massive performance improvement alongside using less power. The EPP "balance_performance" is the default out-of-the-box setting for many Linux distributions. Users manually setting the "performance" mode in the EPP are not expecting any increase from this patch, as the "balance_performance" mode had issues balancing power and efficiency. Introducing this new setting yields more performance for machines that run at default settings, and this is especially important for data centers where the need for lower power and increased performance is constantly surging. Especially at hyperscalers like Amazon, Google, and Meta, which may run tens of thousands of these CPUs at default settings to keep them stable and well-cooled, who can now enjoy a massive performance increase with less power consumed.
Below, you can see the patch quote as well as more performance/power measurements.
Sources:
Phoronix, LKML
Ubuntu Linux, as well as many other distributions, ship with Energy Performance Preference (EPP) for Emerald Rapids with a "balance_performance" value of 128. However, changing the value to 32 now yields a massive performance improvement alongside using less power. The EPP "balance_performance" is the default out-of-the-box setting for many Linux distributions. Users manually setting the "performance" mode in the EPP are not expecting any increase from this patch, as the "balance_performance" mode had issues balancing power and efficiency. Introducing this new setting yields more performance for machines that run at default settings, and this is especially important for data centers where the need for lower power and increased performance is constantly surging. Especially at hyperscalers like Amazon, Google, and Meta, which may run tens of thousands of these CPUs at default settings to keep them stable and well-cooled, who can now enjoy a massive performance increase with less power consumed.
On Intel Emerald Rapids machines, we ship the Energy Performance Preference (EPP) default for balance_performance as 128. However, during an internal investigation together with Intel, we have determined that 32 is a more suitable value. This leads to significant improvements in both performance and energy:
POV-Ray: 32% faster | 12% less energy
OpenSSL: 12% faster | energy within 1%
Build Linux Kernel: 29% faster | 18% less energy
Therefore, we should move the default EPP for balance_performance to 32. This is in line with what has already been done for Sapphire Rapids.
18 Comments on Linux Patch Boosts Intel 5th Generation Xeon "Emerald Rapids" Performance by up to 38%, up to 18% Less Power
Bit like this massive 500% gains via a driver update with Intel Arc in the past.
Someone made a booboo :laugh:
But nice increase in performance, and nice decrease in power use.
Looking at this, it has EPP set to Performance.
openbenchmarking.org/result/2402255-NE-14900K93584
I noticed Alder Lake is still set at EPP 102, I wonder if someone has checked all of these. Intel should be jumping on this, their chips have been known for poor efficiency for years they should be on top of this.
The rest you can just change CPU governor like this
I got it set to this most of the time... and sometimes put on powersave when I am on battery but a lot of the time this is plugged in...
Windows Server you can kind of just roll your face on the keyboard during setup and get the consistent mediocre performance we know and love.