The recent development of AI models that are more capable than ever has led to a massive demand for hardware infrastructure that powers them. As the dominant player in the industry with its GPU and CPU-GPU solutions, NVIDIA has reportedly discussed leasing data center space to power its own cloud service for these AI applications. Called NVIDIA Cloud DGX, it will reportedly put the company right up against its clients, which are cloud service providers (CSPs) as well. Companies like Microsoft Azure, Amazon AWS, Google Cloud, and Oracle actively acquire NVIDIA GPUs to power their GPU-accelerated cloud instances. According to the report, this has been developing for a few years.

Additionally, it is worth noting that NVIDIA already owns parts for its potential data center infrastructure. This includes NVIDIA DGX and HGX units, which can just be interconnected in a data center, with cloud provisioning so developers can access NVIDIA's instances. A great benefit that would attract the end-user is that NVIDIA could potentially lower the price point of its offerings, as they are acquiring GPUs for much less compared to the CSPs that receive them with a profit margin that NVIDIA imposes. This can attract potential customers, leaving hyperscalers like Amazon, Microsoft, and Google without a moat in the cloud game. Of course, until this project is official, we should take this information with a grain of salt.

Data center infrastructure is a complex matter. It requires shelter, cooling, and dedicated power generators that keep the servers running at full capacity and uptime. However, as these data centers can consume MegaWatts of power, it is becoming increasingly more work for hyperscalers like Meta, Google, Amazon, Microsoft, and others to ensure proper power supply to their data centers. Today, according to the job listing by Microsoft, we learn that the Redmond giant is preparing its infrastructure for nuclear power to reduce data centers' dependency on the outside grid. According to the job listing, Microsoft is seeking a "Principal Program Manager, Nuclear Technology, who will be responsible for maturing and implementing a global Small Modular Reactor (SMR) and microreactor energy strategy."

The SMR and microreactor systems are smaller-scale than traditional nuclear reactors that many power plants are using today and are more manageable due to their sheer size. The power plants based on the aforementioned technology can reside right next to the data center. We are sure that Microsoft had calculated the return on investment (ROI) of creating its power grid, as its electricity consumption will only increase in the coming years as the infrastructure expands. P. Todd Noe, director of nuclear technologies engineering at Microsoft, shared a note regarding the listing, stating: "This is not just a job, it is a challenge. By joining us, you will be part of a global movement that is transforming the way we produce and consume energy. You will also have the chance to grow your skills, advance your career, and make an impact on millions of lives." Below, you can see an example SMR from NuScale.

As the world experiences a generational shift to artificial intelligence, each of us is participating in a new era of global expansion enabled by silicon. It's the "Siliconomy," where systems powered by AI are imbued with autonomy and agency, assisting us across both knowledge-based and physical-based tasks as part of our everyday environments.

At Intel Innovation, the company unveiled technologies to bring AI everywhere and to make it more accessible across all workloads - from client and edge to network and cloud. These include easy access to AI solutions in the cloud, better price performance for Intel data center AI accelerators than the competition offers, tens of millions of new AI-enabled Intel PCs shipping in 2024 and tools for securely powering AI deployments at the edge.

Intel Innovation 2023 - September 13, 2023 - MiTAC Computing Technology, a professional IT solution provider and a subsidiary of MiTAC Holdings Corporation, will showcase its DSG (Datacenter Solutions Group) product lineup powered by 4th Gen Intel Xeon Scalable processors for enterprise, cloud and AI workloads at Intel Innovation 2023, booth #H216 in the San Jose McEnery Convention Center, USA, from September 19-20.

"MiTAC has seamlessly and successfully managed the Intel DSG business since July. The datacenter solution product lineup enhances MiTAC's product portfolio and service offerings. Our customers can now enjoy a comprehensive one-stop service, ranging from motherboards and barebones servers to Intel Data Center blocks and complete rack integration for their datacenter infrastructure needs," said Eric Kuo, Vice President of the Server Infrastructure Business Unit at MiTAC Computing Technology.

Today, MLCommons published results of its MLPerf Inference v3.1 performance benchmark for GPT-J, the 6 billion parameter large language model, as well as computer vision and natural language processing models. Intel submitted results for Habana Gaudi 2 accelerators, 4th Gen Intel Xeon Scalable processors, and Intel Xeon CPU Max Series. The results show Intel's competitive performance for AI inference and reinforce the company's commitment to making artificial intelligence more accessible at scale across the continuum of AI workloads - from client and edge to the network and cloud.

"As demonstrated through the recent MLCommons results, we have a strong, competitive AI product portfolio, designed to meet our customers' needs for high-performance, high-efficiency deep learning inference and training, for the complete spectrum of AI models - from the smallest to the largest - with leading price/performance." -Sandra Rivera, Intel executive vice president and general manager of the Data Center and AI Group

Today, AMD announced Amazon Web Services (AWS) has expanded its 4th Gen AMD EPYC processor-based offerings with the general availability of Amazon Elastic Compute Cloud (EC2) M7a and Amazon EC2 Hpc7a instances, which offer next-generation performance and efficiency for applications that benefit from high performance, high throughput and tightly coupled HPC workloads, respectively.

"For customers with increasingly complex and compute-intensive workloads, 4th Gen EPYC processor-powered Amazon EC2 instances deliver a differentiated offering for customers," said David Brown, vice president of Amazon EC2 at AWS. "Combined with the power of the AWS Nitro System, both M7a and Hpc7a instances allow for fast and low-latency internode communications, advancing what our customers can achieve across our growing family of Amazon EC2 instances."

According to the job listing found by Electrek, Tesla is currently hiring staff for Tesla's "1st of its kind Data Centers." Tesla is a company with a huge demand for computing, especially with training self-driving technology on its hardware. The company is building its training chips called Dojo D1, which is used to train neural networks that power the company's Full Self Driving (FSD) that is inferenced locally on each Tesla vehicle. However, to support such training infrastructure and other data processing, the company is in need of its own data centers, and the recruitment for it has just started.

It is interesting to mention a "first of its kind" data center, meaning that some unique design and/or application goal will be present. The global data center is roughly a 250 billion USD market, and with Tesla entering, we are still waiting to see the size of its investment. Nonetheless, the latest position, "Engineering Program Manager, Data Centers," will oversee these efforts and lead the end-to-end design and engineering of this supposedly unique data center.

Lightelligence, the global leader in photonic computing and connectivity systems, today announced Photowave, the first optical communications hardware designed for PCIe and Compute Express Link (CXL) connectivity, unleashing next-generation workload efficiency.

Photowave, an Optical Networking (oNET) transceiver leveraging the significant latency and energy efficiency of photonics technology, empowers data center managers to scale resources within or across server racks. The first public demonstration of Photowave will be at Flash Memory Summit today through Thursday, August 10, in Santa Clara, Calif.

From the cloud, to the edge, to the enterprise, data center architects are deploying higher levels of flash to unlock the potential of AI, object storage, file sharing and more. At the same time, they are laser-focused on controlling spend and must find solutions to help them manage, scale and utilize storage assets more efficiently. This is driving a growing trend to disaggregate and share NVMe flash over fabric (NVMe-oF) for improved performance, availability and flexibility of storage resources.

Helping customers simplify NVMe/NVMe-oF storage deployment, Western Digital (NASDAQ: WDC) today announced its enhanced OpenFlex Data24 3200 NVMe-oF JBOF/Storage Platform along with the next-generation RapidFlex A2000 and C2000 NVMe-oF fabric bridge devices (FBDs), and the new Ultrastar DC SN655 PCIe Gen 4.0 dual-port NVMe SSD. These new storage solutions are enabling an ecosystem, providing more flexibility and choice for simplifying NVMe and NVMe-oF deployment for customers. Western Digital is now the only company with vertical integration capabilities targeting both ends of the Ethernet wire to deliver solutions where data travels from the server initiator to the storage target.

KIOXIA America, Inc. today announced the addition of the KIOXIA CD8P Series to its lineup of data center-class solid state drives (SSDs). KIOXIA CD8P drives are well-suited to general purpose server and cloud environments that can take advantage of PCIe 5.0 (32 gigatransfers/s x4) performance. These data center applications can generate complex mixed workloads spread across large scale virtualized systems. The new drives are available in capacities up to 30.72 terabytes (TB) and in both Enterprise and Data Center Standard Form Factor (EDSFF) E3.S and 2.5-inch (U.2) form factors.

Optimized for the performance, latency, reduced power and thermal requirements of data center environments where power and cooling efficiency is critical, the KIOXIA CD8P Series provides the predictability and consistency needed for a seamless user experience. According to Jeff Janukowicz, Research Vice President, IDC, "Growth in NVMe SSDs continues with PCIe capacity shipments in servers and storage systems expected to grow at a 40% CAGR between 2022 and 2027. The new CD8P Series SSDs gives these customers the range of performance, capacity, and security choices essential for meeting the storage requirements of next-generation digital enterprise and data center infrastructure."

AMD today announced revenue for the second quarter of 2023 of $5.4 billion, gross margin of 46%, operating loss of $20 million, net income of $27 million and diluted earnings per share of $0.02. On a non-GAAP basis, gross margin was 50%, operating income was $1.1 billion, net income was $948 million and diluted earnings per share was $0.58.

"We delivered strong results in the second quarter as 4th Gen EPYC and Ryzen 7000 processors ramped significantly," said AMD Chair and CEO Dr. Lisa Su. "Our AI engagements increased by more than seven times in the quarter as multiple customers initiated or expanded programs supporting future deployments of Instinct accelerators at scale. We made strong progress meeting key hardware and software milestones to address the growing customer pull for our data center AI solutions and are on-track to launch and ramp production of MI300 accelerators in the fourth quarter."

Cerebras Systems, the pioneer in accelerating generative AI, and G42, the UAE-based technology holding group, today announced Condor Galaxy, a network of nine interconnected supercomputers, offering a new approach to AI compute that promises to significantly reduce AI model training time. The first AI supercomputer on this network, Condor Galaxy 1 (CG-1), has 4 exaFLOPs and 54 million cores. Cerebras and G42 are planning to deploy two more such supercomputers, CG-2 and CG-3, in the U.S. in early 2024. With a planned capacity of 36 exaFLOPs in total, this unprecedented supercomputing network will revolutionize the advancement of AI globally.

"Collaborating with Cerebras to rapidly deliver the world's fastest AI training supercomputer and laying the foundation for interconnecting a constellation of these supercomputers across the world has been enormously exciting. This partnership brings together Cerebras' extraordinary compute capabilities, together with G42's multi-industry AI expertise. G42 and Cerebras' shared vision is that Condor Galaxy will be used to address society's most pressing challenges across healthcare, energy, climate action and more," said Talal Alkaissi, CEO of G42 Cloud, a subsidiary of G42.

The U.S. Department of Energy (DOE) has announced its selection of Intel as one of 15 organizations tasked with developing high-performance, energy-efficient cooling solutions for future data centers. The award, announced in May, is part of the COOLERCHIPS program - Cooling Operations Optimized for Leaps in Energy, Reliability, and Carbon Hyperefficiency for Information Processing Systems - supported by DOE's Advanced Research Projects Agency-Energy (ARPA-E). Intel's project, anticipated to be a three-year agreement with $1.71 million in funding, will enable the continuation of Moore's Law by allowing Intel to add more cores and transistors to its highest performance processors, while managing the heat on future devices.

Tejas Shah, principal engineer and lead thermal architect for Intel's Super Compute Platforms Group said: "Immersion cooling is used for its simplicity, sustainability and ease of upgrades. This proposal will enable two-phase immersion cooling to align with the exponential increase in power expected by processors over the next decade."

TYAN, an industry-leading server platform design manufacturer and a subsidiary of MiTAC Computing Technology Corporation, will be showcasing its latest HPC, cloud and storage platforms at Computex 2023, Booth #M0701a in Taipei, Taiwan from May 30 to June 2. These platforms are powered by AMD EPYC 9004 Series processors, which offer superior energy efficiency and are designed to enhance data center computing performance.

"As businesses increasingly prioritize sustainability in their operations, data centers - which serve as the computational core of an organization - offer a significant opportunity to improve efficiency and support ambitious sustainability targets," said Eric Kuo, Vice President of the Server Infrastructure Business Unit at MiTAC Computing Technology Corporation. "TYAN's server platforms powered by 4th Gen AMD EPYC processor enable IT organizations to achieve high performance while remaining cost-effective and contributing to environmental sustainability."

NVIDIA and SoftBank Corp. today announced they are collaborating on a pioneering platform for generative AI and 5G/6G applications that is based on the NVIDIA GH200 Grace Hopper Superchip and which SoftBank plans to roll out at new, distributed AI data centers across Japan. Paving the way for the rapid, worldwide deployment of generative AI applications and services, SoftBank will build data centers that can, in collaboration with NVIDIA, host generative AI and wireless applications on a multi-tenant common server platform, which reduces costs and is more energy efficient.

The platform will use the new NVIDIA MGX reference architecture with Arm Neoverse-based GH200 Superchips and is expected to improve performance, scalability and resource utilization of application workloads. "As we enter an era where society coexists with AI, the demand for data processing and electricity requirements will rapidly increase. SoftBank will provide next-generation social infrastructure to support the super-digitalized society in Japan," said Junichi Miyakawa, president and CEO of SoftBank Corp. "Our collaboration with NVIDIA will help our infrastructure achieve a significantly higher performance with the utilization of AI, including optimization of the RAN. We expect it can also help us reduce energy consumption and create a network of interconnected data centers that can be used to share resources and host a range of generative AI applications."

Lenovo Group today announced full-year results, reporting Group revenue of US$62 billion and net income of US$1.6 billion, or US$1.9 billion on a non-Hong Kong Financial Reporting Standards (HKFRS) [1] basis. Profitability was stable with gross margin and operating margin both delivering 18-year highs and non-HKFRS net margin flat year-to-year. While Group revenue was impacted due to the softness in the device market, revenue from non-PC businesses reached a fiscal year high of nearly 40%, fueled by Lenovo's diversified growth engines of Solutions and Services Group (SSG) and Infrastructure Solutions Group (ISG) growing revenue to record highs of US$6.7 billion and US$9.8 billion respectively, up 22% and 37% year-on-year.

After a year of industry and global uncertainties, Lenovo sees positive signs of the market stabilizing. The Group expects the entire PC and smart devices market to resume year-to-year growth in the second half of 2023, and for the IT services market to resume relatively high growth - together these will drive the total IT market in 2023 back to moderate growth. In the mid-to-long term, digital and intelligent transformation will continue to accelerate, leading to a big growth potential for cloud and computing infrastructure.

Today, AMD (NASDAQ: AMD) showcased its high performance computing (HPC) leadership at ISC High Performance 2023 and celebrated, along with key partners, its first year of breaking the exascale barrier. AMD EPYC processors and AMD Instinct accelerators continue to be the solutions of choice behind many of the most innovative, green and powerful supercomputers in the world, powering 121 supercomputers on the latest TOP500 list.

"AMD's mission in high-performance computing is to enable our customers to tackle the world's most important challenges," said Forrest Norrod, executive vice president and general manager, Data Center Solutions Business Group, AMD. "Our industry partners and the global HPC community continue to leverage the performance and efficiency of AMD EPYC processors and Instinct accelerators to advance their groundbreaking work and scientific discoveries."

At the ISC High Performance Conference, Intel showcased leadership performance for high performance computing (HPC) and artificial intelligence (AI) workloads; shared its portfolio of future HPC and AI products, unified by the oneAPI open programming model; and announced an ambitious international effort to use the Aurora supercomputer to develop generative AI models for science and society.

"Intel is committed to serving the HPC and AI community with products that help customers and end-users make breakthrough discoveries faster," said Jeff McVeigh, Intel corporate vice president and general manager of the Super Compute Group. "Our product portfolio spanning Intel Xeon CPU Max Series, Intel Data Center GPU Max Series, 4th Generation Intel Xeon Scalable Processors and Habana Gaudi 2 are outperforming the competition on a variety of workloads, offering energy and total cost of ownership advantages, democratizing AI and providing choice, openness and flexibility."

Solidigm, a leading global provider of innovative NAND flash memory solutions, is expanding its D5 Product Series with the Solidigm D5-P5430, a new QLC solid-state storage drive (SSD) optimized for mainstream and read-intensive workloads. With most of today's enterprise applications read-dominant, the D5-P5430—a 4th gen PCIe QLC SSD—offers substantial storage density and Total Cost of Ownership (TCO) opportunities while delivering read performance that is equivalent to the most widely-adopted TLC SSDs.

The D5-P5430 is optimized for mainstream workloads (e.g., email/unified communications, decision support systems, object storage, and virtual desktop infrastructure) and read-intensive workloads (e.g., content delivery networks, data lakes/pipelines, video-on-demand). These workloads are typically 80% reads or higher and need to move massive amounts of data at high throughput.

KIOXIA America, Inc. today announced that its lineup of CD7 Series Enterprise and Datacenter Standard Form Factor (EDSFF) E3.S NVMe SSDs are first to ship on servers and storage from Hewlett Packard Enterprise (HPE). The industry's first EDSFF drives designed with PCIe 5.0 technology, KIOXIA CD7 E3.S SSDs increase flash storage density per drive for optimized power efficiency and rack consolidation. HPE ProLiant Gen11 servers, HPE Alletra 4000 data storage servers and the HPE Synergy 480 Gen11 Compute Module are enabled with the latest PCIe 5.0 interface, enabling up to twice the performance over PCIe 4.0, and come with optionally equipped EDSFF E3.S drive bays.

As a natural evolution of the 2.5-inch form factor, EDSFF E3.S is designed for the needs of high performance flash storage. E3.S enables more dense, efficient deployments in the same rack unit compared to 2.5-inch drives, while improving cooling and thermal characteristics and raising capacities by up to 1.5 - 2x.

Micron Technology, Inc., today announced the release of two SSDs, the Micron 6500 ION NVMe SSD and the Micron XTR NVMe SSD. Designed to keep pace with the accelerating growth of data, these drives provide a major advancement for data centers by lowering operating costs and improving storage efficiency. The Micron 6500 ION is a high-capacity SSD that offers a superior value over competitive QLC-based drives by providing best-in-class performance and enabling a more environmentally sustainable data center. The 6500 ION is able to deliver TLC performance and QLC-like cost due to Micron's 232-layer technology node leadership compared to the competition's use of sub-200-layer QLC technology. When paired with Micron 6500 ION drives or other SSDs, the Micron XTR SSD delivers extreme endurance that enhances system performance.

"Customers are looking for new capabilities to address the data growth and performance needs of artificial intelligence data lakes and other demanding workloads. As a result, we are seeing tremendous traction on the 6500 ION and XTR with customers who are deploying storage at scale due to their unrivaled combination of large capacity, superior performance, and amazing endurance," said Alvaro Toledo, vice president and general manager of Micron's Data Center Storage group. "The 6500 ION SSD offers QLC value with TLC performance and up to a 20% reduction in power consumption versus competing QLC SSDs, allowing our customers to reduce their carbon footprint. Together, these SSDs enable customers to leap ahead and harness the power of artificial intelligence without compromising performance."

Today, AMD (NASDAQ: AMD) announced the "AMD Data Center and AI Technology Premiere," an in-person and livestreamed event to showcase the company's growth strategy and expanding product portfolio and capabilities for data center and AI. AMD Chair and CEO Dr. Lisa Su will be joined by other AMD executives and key customers to detail new products, and momentum across data center, AI, adaptive and high-performance computing solutions.

The live stream will start at 10 a.m. PT on Tuesday, June 13 at www.amd.com/datacenter as well as the AMD YouTube channel.

Following the recent Q1 2023 financial report with declining revenue, Intel is restructuring its Client Computing Group (CCG) and Data Center Group (DCG). These two units were hit the hardest, with 38 and 39% downturns, respectively. According to Dylan Patel of SemiAnalysis, and a statement from Tom's Hardware, we have information that Intel will be conducting budget cuts to CCG and DCG, with some layoffs. As Dylan Patel notes, Intel will cut CCG and DCG budgets by 10%, resulting in as much as a 20% reduction of the workforce inside those two groups. Additionally, this was supported by Intel's spokesperson, who issued a statement for Tom's Hardware stating the following:

Intel SpokespersonIntel is working to accelerate its strategy while navigating a challenging macro-economic environment. We are focused on identifying cost reductions and efficiency gains through multiple initiatives, including some business and function-specific workforce reductions in areas across the company.

We continue to invest in areas core to our business, including our U.S.-based manufacturing operations, to ensure we are well-positioned for long-term growth. These are difficult decisions, and we are committed to treating impacted employees with dignity and respect.

AMD (NASDAQ:AMD) today announced revenue for the first quarter of 2023 of $5.4 billion, gross margin of 44%, operating loss of $145 million, net loss of $139 million and diluted loss per share of $0.09. On a non-GAAP basis, gross margin was 50%, operating income was $1.1 billion, net income was $970 million and diluted earnings per share was $0.60.

"We executed very well in the first quarter as we delivered better than expected revenue and earnings in a mixed demand environment," said AMD Chair and CEO Dr. Lisa Su. "We launched multiple leadership products and made significant progress accelerating our AI roadmap and customer engagements in the quarter. Longer-term, we see significant growth opportunities as we successfully deliver our roadmaps, execute our strategic data center and embedded priorities and accelerate adoption of our AI portfolio."

Keen-eyed hardware tipster momomo_us this week spotted that an upcoming AMD data center "Siena Dense" CPU has received verification, in the general sense, for SATA and PCI support - courtesy of the Serial ATA International Organization (SATA-IO). The information dump was uploaded to SATA-IO's online database on April 6 of this year - under the heading: "AMD EPYC 8004 Series Processors." As covered by TPU mid-way through this month the family of enterprise-grade processors, bearing codename Siena, is expected to be an entry-level alternative to the EPYC Genoa-X range, set for launch later in 2023.

The EPYC Siena series is reported to arrive with a new socket type - SP6 (LGA 4844) - which is said to be similar in size to the older Socket SP3. The upcoming large "Genoa-X" and "Bergamo" processors will sit in the already existing Socket SP5 (LGA 6096) - 2022's EPYC Genoa lineup makes use of it already. AMD has not made its SP6 socket official to the public, but industry figures have been informed that it can run up to 64 "Zen 4" cores. This new standard has been designed with more power efficient tasks in mind - targeting intelligent edge and telecommunication sectors. The smaller SP6 socket will play host to CPUs optimized for as low as 70 W operation, with hungrier variants accommodated up to 225 W. This single platform solution is said to offer 6-channel memory, 96 PCIe Gen 5.0 lanes, 48 lanes for CXL V1.1+, and 8 PCIe Gen 3.0 lanes.