SK hynix has returned to Santa Clara, California to present its full array of groundbreaking AI memory technologies at FMS: the Future of Memory and Storage (FMS) 2024 from August 6-8. Previously known as Flash Memory Summit, the conference changed its name to reflect its broader focus on all types of memory and storage products amid growing interest in AI. Bringing together industry leaders, customers, and IT professionals, FMS 2024 covers the latest trends and innovations shaping the memory industry.

Participating in the event under the slogan "Memory, The Power of AI," SK hynix is showcasing its outstanding memory capabilities through a keynote presentation, multiple technology sessions, and product exhibits.

TrendForce reports that a recovery in demand for general servers—coupled with an increased production share of HBM by DRAM suppliers—has led suppliers to maintain their stance on hiking prices. As a result, the ASP of DRAM in the third quarter is expected to continue rising, with an anticipated increase of 8-13%. The price of conventional DRAM is expected to rise by 5-10%, showing a slight contraction compared to the increase in the second quarter.

TrendForce notes that buyers were more conservative about restocking in the second, and inventory levels on both the supplier and buyer sides did not show significant changes. Looking ahead to the third quarter, there is still room for inventory replenishment for smartphones and CSPs, and the peak season for production is soon to commence. Consequently, it is expected that smartphones and servers will drive an increase in memory shipments in the third quarter.

Yesterday we reported on DDR6 memory hitting new heights of performance and it looks like LPDDR6 will follow suit, at least based on details in a JEDEC presentation. LPDDR6 will just like LPDDR5 be available as solder down memory, but it will also be available in a new LPCAMM2 module. The bus speed of LPDDR5 on LPCAMM2 modules is expected to peak at 9.2 GT/s based on JEDEC specifications, but LPDDR6 will extend this to 14.4 GT/s or roughly a 50 percent increase. However, today the fastest and only LPCAMM2 modules on the retail market which are using LPDDR5X, comes in at 7.5 GT/s, which suggests that launch speeds of LPDDR6 will end up being quite far from the peak speeds.

There will be some other interesting changes to LPDDR6 CAMM2 modules as there will be a move from 128-bit per module to 192-bit per module and each channel will go from 32-bits to 48-bits. Part of the reason for this is that LPDDR6 is moving to a 24-bit channel width, consisting of two 12-bit sub channels, as mentioned in yesterday's news post. This might seem odd at first, but in reality is fairly simple, LPDDR6 will have native ECC (Error Correction Code) or EDC (Error Detection Code) support, but it's currently not entirely clear how this will be implemented on a system level. JEDEC is also looking at developing a screwless solution for the CAMM2 and LPCAMM2 memory modules, but at the moment there's no clear solution in sight. We might also get to see LPDDR6 via LPCAMM2 modules on the desktop, although the presentation only mentions CAMM2 for the desktop, something we've already seen that MSI is working on.

The next-generation PC DDR6 memory standard (not to be confused with GDDR6), will offer a 10-times increase in bandwidth over DDR4, according to a presentation by Synopsys, a major vendor of memory controller and PHY IP blocks. The initial draft of DDR6 specification by JEDEC is expected to be ready within 2024, with version 1.0 of the spec ready by mid-2025. Speeds (data-rates) of DDR6 start at DDR6-8800, and range up to DDR6-17600 in the first generation; with future generations of DDR6 going all the way up to DDR6-21333 (or 21 Gbps). This is exactly 10 times the bandwidth of DDR4-2133, the initial speed of DDR4 that debuted with 6th Gen Core "Skylake" processors, almost a decade ago. It hence makes sense for a memory specification 10 years since to offer such a linear scaling in bandwidth.

Synopsys also talks about LPDDR6 in this presentation, the future low power memory standard for thin-and-light computing devices and smartphones. LPDDR6 will have an introductory data-rate of LPDDR6-10667 over a 24-bit memory channel, with two 12-bit sub-channels. The highest defined data-rate for LPDDR6 is expected to be LPDDR6-14400 (likely 14466 MT/s). Besides generational increases in bandwidth, both PC DDR6 and LPDDR6 are expected to introduce several security and energy-efficiency features, including an "efficiency mode" that reduces idle power draw for the memory devices.

Aetina, a leading Edge AI solution provider, announced the launch of the Aetina IA380E-QUFL at Embedded World 2024 in Nuremberg, Germany. This groundbreaking product is a small form factor PCIe graphics card powered by the high-performance Intel Arc A380E GPU.

Unmatched Power in a Compact Design
The Aetina IA380E-QUFL delivers workstation-level performance packed into a low-profile, single-slot form factor. This innovative solution consumes only 50 W, making it ideal for space and power-constrained edge computing environments. Embedded system manufacturers and integrators can leverage the power of 4.096 TFLOPs peak FP32 performance delivered by the Intel Arc A380E GPU.

TrendForce's latest report reveals that despite DRAM suppliers' efforts to trim inventories, they have yet to reach healthy ranges. As they continue to improve their lose situations by boosting capacity utilization rates, the overall demand outlook for this year remains tepid. Additionally, significant price increases by suppliers since 4Q23 are expected to further diminish the momentum for inventory restocking. As a result, DRAM contract prices for the second quarter are projected to see a modest increase of 3-8%.

The shift toward DDR5-compatible CPUs is set to drive an increase in PC DRAM demand in the second quarter. As manufacturers move toward more advanced, cost-efficient production processes for DDR5, their profitability is expected to rise significantly. This anticipation of higher DRAM prices in 1H24 has led to suppliers to aim for price increases in Q2, targeting a 3-8% hike in PC DRAM contract prices. Notably, even though DDR5 prices have already seen a notable rise in Q1—exceeding the average increase for other products—the expected emergence of AI PC demand may lead to a slight moderation in DDR5 price increases in Q2.

SK hynix unveiled a new consumer product based on its latest solid-state drive (SSD), PCB01, which boasts industry-leading performance levels at GPU Technology Conference (GTC) 2024. Hosted by NVIDIA in San Jose, California from March 18-21, GTC is one of the world's leading conferences for AI developers. Applied to on-device AI PCs, PCB01 is a PCIe fifth-generation SSD which recently had its performance and reliability verified by a major global customer. After completing product development in the first half of 2024, SK hynix plans to launch two versions of PCB01 by the end of the year which target both major technology companies and general consumers.

Optimized for AI PCs, Capable of Loading LLMs Within One Second
Offering the industry's highest sequential read speed of 14 gigabytes per second (GB/s) and a sequential write speed of 12 GB/s, PCB01 doubles the speed specifications of its previous generation. This enables the loading of LLMs required for AI learning and inference in less than one second. To make on-device AIs operational, PC manufacturers create a structure that stores an LLM in the PC's internal storage and quickly transfers the data to DRAMs for AI tasks. In this process, the PCB01 inside the PC efficiently supports the loading of LLMs. SK hynix expects these characteristics of its latest SSD to greatly increase the speed and quality of on-device AIs.

GIGABYTE TECHNOLOGY Co. Ltd, a leading manufacturer of premium gaming hardware, today announced new GeForce RTX 3050 6G graphics cards. The GeForce RTX 3050 EAGLE OC 6G and GeForce RTX 3050 OC Low Profile 6G graphics cards are powered by Ampere- NVIDIA's 2nd gen RTX architecture, featuring dedicated RT cores, AI Tensor cores, and fast GDDR6 graphics memory. They deliver the most realistic ray tracing graphics and advanced AI features with DLSS. In addition to providing gamers with a visually stunning and smooth 1080p gaming experience, creators can also indulge in the joy of creative expression.

The GIGABYTE GeForce RTX 3050 EAGLE OC 6G graphics card incorporates futuristic design elements, presenting distinctive and personalized features through cosmic-themed graphics, symbols, and geometric shapes. The GIGABYTE GeForce RTX 3050 EAGLE OC 6G is equipped with the GIGABYTE WINDFORCE cooling system. Featuring unique blade fans, alternate spinning, and fan stop functionalities, this cooling system efficiently lowers the working temperature of the graphics card, ensuring stable performance even under high-demand operations.

In a surprising turn of events, SK Hynix has hinted at the possibility of the Compression Attached Memory Module (CAMM) standard, initially designed for laptops, being introduced to desktop PCs. This revelation came from a comment made by an SK Hynix representative at the CES 2024 in Las Vegas for the Korean tech media ITSubIssub. According to the SK Hynix representative, the first implementation is underway, but there are no specific details. CAMM, an innovative memory standard developed by Dell in 2022, was certified to replace SO-DIMM as the official standard for laptop memory. However, the transition to desktop PCs could significantly disrupt the desktop memory market. The CAMM modules, unlike the vertical DRAM sticks currently in use, are horizontal and are screwed into a socket. This design change would necessitate a complete overhaul of the desktop motherboard layout.

The thin, flat design of the CAMM modules could also limit the number that can be installed on an ATX board. However, the desktop version of the standard CAMM2 was announced by JEDEC just a month ago. It is designed for DDR5 memory, but it is expected to become mainstream with the introduction of DDR6 around 2025. While CAMM allows for higher speeds and densities for mobile memory, its advantages for desktops over traditional memory sticks are yet to be fully understood. Although low-power CAMM modules could offer energy savings, this is typically more relevant for mobile devices than desktops. As we move towards DDR6 and DDR7, more information about CAMM for desktops will be needed to understand its potential benefits. JEDEC's official words on the new standard indicate that "DDR5 CAMM2s are intended for performance notebooks and mainstream desktops, while LPDDR5/5X CAMM2s target a broader range of notebooks and certain server market segments." So, we can expect to see CAMM2 in both desktops and some server applications.

TrendForce reports that the DRAM contract prices are estimated to increase by approximately 13-18% in 1Q24 with mobile DRAM leading the surge. It appears that due to the unclear demand outlook for the entire year of 2024, manufacturers believe that sustained production cuts are necessary to maintain the supply-demand balance in the memory industry.

PC DRAM: The market is buzzing with unfilled DDR5 orders, while savvy buyers brace for a continued surge in DDR4 prices, keeping procurement engines running. This trend, however, is shadowed by a gradual industry pivot toward DDR5, casting uncertainty over the expansion of DDR4 bit procurement volumes. Despite this, both DDR4 and DDR5 prices have yet to hit the target set by manufacturers, and buyers seem ready to ride the wave of price hikes into 1Q24. This sets the stage for an estimated 10-15% in PC DRAM contract prices, with DDR5 poised to take the lead over DDR4 in this pricing rally.

TrendForce reports indicate a universal price increase for both DRAM and NAND Flash starting in the fourth quarter. DRAM prices, for instance, are projected to see a quarterly surge of about 3-8%. Whether this upward momentum can be sustained will hinge on the suppliers' steadfastness in maintaining production cuts and the degree of resurgence in actual demand, with the general-purpose server market being a critical determinant.

PC DRAM: DDR5 prices, having already surged in the third quarter, are expected to maintain their upward trajectory, fueled by the stocking of new CPU models. This forthcoming price hike cycle for both DDR4 and DDR5 is incentivizing PC OEMs to proceed with purchases. Although manufacturers still have substantial inventory and there's no imminent shortage, Samsung has been nudged to further slash its production. However, facing negative gross margins on DRAM products, most manufacturers are resistant to further price reductions, instead pushing for aggressive increases. This stance sets the stage for an anticipated rise in DDR4 prices by 0-5% and DDR5 prices by around 3-8% in the fourth quarter. Overall, as DDR5 adoption accelerates, an approximate 3-8% quarterly increase is projected for PC DRAM contract prices during this period.

TrendForce reports that continued production cuts by DRAM suppliers have led to a gradual quarterly decrease in overall DRAM supply. Seasonal demand, on the other hand, is helping to mitigate inventory pressure on suppliers. TrendForce projects that the third quarter will see the ASP for DRAM converging towards a 0~5% decline. Despite suppliers' concerted efforts, inventory levels persistently remain high, keeping prices low. While production cutbacks may help to curtail quarterly price declines, a tangible recovery in prices may not be seen until 2024.

PC DRAM: The benefits of consolidated production cuts on DDR4 by the top three suppliers are expected to become evident in the third quarter. Furthermore, inventory pressure on suppliers has been partially alleviated due to aggressive purchasing by several OEMs at low prices during 2Q23. Evaluating average price trends for PC DRAM products in 3Q23 reveals that DDR4 will continue to remain in a state of persistent oversupply, leading to an expected quarterly price drop of 3~8%. DDR5 prices—influenced by suppliers' efforts to maintain prices and unmet buyer demand—are projected to see a 0-5% quarterly decline. The overall ASP of PC DRAM is projected to experience a QoQ decline of 0~5% in the third quarter.

The new HEATKILLER V PRO graphics card coolers for Nvidia's RTX 4090 Founders Edition have been specially developed to cope with the high power dissipation of 450 watts and more. In order to achieve the necessary performance increase, the German manufacturer decided to introduce a modular high-performance bottom plate as well as implementing existing proven technologies.

To increase the cooling performance in the GPU core area, Watercool relies on a modular high-performance base plate. Due to a fine-slit fin structure and the resulting increase in the cooling surface, this ensures a significantly higher cooling performance compared to a monolithic design. At the same time, the German manufacturer has optimized the fin structure in order to achieve a high flow rate as well. The distances to heat-relevant components were kept tight, which means that the heat of the thermal problem zones like GDDR6X Ram and voltage converters can be dissipated ideally.

SK hynix Inc. announced today that it will showcase a number of its core and brand-new products at the CES 2023, the most influential tech event in the world taking place in Las Vegas from Jan. 5th through Jan. 8th. The products, introduced under the theme of the "Green Digital Solution," as part of the SK Group's "Carbon-Free Future" campaign, are expected to attract Big Tech customers and experts given the significant improvement in performance and energy efficiency compared with the previous generation as well as the effect of lessening the impact on the environment.

Attention on energy-efficient memory chips has been on the rise as global tech companies pursue products that process data faster, while consuming less energy. SK hynix is confident that its products to be displayed at the CES 2023 will meet customers' such needs with outstanding performance per watt and performance. The core product put forward at the show is PS1010 E3.S, an eSSD product composed of multiple 176-layer 4D NAND that supports the fifth generation of the PCIe interface.

BIOSTAR, a leading manufacturer of motherboards, graphics cards, and storage devices today, is excited to unveil two brand-new Radeon RX 7900 series graphics cards. Powered by the groundbreaking AMD RDNA 3 architecture, BIOSTAR is latest Radeon RX 7900XTX-24GB and RX 7900XT-20GB graphics cards deliver up to 50% more performance per watt than their previous generation RDNA 2 GPU units. Featuring AMD is superior RDNA 3 architecture and the world is fastest interconnect technology, the all-new BIOSTAR Radeon RX 7900XTX and RX 7900XT graphics cards combine 5 nm and 6 nm process nodes with updated chiplets that leverage AMD is Infinity Links and high-performance fanout packaging to deliver blazingly fast 5.3 TB/s bandwidth.

Unleash jaw-droppingly high frame-rates on AAA game titles with breathtaking 4K visuals powered by AMD is most advanced graphics technology with BIOSTAR is Radeon RX 7900XTX and RX 7900XT graphics cards. Ideal for gamers and content creators, they carry AMD is second-generation Infinity Cache technology and high-speed GDDR6 memory with up to a 384-bit memory interface.

GIGABYTE TECHNOLOGY Co. Ltd, a leading manufacturer of premium gaming hardware, today announced the new AMD Radeon RX 7900 Series graphics cards powered by the high-performance, energy-efficient AMD RDNA 3 architecture - the AORUS Radeon RX 7900 XTX ELITE 24G, Radeon RX 7900 XTX GAMING OC 24G, Radeon RX 7900 XTX 24G, Radeon RX 7900 XT GAMING OC 20G and Radeon RX 7900 XT 20G graphics cards. The new graphics cards will be available for purchase on December 13, 2022.

The new graphics cards are the world's first gaming graphics cards to feature an advanced AMD chiplet design, delivering exceptional performance and superb energy efficiency to power high-framerate 4K and higher resolution gaming in the most demanding titles.

According to TrendForce research, rising inflation has weakened demand for consumer products, flattening the peak of peak season. In 3Q22, memory bit consumption and shipments continued to exhibit quarterly decline. Due to a significant decline in memory demand, terminal buyers also delayed purchases, leading to further escalation of supplier inventory pressure. At the same time, the strategies of various DRAM suppliers to increase their market share remain unchanged. There have been cases of "consolidated Q3/Q4 price negotiations" or "negotiating quantity before pricing" in the market, which are the reasons leading to a ballooning of declining DRAM prices to 13~18% in 4Q22.

In terms of PC DRAM, due to weak demand for notebooks, PC OEMs will remain focused on destocking DRAM inventory. While the DRAM supply side has not actually reduced production since operating profit remains favorable, bit output continues to rise and pressure on suppliers' inventory becomes increasingly obvious. From the perspective of DDR4 and DDR5, the price drop forecast in 4Q22 is 13~18% with DDR5 declining more than DDR4. However, as the penetration rate of DDR5 continues to rise, coupled with a higher unit price, the penetration rate of DDR5 in the PC DRAM sector will increase 13~15% in 4Q22, which will buoy the average unit price of overall PC DRAM (combined DDR5 and DDR4) marginally and PC DRAM pricing in 4Q22 is estimated to drop by approximately 10~15%.

During its GTC 2022 session, NVIDIA introduced its new generation of gaming graphics cards based on the novel Ada Lovelace architecture. Dubbed NVIDIA GeForce RTX 40 series, it brings various updates like more CUDA cores, a new DLSS 3 version, 4th generation Tensor cores, 3rd generation Ray Tracing cores, and much more, which you can read about here. However, today, we also got a new Ada Lovelace card intended for the data center. Called the L40, NVIDIA updated its previous Ampere-based A40 design. While the NVIDIA website provides sparse, the new L40 GPU uses 48 GB GDDR6 memory with ECC error correction. Using NVLink, you can get 96GBs of VRAM. Paired with an unknown SKU, we assume that it uses AD102 with adjusted frequencies to lower the TDP and allow for passive cooling.

NVIDIA is calling this their Omniverse GPU, as it is a part of the push to separate its GPUs used for graphics and AI/HPC models. The "L" model in the current product stack is used to accelerate graphics, with display ports installed on the GPU, while the "H" models (H100) are there to accelerate HPC/AI installments where visual elements are a secondary task. This is a further separation of the entire GPU market, where the HPC/AI SKUs get their own architecture, and GPUs for graphics processing are built on a new architecture as well. You can see the specifications provided by NVIDIA below.

Achronix Semiconductor Corporation, a leader in high-performance FPGAs and embedded FPGA (eFPGA) IP, today announced that their VectorPath accelerator card featuring the Speedster 7t FPGA has been certified by PCI-SIG and added to the CEM Add-In card integrators list supporting PCIe Gen4 x16. The VectorPath S7t-VG6 accelerator card is designed to reduce time to market when developing high-performance compute and acceleration functions for AI, ML, networking and data center applications. The VectorPath accelerator cards are available and shipping today for new orders.

"Achronix is an important, strategic partner for BittWare. The Speedster7t FPGA has an innovative architecture that provides significant differentiation in the high-performance FPGA market segment," said Craig Petrie, VP of sales and marketing at BittWare. "Designers can now use the VectorPath accelerator card in PCIe Gen4-based system with the confidence of PCI-SIG certification."

Last week the first details of Dell's CAMM (Compression Attached Memory Module) made an early appearance courtesy of a product leak, but now official details have appeared and the good news is that Dell is saying it won't be a proprietary solution. The Compression Connector looks unlike anything used by consumer computers today and Dell is said to be hoping that it'll be the next industry standard for memory modules, according to PCWorld. The interposer mentioned in the previous news article is also mentioned and allows for a pair of DDR5 SO-DIMMs to be used, albeit with a much taller Z-height.

Dell is apparently planning on getting its CAMM approved by the JEDEC, which is the standards organisation when it comes to memory. However, even if the CAMM format is accepted as a JEDEC standard, Dell holds patents and is likely to charge some kind of royalty fees to interested parties. That said, if it becomes a JEDEC standard, Dell has to follow RAND or Reasonable and Non-Discretionary terms, so the royalty fees would have to be reasonable for JEDEC to agree on making CAMM a standard. The main benefit of Dell's CAMM is that the memory traces end up being shorter and more direct, since the CAMM has a single-sided interface, whereas SO-DIMMs are interfaced on both sides, just like standard DIMMs. This would allow for higher speed memory interfaces, without the need of using something like signal re-drivers or re-timers.

During Samsung's Tech Day 2021, the company presented some interesting insights about the future of system memory technologies and how it plans to execute its production. Starting with the latest DDR5 standard, the company intends to follow JEDEC documents and offer some overclocking modules that surpass the specification advised by JEDEC. While the DDR5 standard specifies memory modules with 6,400 MT/s, Samsung will develop modules capable of overclocking up to 8,400 MT/s. These are not yet confirmed as they are still in the development phase. However, we can expect to see them in the later life of DDR5 memory.

The company also talked about the DDR6 standard, which is supposedly twice as fast as DDR5. The new DDR6 standard is still in early development, and all we know so far is that the number of memory channels per module is seeing a twofold increase over DDR5 to four channels. The number of memory banks also increases to 64. In addition to DDR6 for desktop and server use cases, the company is also working on Low Power DDR6 (LPDDR6) for mobile applications. While the company's LPDDR5 memory goes into volume production using the 1a-nm process at the beginning of 2022, the LPDDR6 is still in early development. The base speed for DDR6 modules will allegedly arrive at 12,800 MT/s, while overclocking modules will join the party at up to 17,000 MT/s. Mobile-oriented LPDDR6 version is also supposed to come with up to 17,000 MT/s speeds.

Gigabyte Technology Co. Ltd, a leading manufacturer of premium gaming hardware, today announced a new AMD Radeon RX 6600 graphics card - the Gigabyte Radeon RX 6600 Eagle 8G. The Eagle graphics card is the best choice for those who desire a unique design optimized for power efficiency and durability, and the ability to experience incredible high-framerate 1080p gaming.

AMD Radeon RX 6600 graphics cards are based on the breakthrough AMD RDNA 2 gaming architecture, designed to deliver the optimal balance of performance and power efficiency. Offering 32 MB of high-performance AMD Infinity Cache, 8 GB of GDDR6 memory, AMD Smart Access Memory technology and other advanced features, the new graphics cards are designed to bring next-generation desktop gaming experiences to the midrange market. They also support AMD FidelityFX Super Resolution, an open-source spatial upscaling solution designed to increase framerates in select titles while delivering high-resolution gaming experiences.

Today, Lenovo announced the latest additions to its ThinkPad and ThinkVision portfolios. The redesigned and re-engineered ThinkPad X1 Extreme Gen 4 delivers more power, better connectivity and rich configuration options in response to customer demand. Powered by up to the latest 11th Gen Intel Core i9 H-Series vPro processors and available with the latest NVIDIA GeForce RTX Laptop GPUs, up to 64 GB DDR4 memory and dual Solid-State Drive (SSD) support, the X1 Extreme Gen 4 is also offered with optional 5G Wireless WAN for high-speed access to cloud data.

With 74 percent of companies planning to permanently shift to more remote working, users need an exceptional collaboration experience. X1 Extreme Gen 4 delivers in spades, thanks to edge-to-edge 16-inch display options up to 4K along with Dolby Vision support, a new FHD webcam, dual noise-cancelling microphones and a user-facing Dolby Atmos Speaker System that is 20 percent larger than previous generation. All this performance wrapped in a legendary ThinkPad durable package that weighs less the 1.81 kg (four pounds).

The PC5 DDR5 main memory standard could enter the market by 2020, according to SK Hynix research fellow Kim Dong-Kyun. The first such memory standard will be DDR5-5200, which offers nearly double the bandwidth of DDR4-2666. "We are discussing several concepts of the post DDR5," he said. "One concept is to maintain the current trend of speeding up the data transmission, and another is to combine the DRAM technology with system-on-chip process technologies, such as CPU," he added, without offering any additional information. SK Hynix had in 2018 developed a working prototype of a 16-gigabit (2 GB) DDR5 DRAM chip ticking at 5200 MT/s, at 1.1 Volts. A 64-bit wide memory module made with these chips could offer bandwidth of 41.6 GB/s.

SK Hynix is developing its own innovations that could make its DDR5 chips more advanced than the competition without going off-standard. "We have developed a multi-phase synchronization technology that enables keeping the voltage during a high-speed operation in a chip at a low level by placing multiple phases within the IP circuit, so the power used on each phase is low but the speed is high when combined," Kim said. He also mentioned that development of the DDR6 PC memory standard is already underway, with the design goals of doubling bandwidth and densities over DDR5. Advancements in DRAM are propelled not just by the PC ecosystem, but also handhelds and self-driving car electronics.