Friday, October 20th 2023
SK hynix Displays Next-Gen Solutions Set to Unlock AI and More at OCP Global Summit 2023
SK hynix showcased its next-generation memory semiconductor technologies and solutions at the OCP Global Summit 2023 held in San Jose, California from October 17-19. The OCP Global Summit is an annual event hosted by the world's largest data center technology community, the Open Compute Project (OCP), where industry experts gather to share various technologies and visions. This year, SK hynix and its subsidiary Solidigm showcased advanced semiconductor memory products that will lead the AI era under the slogan "United Through Technology".
SK hynix presented a broad range of its solutions at the summit, including its leading HBM(HBM3/3E), CXL, and AiM products for generative AI. The company also unveiled some of the latest additions to its product portfolio including its DDR5 RDIMM, MCR DIMM, enterprise SSD (eSSD), and LPDDR CAMM devices. Visitors to the HBM exhibit could see HBM3, which is utilized in NVIDIA's H100, a high-performance GPU for AI, and also check out the next-generation HBM3E. Due to their low-power consumption and ultra-high-performance, these HBM solutions are more eco-friendly and are particularly suitable for power-hungry AI server systems.Three of SK hynix's key CXL products were demonstrated at the event, including its CXL-based computational memory solution (CMS) 2.0. A next-generation memory solution that integrates computational functions into CXL memory, CMS 2.0 uses NMP to minimize data movement between the CPU and memory. For the demonstration, CMS 2.0 was applied to SK Telecom's real-time foot traffic analysis service, illustrating its data processing power equivalent to a server CPU. Moreover, the demonstration highlighted that CMS 2.0 can improve data processing performance and energy efficiency.
The company also demonstrated its CXL-based pooled memory solution which can significantly reduce idle memory usage and shorten the overhead time of data movement in distributed processing environments such as AI and big data. The demonstration, which featured a technological collaboration with software provider MemVerge, showcased how CXL-based pooled memory solutions can improve system performance in AI and big data distributed processing systems.
Additionally, SK hynix demonstrated its CXL-based memory expander applied to Meta's software caching engine, CacheLib, which showed how the CXL-based memory solution optimizes software for improved performance and cost savings.
AiM, a game-changing technology that redefines memory's role in AI inference, was also presented at the booth. A subset of SK hynix's PIM portfolio, AiM promises to revolutionize machine learning, high-performance computing, and big data applications while reducing operating costs. The company demonstrated its GDDR6-AiM, a solution which incorporates computational capabilities into the memory and improves the performance and efficiency of data-intensive generative AI inference systems. Additionally, a demonstration was held for the prototype of AiMX, an innovative generative AI accelerator card based on GDDR6-AiM.
SK hynix also showcased the PS1010 E3.S, a PCIe (Peripheral Component Interconnect Express) Gen 5-based eSSD. Designed for data-intensive applications, cloud computing, and AI workloads, the PS1010 E3.S promises improved performance and reliability with superior speed and lower carbon emissions compared to previous generations.
Through thought-provoking talks and sessions at the summit, SK hynix also suggested the future development of next-generation memory solutions.
In a panel session titled "Data Central Computing, Present and Future", Hoshik Kim, fellow of the System Architecture Group in Memory Forest x&D, joined other industry experts to omputing and programming models. Kim also held an executive session in which he revealed SK hynix's progress in developing CXL technology and shared the company's vision under the theme of "CXL: A Prelude to a Memory-Centric Computing".
The potential of CXL was also the focal point of three other sessions held by the company's employees from the Memory x&D department. Youngpyo Joo, head of the Software Solutions Group, explored how CXL-based computational memory solution architecture can offer increased usability and flexibility.
Meanwhile, Donguk Moon, technical leader of the Platform Software team, introduced how emerging CXL devices can enhance memory capacity and bandwidth at the caching layer for technologies such as AI and web services. In addition, Jungmin Choi, technical leader of the Composable Memory team, covered how the latest CXL technology will further support the disaggregation of memory. Choi also emphasized that this technology can not only solve problems currently faced by data centers such as idle memory, but also improve system performance.In another engaging session, Euicheol Lim, head of the Memory Solution Product Design Group, explored the potential for PIM technology to meet the high memory and computational demands of AI. Lim highlighted key technologies based on PIM, including SK hynix's PIM-based AiM accelerator.
Advanced Solutions to Unlock Next-Generation Technologies
As the OCP Global Summit 2023 drew to a close, SK hynix reinforced its commitment to developing groundbreaking solutions which can help realize advanced technologies such as AI. Going forward, the company will continue to tackle industry challenges and make technological breakthroughs for the AI era as the global no.1 AI memory solution provider.
Source:
SK Hynix
SK hynix presented a broad range of its solutions at the summit, including its leading HBM(HBM3/3E), CXL, and AiM products for generative AI. The company also unveiled some of the latest additions to its product portfolio including its DDR5 RDIMM, MCR DIMM, enterprise SSD (eSSD), and LPDDR CAMM devices. Visitors to the HBM exhibit could see HBM3, which is utilized in NVIDIA's H100, a high-performance GPU for AI, and also check out the next-generation HBM3E. Due to their low-power consumption and ultra-high-performance, these HBM solutions are more eco-friendly and are particularly suitable for power-hungry AI server systems.Three of SK hynix's key CXL products were demonstrated at the event, including its CXL-based computational memory solution (CMS) 2.0. A next-generation memory solution that integrates computational functions into CXL memory, CMS 2.0 uses NMP to minimize data movement between the CPU and memory. For the demonstration, CMS 2.0 was applied to SK Telecom's real-time foot traffic analysis service, illustrating its data processing power equivalent to a server CPU. Moreover, the demonstration highlighted that CMS 2.0 can improve data processing performance and energy efficiency.
The company also demonstrated its CXL-based pooled memory solution which can significantly reduce idle memory usage and shorten the overhead time of data movement in distributed processing environments such as AI and big data. The demonstration, which featured a technological collaboration with software provider MemVerge, showcased how CXL-based pooled memory solutions can improve system performance in AI and big data distributed processing systems.
Additionally, SK hynix demonstrated its CXL-based memory expander applied to Meta's software caching engine, CacheLib, which showed how the CXL-based memory solution optimizes software for improved performance and cost savings.
AiM, a game-changing technology that redefines memory's role in AI inference, was also presented at the booth. A subset of SK hynix's PIM portfolio, AiM promises to revolutionize machine learning, high-performance computing, and big data applications while reducing operating costs. The company demonstrated its GDDR6-AiM, a solution which incorporates computational capabilities into the memory and improves the performance and efficiency of data-intensive generative AI inference systems. Additionally, a demonstration was held for the prototype of AiMX, an innovative generative AI accelerator card based on GDDR6-AiM.
SK hynix also showcased the PS1010 E3.S, a PCIe (Peripheral Component Interconnect Express) Gen 5-based eSSD. Designed for data-intensive applications, cloud computing, and AI workloads, the PS1010 E3.S promises improved performance and reliability with superior speed and lower carbon emissions compared to previous generations.
Through thought-provoking talks and sessions at the summit, SK hynix also suggested the future development of next-generation memory solutions.
In a panel session titled "Data Central Computing, Present and Future", Hoshik Kim, fellow of the System Architecture Group in Memory Forest x&D, joined other industry experts to omputing and programming models. Kim also held an executive session in which he revealed SK hynix's progress in developing CXL technology and shared the company's vision under the theme of "CXL: A Prelude to a Memory-Centric Computing".
The potential of CXL was also the focal point of three other sessions held by the company's employees from the Memory x&D department. Youngpyo Joo, head of the Software Solutions Group, explored how CXL-based computational memory solution architecture can offer increased usability and flexibility.
Meanwhile, Donguk Moon, technical leader of the Platform Software team, introduced how emerging CXL devices can enhance memory capacity and bandwidth at the caching layer for technologies such as AI and web services. In addition, Jungmin Choi, technical leader of the Composable Memory team, covered how the latest CXL technology will further support the disaggregation of memory. Choi also emphasized that this technology can not only solve problems currently faced by data centers such as idle memory, but also improve system performance.In another engaging session, Euicheol Lim, head of the Memory Solution Product Design Group, explored the potential for PIM technology to meet the high memory and computational demands of AI. Lim highlighted key technologies based on PIM, including SK hynix's PIM-based AiM accelerator.
Advanced Solutions to Unlock Next-Generation Technologies
As the OCP Global Summit 2023 drew to a close, SK hynix reinforced its commitment to developing groundbreaking solutions which can help realize advanced technologies such as AI. Going forward, the company will continue to tackle industry challenges and make technological breakthroughs for the AI era as the global no.1 AI memory solution provider.
Comments on SK hynix Displays Next-Gen Solutions Set to Unlock AI and More at OCP Global Summit 2023
There are no comments yet.