• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

SK hynix Introduces Industry's First CXL-based Computational Memory Solution (CMS) at the OCP Global Summit

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
47,378 (7.52/day)
Location
Hyderabad, India
System Name RBMK-1000
Processor AMD Ryzen 7 5700G
Motherboard ASUS ROG Strix B450-E Gaming
Cooling DeepCool Gammax L240 V2
Memory 2x 8GB G.Skill Sniper X
Video Card(s) Palit GeForce RTX 2080 SUPER GameRock
Storage Western Digital Black NVMe 512GB
Display(s) BenQ 1440p 60 Hz 27-inch
Case Corsair Carbide 100R
Audio Device(s) ASUS SupremeFX S1220A
Power Supply Cooler Master MWE Gold 650W
Mouse ASUS ROG Strix Impact
Keyboard Gamdias Hermes E2
Software Windows 11 Pro
Just two months after introducing the first CXL memory sample in August, SK hynix has successfully developed a computational memory solution, becoming the industry's first to integrate computational functions into CXL memory. The solution, a result of a close collaboration with SK Telecom from early on for optimization of the next-generation, high-performance computing infra system, marks a meaningful case where SK Group's ICT companies converged their technologies for a joint development.

Unveiling both the CMS and its software platform at the Open Compute Project (OCP) Global Summit 2022 taking place from Oct. 18 in San Jose, USA, SK hynix showed a next-generation high-performance computing infrastructure solution as well as the value of the solution from the customer's perspective. The solution is expected to be installed on next-generation server platforms to improve system performance as well as energy efficiency.



Integrated Solution for Memory, Computational Functions Introduced
CXL (Compute eXpress Link), a base technology for the latest development, is a new interconnect technology designed to promote efficiency of various solutions such as GPU, AI accelerator and memory.

Among the advantages of CXL that have caught the attention of the industry is its flexible increase in memory capacity. CXL enables the flexible expansion of a system's memory capacity by installing a memory card like a GPU or SSD. SK hynix focused on CXL's technological characteristic of supporting both memory and accelerator to proceed with a preemptive research and development and, consequently, come up with the latest integrated solution. Park Kyoung, Head of Memory System Research at SK hynix, noted, "CXL has created an opportunity for memory providers."

The CMS technology provides not only the advantage of CXL but also showcases advantages of machine learning and data filtering computation functions frequently performed by big data analysis applications. The solution also screens operations that are inefficient for the CPU to perform or that consume a lot of energy during the transfer of data between the memory and the CPU. Park Kyoung, announcing follow-up research and development plans, said, "Through the internalization of computational functions, CMS enabled performance several times faster than that of dozens of CPU cores in specific computations. Considering that this is just a prototype, we think we can improve the performance even further and are considering applying the technology to other applications such as big data."

Convergence of SK Group companies' leading technologies
Park also said, "When introducing new technologies and their solutions to the market, it is important to prove their value from the customer's point of view, but the possible scope of collaboration with customers is relatively limited, especially for data-center server areas. In that sense, collaboration with SK Telecom provided a great opportunity to bring the CMS into reality. SK Telecom's experience in AI/Big Data-based service infrastructure development and operations was reflected in each part of the development process." In order to efficiently process large amounts of data, SK Telecom has developed and ran in various commercial services its own Lightning DB, an in-memory data analytics platform.

The two companies proceeded with development of both CMS and CMS-applied Lightning DB simultaneously. Through this process, SK hynix was able to discover and apply the computational functions required by customers, and SK Telecom was able to enhance the competitiveness of its platform.

Yang Seung-ji, Vice President and Head of Vision R&D at SK Telecom, said, "It is common for hardware solutions of a new concept to take a considerable amount of time to prove their effectiveness from a software application's point of view. But this time, meaningful computations for SK Telecom's actual application services were selected, which helped us save a significant amount of time by jointly performing all processes from structure design of hardware-software to development and verification." Yang continued, "As we verified the performance improvements of the solutions, we plan to apply them to screening tasks that increase accuracy in large-scale AI learning data in the future and use them to strengthen the competitiveness of SK Telecom's AI service."

SK Group's ICT affiliates have been operating R&D projects for synergies to converge various technologies of related companies that encompass semiconductors, hardware solutions, software platforms, and AI services. Lee Jong-min, Vice President and Head of Future R&D at SK Telecom, said, "This case is significant in that we successfully developed a leading technology by combining AI and semiconductor capabilities of SK Telecom and SK hynix together. We will continue to provide new technology-based value to customers and contribute to the ICT R&D ecosystem globally."

The CXL memory solution prototype developed by SK hynix and the big data analysis platform optimized together with SK Telecom will be unveiled initially at the Open Compute Project (OCP) Global Summit and will also be demonstrated at the SK Tech Summit in Korea in early November. In the future, SK hynix plans to actively conduct R&D and collaborations related to CXL memory that provides added value from the customer's point of view.

View at TechPowerUp Main Site
 
Joined
Apr 18, 2019
Messages
2,424 (1.16/day)
Location
Olympia, WA
System Name Sleepy Painter
Processor AMD Ryzen 5 3600
Motherboard Asus TuF Gaming X570-PLUS/WIFI
Cooling FSP Windale 6 - Passive
Memory 2x16GB F4-3600C16-16GVKC @ 16-19-21-36-58-1T
Video Card(s) MSI RX580 8GB
Storage 2x Samsung PM963 960GB nVME RAID0, Crucial BX500 1TB SATA, WD Blue 3D 2TB SATA
Display(s) Microboard 32" Curved 1080P 144hz VA w/ Freesync
Case NZXT Gamma Classic Black
Audio Device(s) Asus Xonar D1
Power Supply Rosewill 1KW on 240V@60hz
Mouse Logitech MX518 Legend
Keyboard Red Dragon K552
Software Windows 10 Enterprise 2019 LTSC 1809 17763.1757
Are these types of devices something to expect as PCIe 5.0 becomes more common?

Personally, I get a sort of thrill, using 'industry' kit in my own builds.

Perhaps we could get a small editorial on PCIe 5.0 and CXL?
 
Joined
Oct 15, 2004
Messages
189 (0.03/day)
Location
Peterborough, UK
System Name IONE
Processor AMD Ryzen 9 5900X
Motherboard ASUS STRIX B550-A Gaming
Cooling Noctua NH-U12S SE-AM4
Memory 128GB (4x32GB) Corsair DDR4 Vengeance LPX Black, PC4-25600 (3200), CMK128GX4M4E3200C16
Video Card(s) PNY GeForce RTX 3080 12GB
Storage Samsung 980 1TB NVMe (system), Lexar NM790 4TB NVMe (temp), 16x Seagate IronWolf 10TB RAID6
Display(s) Dell UP3017
Case Lian-Li PC-777B
Audio Device(s) Focal Alpha 65 Evo
Power Supply Corsair AX1200
Mouse Logitech M510
Keyboard Keychron Q10, brass plate, Kailh Box Summer switches and PBT Cherry keycaps
Software Xubuntu 24.04
Benchmark Scores N/A
Are these types of devices something to expect as PCIe 5.0 becomes more common?

Personally, I get a sort of thrill, using 'industry' kit in my own builds.

Perhaps we could get a small editorial on PCIe 5.0 and CXL?
I wouldn't expect CXL of any kind outside of servers for a very long time.

Here you have a suitable amount of CXL articles to get you started: https://www.servethehome.com/?s=cxl
 
Joined
Jan 3, 2021
Messages
3,676 (2.51/day)
Location
Slovenia
Processor i5-6600K
Motherboard Asus Z170A
Cooling some cheap Cooler Master Hyper 103 or similar
Memory 16GB DDR4-2400
Video Card(s) IGP
Storage Samsung 850 EVO 250GB
Display(s) 2x Oldell 24" 1920x1200
Case Bitfenix Nova white windowless non-mesh
Audio Device(s) E-mu 1212m PCI
Power Supply Seasonic G-360
Mouse Logitech Marble trackball, never had a mouse
Keyboard Key Tronic KT2000, no Win key because 1994
Software Oldwin
Are these types of devices something to expect as PCIe 5.0 becomes more common?

Personally, I get a sort of thrill, using 'industry' kit in my own builds.

Perhaps we could get a small editorial on PCIe 5.0 and CXL?
One thing is for sure - it won't be low latency.

See this article on Semianalysis, it's not a basic primer but it helps explain where CXL belongs. The added latency due to the CXL link is estimated at 67 to 87 ns, which amounts to 200-250 cycles @ DDR5-6000. In return, you get the ability to dynamically share a pool of RAM between several CPUs.
 
Top