Samsung Hopes PIM Memory Technology Can Replace HBM in Next-Gen AI Applications

[Nomad76]

The 8th edition of the Samsung AI Forum was held on November 4th and 5th in Seoul, and among all the presentations and keynote speeches, one piece of information caught our attention. As reported by The Chosun Daily, Samsung is (again) turning its attention to Processing-in-Memory (PIM) technology, in what appears to be the company's latest attempt to keep up with its rival SK Hynix in this area. In 2021, Samsung introduced the world's first HBM-PIM, the chips showing impressive gains in performance (nearly double) while reducing energy consumption by almost 50% on average. PIM technology basically adds the processor functions necessary for computational tasks, reducing data transfer between the CPU and memory.

Now, the company hopes that PIM memory chips could replace HBM in the future, based on the advantages this next-generation memory technology possesses, mainly for artificial intelligence (AI) applications. "AI is transforming our lives at an unprecedented rate, and the question of how to use AI more responsibly is becoming increasingly important," said Samsung Electronics CEO Han Jong-hee in his opening remarks. "Samsung Electronics is committed to fostering a more efficient and sustainable AI ecosystem." During the event, Samsung also highlighted its partnership with AMD, which reportedly supplies AMD with its fifth-generation HBM, the HBM3E.



View at TechPowerUp Main Site | Source

 

[Wirko]

Did Samsung or Hynix ever offer at least a basic explanation of what the processing logic is capable of?

 

[bonehead123]

Did Samsung or Hynix ever offer at least a basic explanation of what the processing logic is capable of?

Of course they did, but like most things nowadayz, that info is behind a paywall, so you have to pony up some $$ if you want the nitty-gritty, hahahaha

Aint capitalism a snotty, slimy biotch ?

 

[kondamin]

Did Samsung or Hynix ever offer at least a basic explanation of what the processing logic is capable of?

Very basic stuff, adding and subtracting, logic operations.
say you have a simple Database that has a constant stream of transactions on it, that would be a job the memory processors would be doing.

dont know how I feel about it as there is little to make certain the computaion was right, but much smarter people than me are making it so…