• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Intel Reveals the "What" and "Why" of CXL Interconnect, its Answer to NVLink

bug

Joined
May 22, 2015
Messages
13,799 (3.96/day)
Processor Intel i5-12600k
Motherboard Asus H670 TUF
Cooling Arctic Freezer 34
Memory 2x16GB DDR4 3600 G.Skill Ripjaws V
Video Card(s) EVGA GTX 1060 SC
Storage 500GB Samsung 970 EVO, 500GB Samsung 850 EVO, 1TB Crucial MX300 and 2TB Crucial MX500
Display(s) Dell U3219Q + HP ZR24w
Case Raijintek Thetis
Audio Device(s) Audioquest Dragonfly Red :D
Power Supply Seasonic 620W M12
Mouse Logitech G502 Proteus Core
Keyboard G.Skill KM780R
Software Arch Linux + Win10
There is some level of anti-Intel obsession here. Like Intel owes something to anybody, meanwhile nVidia and AMD proprietary solutions are looked as "meah, nothing to see, look away". Yes CCIX is AMD's baby, and others are "contributors".
CXL, besides Intel, has already gained a lot of support from other big names interested in computing, so put that in perspective:
https://www.computeexpresslink.org/members

ARM, Google, Cisco, Facebook, alibaba, Dell, HP, Huawei, Lenovo, Microsoft, Microchip... they are all into giving Intel free money???
A standard is as strong as the money behind it and the adoption by industry. Better standard (by al measures) will win.
I will add to that: a standard in an agreed upon way of doing things. The trouble is, it's hard to do stuff for the first(ish) time and agree with everybody else.
So oftentimes, when companies decide to go at it by themselves, it's not because they're after your cash (well, they are in the end), but because they need a product out there.
 
Joined
Jan 17, 2018
Messages
64 (0.03/day)
There is some level of anti-Intel obsession here. Like Intel owes something to anybody, meanwhile nVidia and AMD proprietary solutions are looked as "meah, nothing to see, look away". Yes CCIX is AMD's baby, and others are "contributors".
CXL, besides Intel, has already gained a lot of support from other big names interested in computing, so put that in perspective:
https://www.computeexpresslink.org/members

ARM, Google, Cisco, Facebook, alibaba, Dell, HP, Huawei, Lenovo, Microsoft, Microchip... they are all into giving Intel free money???
A standard is as strong as the money behind it and the adoption by industry. Better standard (by al measures) will win.

I think you missed your own point. Intel locks down their tech all the time. Thunderbolt being the latest. They have a proprietary 200g network adapter as well as a long history of this. While AMD is the opposite. Freesync, opencl support, opengl, Tressfx, etc. I don't care who makes it, as long as it is truly open. AMD has a good record of going open. Intel, not so much. I do admire your faith that this will definitely and without question be the first time without strings attached. I just don't share it.
 

bug

Joined
May 22, 2015
Messages
13,799 (3.96/day)
Processor Intel i5-12600k
Motherboard Asus H670 TUF
Cooling Arctic Freezer 34
Memory 2x16GB DDR4 3600 G.Skill Ripjaws V
Video Card(s) EVGA GTX 1060 SC
Storage 500GB Samsung 970 EVO, 500GB Samsung 850 EVO, 1TB Crucial MX300 and 2TB Crucial MX500
Display(s) Dell U3219Q + HP ZR24w
Case Raijintek Thetis
Audio Device(s) Audioquest Dragonfly Red :D
Power Supply Seasonic 620W M12
Mouse Logitech G502 Proteus Core
Keyboard G.Skill KM780R
Software Arch Linux + Win10
I think you missed your own point. Intel locks down their tech all the time. Thunderbolt being the latest. They have a proprietary 200g network adapter as well as a long history of this. While AMD is the opposite. Freesync, opencl support, opengl, Tressfx, etc. I don't care who makes it, as long as it is truly open. AMD has a good record of going open. Intel, not so much. I do admire your faith that this will definitely and without question be the first time without strings attached. I just don't share it.
You have a really black or white view of things there.
Intel had an open source video driver for Linux long before AMD. Also: https://en.wikipedia.org/wiki/Thunderbolt_(interface)#Royalty_situation
AMD has to go the open route. They're the underdog, they can't sell closed solutions. If things changed, I'm pretty sure they'd reconsider their approach.
 
Joined
Sep 27, 2014
Messages
550 (0.15/day)
So Intel should be nationalized, and then government should provide all those standards for free to everyone else in the world. Like they use freely the GPS.
Got it.
 
  • Like
Reactions: bug
Joined
Oct 22, 2014
Messages
14,117 (3.82/day)
Location
Sunshine Coast
System Name H7 Flow 2024
Processor AMD 5800X3D
Motherboard Asus X570 Tough Gaming
Cooling Custom liquid
Memory 32 GB DDR4
Video Card(s) Intel ARC A750
Storage Crucial P5 Plus 2TB.
Display(s) AOC 24" Freesync 1m.s. 75Hz
Mouse Lenovo
Keyboard Eweadn Mechanical
Software W11 Pro 64 bit
Joined
Apr 12, 2013
Messages
7,555 (1.78/day)
This is not for your desktop Steeevo, this is for servers where the bandwidth isn't as much for single device performance but for device to device performance. X8 may be fine for a single gpu to not lose performance, but not if it wants to work with 15 others and compete against nvlink. This is also intel railroading and not joining the other consortiums... which are already open standards Now... not to be opened on 2nd gen. This is a desperate lock-in attempt for their cascade lake failings.
I don't believe PCIe 4.0 will have such a bottleneck even for huge server farms ~ Why AMD EPYC Rome 2P Will Have 128-160 PCIe Gen4 Lanes

Having said that each use(r) case is different, so while some enterprses may need the extra lanes - they should have plenty to spare with PCIe 4.0 perhpas with the exception of (extreme) edge cases.

Some key points wrt competing solutions ~
https://www.openfabrics.org/images/eventpresos/2017presentations/213_CCIXGen-Z_BBenton.pdf
https://www.csm.ornl.gov/workshops/...chnology Overview, Trends, and Alignments.pdf
 
Last edited:
Joined
Jan 17, 2018
Messages
64 (0.03/day)
You have a really black or white view of things there.
Intel had an open source video driver for Linux long before AMD. Also: https://en.wikipedia.org/wiki/Thunderbolt_(interface)#Royalty_situation
AMD has to go the open route. They're the underdog, they can't sell closed solutions. If things changed, I'm pretty sure they'd reconsider their approach.

LOL, so, open solutions are only for losers who have no choice but to market that way? What does that say about thunderbolt? Do you think they dropped the royalties because it was such a rousing success? It's not about black, white, blue, green, or whatever. Although I'll give you, Nvidia makes Intel look like choir boys when it comes to this. I really could care less about who comes up with what, as I said. And true innovation should be rewarded, but warming over similar tech to others in order to lock players out of one market or another is not right, and just not something I support. Optane is an original idea and more power to them for leveraging it, CXL is not.
 
Joined
Sep 15, 2011
Messages
6,741 (1.40/day)
Processor Intel® Core™ i7-13700K
Motherboard Gigabyte Z790 Aorus Elite AX
Cooling Noctua NH-D15
Memory 32GB(2x16) DDR5@6600MHz G-Skill Trident Z5
Video Card(s) ZOTAC GAMING GeForce RTX 3080 AMP Holo
Storage 2TB SK Platinum P41 SSD + 4TB SanDisk Ultra SSD + 500GB Samsung 840 EVO SSD
Display(s) Acer Predator X34 3440x1440@100Hz G-Sync
Case NZXT PHANTOM410-BK
Audio Device(s) Creative X-Fi Titanium PCIe
Power Supply Corsair 850W
Mouse Logitech Hero G502 SE
Software Windows 11 Pro - 64bit
Benchmark Scores 30FPS in NFS:Rivals
All big talk and nothing concrete. By date, there isn't even 1 mobo with PCI-X 4.0 out there, not to mention CPUs that support it (yet)
 

bug

Joined
May 22, 2015
Messages
13,799 (3.96/day)
Processor Intel i5-12600k
Motherboard Asus H670 TUF
Cooling Arctic Freezer 34
Memory 2x16GB DDR4 3600 G.Skill Ripjaws V
Video Card(s) EVGA GTX 1060 SC
Storage 500GB Samsung 970 EVO, 500GB Samsung 850 EVO, 1TB Crucial MX300 and 2TB Crucial MX500
Display(s) Dell U3219Q + HP ZR24w
Case Raijintek Thetis
Audio Device(s) Audioquest Dragonfly Red :D
Power Supply Seasonic 620W M12
Mouse Logitech G502 Proteus Core
Keyboard G.Skill KM780R
Software Arch Linux + Win10
LOL, so, open solutions are only for losers who have no choice but to market that way? What does that say about thunderbolt? Do you think they dropped the royalties because it was such a rousing success? It's not about black, white, blue, green, or whatever. Although I'll give you, Nvidia makes Intel look like choir boys when it comes to this. I really could care less about who comes up with what, as I said. And true innovation should be rewarded, but warming over similar tech to others in order to lock players out of one market or another is not right, and just not something I support. Optane is an original idea and more power to them for leveraging it, CXL is not.
Do not put words in my mouth. Open solution are generally better. But they are contingent on existing expertise and participants agreeing with each other. Public companies on the other hand are primarily accountable to their shareholders and have to think about profit first.
 
Joined
Sep 27, 2014
Messages
550 (0.15/day)
When open solutions will be building their first CPU, then good for them.
Until then, if Intel will add support in their CPU for something, it will became a defacto standard.

And yes, building for profit works, provides money for future research and development.

Open solutions don't work by themselves, they are supported by the evil non open products. Nobody likes to work for free, even the kids in their parents bedrooms want money for new phones, movie tickets with their dates, gas money...
 
  • Like
Reactions: bug
Joined
Oct 27, 2009
Messages
1,185 (0.21/day)
Location
Republic of Texas
System Name [H]arbringer
Processor 4x 61XX ES @3.5Ghz (48cores)
Motherboard SM GL
Cooling 3x xspc rx360, rx240, 4x DT G34 snipers, D5 pump.
Memory 16x gskill DDR3 1600 cas6 2gb
Video Card(s) blah bigadv folder no gfx needed
Storage 32GB Sammy SSD
Display(s) headless
Case Xigmatek Elysium (whats left of it)
Audio Device(s) yawn
Power Supply Antec 1200w HCP
Software Ubuntu 10.10
Benchmark Scores http://valid.canardpc.com/show_oc.php?id=1780855 http://www.hwbot.org/submission/2158678 http://ww
I don't believe PCIe 4.0 will have such a bottleneck even for huge server farms ~ Why AMD EPYC Rome 2P Will Have 128-160 PCIe Gen4 Lanes

Having said that each use(r) case is different, so while some enterprses may need the extra lanes - they should have plenty to spare with PCIe 4.0 perhpas with the exception of (extreme) edge cases.

Some key points wrt competing solutions ~
https://www.openfabrics.org/images/eventpresos/2017presentations/213_CCIXGen-Z_BBenton.pdf
https://www.csm.ornl.gov/workshops/openshmem2017/presentations/Benton - OpenCAPI, Gen-Z, CCIX- Technology Overview, Trends, and Alignments.pdf


Intel is skipping pcie 4 and going straight to 5 with this custom "optional" alternative proprietary protocol. So while AMD's Pcie 4 with CCIX and 128+++ pcie lanes** is enough for accelerators Intel has max 80 lanes of pcie 3.0 per cascade lake 2p or 4p... They need more and can catch up/pass AMD with 80 lanes of pcie 5.0.

**(160 lanes requires cutting cpu interconnects from 4 to 3/ While flexibility is nice, this is by far not optimal for compute intensive setups. Naples suffered due to interconnect saturation with nvme devices, While the bandwidth has doubled the core count has as well. Time will tell if the ram speed bump, and I/O die brings enough of an improvement to offset the loss of an interconnect.

AMD also has a 4 gpu infinity fabric ringbus that takes the load off the cpu. infinity fabric is very similar to ccix in being an alternative lower latency protocol over pcie.

Also, whoever mentioned no pcie 4 boards being on the market is only half correct, no x86 boards, but powerpc has had them for awhile, and I think a few arm boards.
2nd fun fact, powerpc chips have nvlink interconnects on die, so rather than connecting to nvlink gpus through a pcie switch... they are part of the mesh.
 
Last edited:
Joined
Apr 12, 2013
Messages
7,555 (1.78/day)
Intel is skipping pcie 4 and going straight to 5 with this custom "optional" alternative proprietary protocol.
They have PCIe 4.0 lined up however Intel's road-map change so often & they have so many overlapping ones that it's virtually impossible to say what they'll "release" next & if it'll just be a paper launch.


powerpc chips have nvlink interconnects on die
Yes & NVlink was designed with IBM, it's a GPU-GPU & GPU-CPU interconnect that's why I said it's nothing like CXL, it's more akin to IF.
 
Top