• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

NVIDIA Unveils the Tesla P100 HPC Board based on "Pascal" Architecture

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
47,201 (7.56/day)
Location
Hyderabad, India
System Name RBMK-1000
Processor AMD Ryzen 7 5700G
Motherboard ASUS ROG Strix B450-E Gaming
Cooling DeepCool Gammax L240 V2
Memory 2x 8GB G.Skill Sniper X
Video Card(s) Palit GeForce RTX 2080 SUPER GameRock
Storage Western Digital Black NVMe 512GB
Display(s) BenQ 1440p 60 Hz 27-inch
Case Corsair Carbide 100R
Audio Device(s) ASUS SupremeFX S1220A
Power Supply Cooler Master MWE Gold 650W
Mouse ASUS ROG Strix Impact
Keyboard Gamdias Hermes E2
Software Windows 11 Pro
NVIDIA unveiled the Tesla P100, the first product based on the company's "Pascal" GPU architecture. At its core is a swanky new multi-chip module, similar in its essential layout to the AMD "Fiji." A 15 billion-transistor GPU die sits on top of a silicon wafer, through which a 4096-bit wide HBM2 memory interface wires it to four 3D HBM2 stacks; and with the wafer sitting on the fiberglass substrate that's rooted into the PCB over a ball-grid array. With the GPU die, wafer, and memory dies put together, this package has a cumulative transistor count of 150 billion transistors. The GPU die is built on the 16 nm FinFET process, and is 600 mm² in area.

The P100 sits on top of a space-efficient PCB that looks less like a video card, and more like a compact module that can be tucked away into ultra-high density supercomputing cluster boxes, such as the new NVIDIA DGX-1. The P100 offers a double-precision (FP64) compute performance of 5.3 TFLOP/s, FP32 performance of 10.6 TFLOP/s, and FP16 performance of a whopping 21.2 TFLOP/s. The chip has registers as big as 14.2 MB, and an L2 cache of 4 MB. In addition to PCI-Express, each P100 chip will be equipped with NVLink, and in-house developed high-bandwidth interconnect by NVIDIA, with bandwidths as high as 80 GB/s per direction, 160 GB/s both directions. This allows extremely high-bandwidth paths between GPUs, so they could share memory and work more like single-GPUs. The P100 is already in volume production, with its target customers already having bought it all the way up to its OEM channel availability some time in Q1-2017.



View at TechPowerUp Main Site
 
Last edited:

the54thvoid

Super Intoxicated Moderator
Staff member
Joined
Dec 14, 2009
Messages
13,025 (2.39/day)
Location
Glasgow - home of formal profanity
Processor Ryzen 7800X3D
Motherboard MSI MAG Mortar B650 (wifi)
Cooling be quiet! Dark Rock Pro 4
Memory 32GB Kingston Fury
Video Card(s) Gainward RTX4070ti
Storage Seagate FireCuda 530 M.2 1TB / Samsumg 960 Pro M.2 512Gb
Display(s) LG 32" 165Hz 1440p GSYNC
Case Asus Prime AP201
Audio Device(s) On Board
Power Supply be quiet! Pure POwer M12 850w Gold (ATX3.0)
Software W10
But can it play Ashes of the Singularity?
 
Joined
Feb 14, 2012
Messages
2,355 (0.51/day)
System Name msdos
Processor 8086
Motherboard mainboard
Cooling passive
Memory 640KB + 384KB extended
Video Card(s) EGA
Storage 5.25"
Display(s) 80x25
Case plastic
Audio Device(s) modchip
Power Supply 45 watts
Mouse serial
Keyboard yes
Software disk commander
Benchmark Scores still running
I was rolling my eyes at his over-statement of 150B transistors (vs 7) and the odds of working being 0% ... c'mon, now you're including memory die, that's not how gpu yield is computed.
 

iO

Joined
Jul 18, 2012
Messages
529 (0.12/day)
Location
Germany
Processor R7 5700x
Motherboard MSI B450i Gaming
Cooling Accelero Mono CPU Edition
Memory 16 GB VLP
Video Card(s) AMD RX 6700 XT Accelero Mono
Storage P34A80 512GB
Display(s) LG 27UM67 UHD
Case none
Power Supply Fractal Ion 650 SFX
So Q2-2017 for a Titan and Q3 for a less stupidly priced card..?
 
Joined
Apr 12, 2013
Messages
7,507 (1.77/day)
So Q2-2017 for a Titan and Q3 for a less stupidly priced card..?
Q3 or Q4 depending on how well the titan sells, they'll milk it for as long as they can, & Vega as well.
 
Joined
Nov 4, 2005
Messages
11,966 (1.72/day)
System Name Compy 386
Processor 7800X3D
Motherboard Asus
Cooling Air for now.....
Memory 64 GB DDR5 6400Mhz
Video Card(s) 7900XTX 310 Merc
Storage Samsung 990 2TB, 2 SP 2TB SSDs, 24TB Enterprise drives
Display(s) 55" Samsung 4K HDR
Audio Device(s) ATI HDMI
Mouse Logitech MX518
Keyboard Razer
Software A lot.
Benchmark Scores Its fast. Enough.
"Five Miracles"


I threw up a little. Why do they have to be so.........
 

qubit

Overclocked quantum bit
Joined
Dec 6, 2007
Messages
17,865 (2.89/day)
Location
Quantum Well UK
System Name Quantumville™
Processor Intel Core i7-2700K @ 4GHz
Motherboard Asus P8Z68-V PRO/GEN3
Cooling Noctua NH-D14
Memory 16GB (2 x 8GB Corsair Vengeance Black DDR3 PC3-12800 C9 1600MHz)
Video Card(s) MSI RTX 2080 SUPER Gaming X Trio
Storage Samsung 850 Pro 256GB | WD Black 4TB | WD Blue 6TB
Display(s) ASUS ROG Strix XG27UQR (4K, 144Hz, G-SYNC compatible) | Asus MG28UQ (4K, 60Hz, FreeSync compatible)
Case Cooler Master HAF 922
Audio Device(s) Creative Sound Blaster X-Fi Fatal1ty PCIe
Power Supply Corsair AX1600i
Mouse Microsoft Intellimouse Pro - Black Shadow
Keyboard Yes
Software Windows 10 Pro 64-bit
But can it play Ashes of the Singularity?
Indeed it will, but not Crysis, unfortunately. :p

I'm looking forward to purchasing this top card at the affordable price that NVIDIA are known to price at and bundled with a free AAA game. :laugh:
 

FordGT90Concept

"I go fast!1!11!1!"
Joined
Oct 13, 2008
Messages
26,259 (4.47/day)
Location
IA, USA
System Name BY-2021
Processor AMD Ryzen 7 5800X (65w eco profile)
Motherboard MSI B550 Gaming Plus
Cooling Scythe Mugen (rev 5)
Memory 2 x Kingston HyperX DDR4-3200 32 GiB
Video Card(s) AMD Radeon RX 7900 XT
Storage Samsung 980 Pro, Seagate Exos X20 TB 7200 RPM
Display(s) Nixeus NX-EDG274K (3840x2160@144 DP) + Samsung SyncMaster 906BW (1440x900@60 HDMI-DVI)
Case Coolermaster HAF 932 w/ USB 3.0 5.25" bay + USB 3.2 (A+C) 3.5" bay
Audio Device(s) Realtek ALC1150, Micca OriGen+
Power Supply Enermax Platimax 850w
Mouse Nixeus REVEL-X
Keyboard Tesoro Excalibur
Software Windows 10 Home 64-bit
Benchmark Scores Faster than the tortoise; slower than the hare.
So...paper launch...note all of the pictures are CAD renders. If they don't have a picture of an actual product to show, why bother?

I was rolling my eyes at his over-statement of 150B transistors (vs 7) and the odds of working being 0% ... c'mon, now you're including memory die, that's not how gpu yield is computed.
Fiji has 8.9 billion. Pascal and Polaris having ~15 billion is likely. You can thank 28nm -> 14/16nm for that.

The 150 billion figure is either a typo or they're counting all of the transistors in the HBM too.
 

W1zzard

Administrator
Staff member
Joined
May 14, 2004
Messages
27,757 (3.71/day)
Processor Ryzen 7 5700X
Memory 48 GB
Video Card(s) RTX 4080
Storage 2x HDD RAID 1, 3x M.2 NVMe
Display(s) 30" 2560x1600 + 19" 1280x1024
Software Windows 10 64-bit
Joined
Sep 7, 2011
Messages
2,785 (0.58/day)
Location
New Zealand
System Name MoneySink
Processor 2600K @ 4.8
Motherboard P8Z77-V
Cooling AC NexXxos XT45 360, RayStorm, D5T+XSPC tank, Tygon R-3603, Bitspower
Memory 16GB Crucial Ballistix DDR3-1600C8
Video Card(s) GTX 780 SLI (EVGA SC ACX + Giga GHz Ed.)
Storage Kingston HyperX SSD (128) OS, WD RE4 (1TB), RE2 (1TB), Cav. Black (2 x 500GB), Red (4TB)
Display(s) Achieva Shimian QH270-IPSMS (2560x1440) S-IPS
Case NZXT Switch 810
Audio Device(s) onboard Realtek yawn edition
Power Supply Seasonic X-1050
Software Win8.1 Pro
Benchmark Scores 3.5 litres of Pale Ale in 18 minutes.
If they don't have a picture of an actual product to show, why bother?
Because the products will launch before the next GTC ?
After all, AMD did exactly the same thing with Vega at the Capsizing Capsaicin presentation, and Intel formally unveiled Omni-Path well over a year before any interconnect hardware was sighted.
 

silentbogo

Moderator
Staff member
Joined
Nov 20, 2013
Messages
5,538 (1.38/day)
Location
Kyiv, Ukraine
System Name WS#1337
Processor Ryzen 7 3800X
Motherboard ASUS X570-PLUS TUF Gaming
Cooling Xigmatek Scylla 240mm AIO
Memory 4x8GB Samsung DDR4 ECC UDIMM
Video Card(s) MSI RTX 3070 Gaming X Trio
Storage ADATA Legend 2TB + ADATA SX8200 Pro 1TB
Display(s) Samsung U24E590D (4K/UHD)
Case ghetto CM Cosmos RC-1000
Audio Device(s) ALC1220
Power Supply SeaSonic SSR-550FX (80+ GOLD)
Mouse Logitech G603
Keyboard Modecom Volcano Blade (Kailh choc LP)
VR HMD Google dreamview headset(aka fancy cardboard)
Software Windows 11, Ubuntu 24.04 LTS
Joined
Sep 7, 2011
Messages
2,785 (0.58/day)
Location
New Zealand
System Name MoneySink
Processor 2600K @ 4.8
Motherboard P8Z77-V
Cooling AC NexXxos XT45 360, RayStorm, D5T+XSPC tank, Tygon R-3603, Bitspower
Memory 16GB Crucial Ballistix DDR3-1600C8
Video Card(s) GTX 780 SLI (EVGA SC ACX + Giga GHz Ed.)
Storage Kingston HyperX SSD (128) OS, WD RE4 (1TB), RE2 (1TB), Cav. Black (2 x 500GB), Red (4TB)
Display(s) Achieva Shimian QH270-IPSMS (2560x1440) S-IPS
Case NZXT Switch 810
Audio Device(s) onboard Realtek yawn edition
Power Supply Seasonic X-1050
Software Win8.1 Pro
Benchmark Scores 3.5 litres of Pale Ale in 18 minutes.
There are some more specs for P100 published on NVidia website
https://devblogs.nvidia.com/parallelforall/inside-pascal/

Pretty sure, that in a few weeks, once some GTC videos make their way to Youtube, we'll get more details on what's going on + some marketing crap as usual )).
Hopefully Nvidia rework the layout for gaming consumers. The vast bulk of FP64 units would be better served being culled in favour of a higher ALU count.
Given the conservative clocks usually associated with professional GPGPU, a near 1500MHz boost clock for a 600mm^2 augers well for the 16nmFF+ process.
 
Joined
Jul 9, 2015
Messages
3,413 (1.00/day)
System Name M3401 notebook
Processor 5600H
Motherboard NA
Memory 16GB
Video Card(s) 3050
Storage 500GB SSD
Display(s) 14" OLED screen of the laptop
Software Windows 10
Benchmark Scores 3050 scores good 15-20% lower than average, despite ASUS's claims that it has uber cooling.
Joined
Jun 19, 2012
Messages
345 (0.08/day)
System Name Off-Brand PC System
Processor 2990WX
Motherboard X399
Cooling Wraithripper
Video Card(s) Vega 64
Benchmark Scores Less than Intel and Nvidia
But can it play Ashes of the Singularity?
Not like that game is any good to begin with.

Total War: Warhammer is where it's at. DX 12 and ASYNC. And it looks like an actual game instead of a benchmark like AOS.
 
Joined
Dec 22, 2011
Messages
3,890 (0.83/day)
Processor AMD Ryzen 7 3700X
Motherboard MSI MAG B550 TOMAHAWK
Cooling AMD Wraith Prism
Memory Team Group Dark Pro 8Pack Edition 3600Mhz CL16
Video Card(s) NVIDIA GeForce RTX 3080 FE
Storage Kingston A2000 1TB + Seagate HDD workhorse
Display(s) Samsung 50" QN94A Neo QLED
Case Antec 1200
Power Supply Seasonic Focus GX-850
Mouse Razer Deathadder Chroma
Keyboard Logitech UltraX
Software Windows 11
A big chip and already very healthy clock speeds, bodes very well for the mid-tier consumer part coming our way.

Anyway the HPC market is gonna lap this badboy up.
 
Last edited:
Joined
Sep 15, 2007
Messages
3,946 (0.63/day)
Location
Police/Nanny State of America
Processor OCed 5800X3D
Motherboard Asucks C6H
Cooling Air
Memory 32GB
Video Card(s) OCed 6800XT
Storage NVMees
Display(s) 32" Dull curved 1440
Case Freebie glass idk
Audio Device(s) Sennheiser
Power Supply Don't even remember
We're totally serious, we're making these chips like hotcakes. We knows chips. We make the best chips. Everyone says so. People always ask us, "Nvidia, where can I get your chips?" We tell them it's in volume production, but you can't get it for 11 months LOL


Nvidia sure is good at terrible lying.
 
Joined
Sep 7, 2011
Messages
2,785 (0.58/day)
Location
New Zealand
System Name MoneySink
Processor 2600K @ 4.8
Motherboard P8Z77-V
Cooling AC NexXxos XT45 360, RayStorm, D5T+XSPC tank, Tygon R-3603, Bitspower
Memory 16GB Crucial Ballistix DDR3-1600C8
Video Card(s) GTX 780 SLI (EVGA SC ACX + Giga GHz Ed.)
Storage Kingston HyperX SSD (128) OS, WD RE4 (1TB), RE2 (1TB), Cav. Black (2 x 500GB), Red (4TB)
Display(s) Achieva Shimian QH270-IPSMS (2560x1440) S-IPS
Case NZXT Switch 810
Audio Device(s) onboard Realtek yawn edition
Power Supply Seasonic X-1050
Software Win8.1 Pro
Benchmark Scores 3.5 litres of Pale Ale in 18 minutes.
We tell them it's in volume production, but you can't get it for 11 months LOL
Wasn't the takeaway that Nvidia was prioritizing for the DGX-1 and fulfilling orders for supers (such as Cobalt) for HPC contracts?
Nvidia says it's producing Tesla P100s in volume today. The company says it's devoting its entire production of Tesla P100 cards (and presumably the GP100 GPU) to its DGX-1 high-density HPC node systems and HPC servers from IBM, Dell, and Cray.
[Source]
Nvidia sure is good at terrible lying.
You'll be providing proof that these contracts have been shelved or deferred? Thought not. Nice to see you remain committed to such a low standard of knee-jerk reactionary trolling though.

I'm guessing that production takes into account die size/yield, HBM2 availability, and assembly yield - which are three areas that Nvidia would have virtually no control over - just as AMD had to grin and bear it with the slow Fiji ramp.
 
Joined
Sep 15, 2007
Messages
3,946 (0.63/day)
Location
Police/Nanny State of America
Processor OCed 5800X3D
Motherboard Asucks C6H
Cooling Air
Memory 32GB
Video Card(s) OCed 6800XT
Storage NVMees
Display(s) 32" Dull curved 1440
Case Freebie glass idk
Audio Device(s) Sennheiser
Power Supply Don't even remember
Wasn't the takeaway that Nvidia was prioritizing for the DGX-1 and fulfilling orders for supers (such as Cobalt) for HPC contracts?

[Source]

You'll be providing proof that these contracts have been shelved or deferred? Thought not. Nice to see you remain committed to such a low standard of knee-jerk reactionary trolling though.

I'm guessing that production takes into account die size/yield, HBM2 availability, and assembly yield - which are three areas that Nvidia would have virtually no control over - just as AMD had to grin and bear it with the slow Fiji ramp.

Bingo. They have no control means they have no volume production. How many chips can possibly be going to HPC? Not that many, but when you DO NOT have any volume, then of course they will take all the orders.
 
Joined
Sep 7, 2011
Messages
2,785 (0.58/day)
Location
New Zealand
System Name MoneySink
Processor 2600K @ 4.8
Motherboard P8Z77-V
Cooling AC NexXxos XT45 360, RayStorm, D5T+XSPC tank, Tygon R-3603, Bitspower
Memory 16GB Crucial Ballistix DDR3-1600C8
Video Card(s) GTX 780 SLI (EVGA SC ACX + Giga GHz Ed.)
Storage Kingston HyperX SSD (128) OS, WD RE4 (1TB), RE2 (1TB), Cav. Black (2 x 500GB), Red (4TB)
Display(s) Achieva Shimian QH270-IPSMS (2560x1440) S-IPS
Case NZXT Switch 810
Audio Device(s) onboard Realtek yawn edition
Power Supply Seasonic X-1050
Software Win8.1 Pro
Benchmark Scores 3.5 litres of Pale Ale in 18 minutes.
Bingo. They have no control means they have no volume production. How many chips can possibly be going to HPC? Not that many, but when you DO NOT have any volume, then of course they will take all the orders.
The only person here stating that Nvidia is in volume production status here is you. Nvidia just stated that production had begun and chip packages were prioritized for pre-existing contracts and what looks to be a money-spinning deep learning system.
You are the one making hyperbolic claims on Nvidia's behalf. Gunning for Roy Taylor's job?
 
Joined
Sep 15, 2007
Messages
3,946 (0.63/day)
Location
Police/Nanny State of America
Processor OCed 5800X3D
Motherboard Asucks C6H
Cooling Air
Memory 32GB
Video Card(s) OCed 6800XT
Storage NVMees
Display(s) 32" Dull curved 1440
Case Freebie glass idk
Audio Device(s) Sennheiser
Power Supply Don't even remember
The only person here stating that Nvidia is in volume production status here is you. Nvidia just stated that production had begun and chip packages were prioritized for pre-existing contracts and what looks to be a money-spinning deep learning system.
You are the one making hyperbolic claims on Nvidia's behalf. Gunning for Roy Taylor's job?

"The P100 is already in volume production..."

I wouldn't expect any high end gaming cards until late fall with this kind of ridiculous spin going on for PR.
 
Joined
Sep 7, 2011
Messages
2,785 (0.58/day)
Location
New Zealand
System Name MoneySink
Processor 2600K @ 4.8
Motherboard P8Z77-V
Cooling AC NexXxos XT45 360, RayStorm, D5T+XSPC tank, Tygon R-3603, Bitspower
Memory 16GB Crucial Ballistix DDR3-1600C8
Video Card(s) GTX 780 SLI (EVGA SC ACX + Giga GHz Ed.)
Storage Kingston HyperX SSD (128) OS, WD RE4 (1TB), RE2 (1TB), Cav. Black (2 x 500GB), Red (4TB)
Display(s) Achieva Shimian QH270-IPSMS (2560x1440) S-IPS
Case NZXT Switch 810
Audio Device(s) onboard Realtek yawn edition
Power Supply Seasonic X-1050
Software Win8.1 Pro
Benchmark Scores 3.5 litres of Pale Ale in 18 minutes.
"The P100 is already in volume production..."
I wouldn't expect any high end gaming cards until late fall with this kind of ridiculous spin going on for PR.
The announcement has nothing to do with gaming cards. The actual quote was that the company were producing the P100 in volume - as opposed to risk/QA production. bta's reinterpretation of the statement introduces some ambiguity. As for professional cards, volume tends to mean something much less than consumer cards - not rocket science.


Again...only you seem to be inferring that Nvidia is claiming volume production suitable for gaming cards. The company made it quite clear that wider availability of GP100 wouldn't happen until Q1 2017.
 

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
47,201 (7.56/day)
Location
Hyderabad, India
System Name RBMK-1000
Processor AMD Ryzen 7 5700G
Motherboard ASUS ROG Strix B450-E Gaming
Cooling DeepCool Gammax L240 V2
Memory 2x 8GB G.Skill Sniper X
Video Card(s) Palit GeForce RTX 2080 SUPER GameRock
Storage Western Digital Black NVMe 512GB
Display(s) BenQ 1440p 60 Hz 27-inch
Case Corsair Carbide 100R
Audio Device(s) ASUS SupremeFX S1220A
Power Supply Cooler Master MWE Gold 650W
Mouse ASUS ROG Strix Impact
Keyboard Gamdias Hermes E2
Software Windows 11 Pro
So...paper launch...note all of the pictures are CAD renders. If they don't have a picture of an actual product to show, why bother?


Fiji has 8.9 billion. Pascal and Polaris having ~15 billion is likely. You can thank 28nm -> 14/16nm for that.

The 150 billion figure is either a typo or they're counting all of the transistors in the HBM too.

As I've mentioned clearly in the post, the GPU die has 15 billion transistors, and NV arrived at 150 billion by adding up every transistor on the package (GPU die + wafer/interposer + 4 x 4-die HBM2 memory stacks). A DRAM die is an ocean of transistors. NVIDIA has 16 of them. If AMD did the same math for "Fiji," it probably would have arrived at a similar "several dozen billion" transistor count. They stuck to an honest 8.9 billion, counting only the GPU die.
 

silentbogo

Moderator
Staff member
Joined
Nov 20, 2013
Messages
5,538 (1.38/day)
Location
Kyiv, Ukraine
System Name WS#1337
Processor Ryzen 7 3800X
Motherboard ASUS X570-PLUS TUF Gaming
Cooling Xigmatek Scylla 240mm AIO
Memory 4x8GB Samsung DDR4 ECC UDIMM
Video Card(s) MSI RTX 3070 Gaming X Trio
Storage ADATA Legend 2TB + ADATA SX8200 Pro 1TB
Display(s) Samsung U24E590D (4K/UHD)
Case ghetto CM Cosmos RC-1000
Audio Device(s) ALC1220
Power Supply SeaSonic SSR-550FX (80+ GOLD)
Mouse Logitech G603
Keyboard Modecom Volcano Blade (Kailh choc LP)
VR HMD Google dreamview headset(aka fancy cardboard)
Software Windows 11, Ubuntu 24.04 LTS
NVidia started to upload GTC 2016 videos on youtube.
Let's see what Jen-Hsun Huang has to say:

 
Joined
Jul 9, 2015
Messages
3,413 (1.00/day)
System Name M3401 notebook
Processor 5600H
Motherboard NA
Memory 16GB
Video Card(s) 3050
Storage 500GB SSD
Display(s) 14" OLED screen of the laptop
Software Windows 10
Benchmark Scores 3050 scores good 15-20% lower than average, despite ASUS's claims that it has uber cooling.
Also note the "5 miracles" in Tesla P100. Although, I might be confusing which product would have the miracles (or even be a miracle). Anyhow, most miraculous NV launch (and with some volume production too!) so far. And it's not that expensive too, only 129'000$.

No clue if it is faster than Tesla S.

"The P100 is already in volume production..."

"Is white a color?"
"Yes"
"Is black a color?"
"Yes"
"Told ya, I've sold you a color TV"

(A joke from times where there actually were black & white TVs)
 
Last edited:
Top