GPU Wiki
Compare NVIDIA GPUs
Select up to four GPU Wiki entries to compare matching specifications row by row. The comparison uses the site database and keeps generation-specific specs visibly separate.
Row order:
Muted cells indicate unavailable, not applicable, or not directly comparable specifications.
| Spec | H100 PCIe 96 GB |
|---|---|
| Overview | |
| Product name | NVIDIA H100 PCIe 96 GB |
| Architecture | Hopper |
| Generation / family | NVIDIA H-Series |
| GPU codename | GH100 |
| Launch date | 2023-03-21 |
| Market segment | Data Center in NVIDIA H-Series |
| Board type / entry type | Data Center GPU |
| GPU | |
| Process node | TSMC 5 nm |
| Die size | 814 mm² |
| Transistor count | 80 billion |
| GPU chip | GH100 |
| SM / multiprocessor count | 132 |
| CUDA Cores | 16896 |
| Tensor Cores | 528 |
| ROPs | 24 |
| TMUs | 528 |
| Clocks | |
| Base / Core clock | 1,665 MHz |
| Boost clock | 1,837 MHz |
| Memory clock | 1,313 MHz |
| Memory | |
| Memory size | 96 GB |
| Memory type | HBM3 |
| Memory bus width | 5,120-bit |
| Memory bandwidth | 3,360 GB/s |
| Bus / Interface | |
| Bus interface | PCIe 5.0 x16 |
| AGP / PCI / PCIe distinction | PCIe |
| Power | |
| TDP / TBP / board power | 700 W |
| Recommended PSU | 1,100 W |
| Power connectors | 8-pin EPS |
| Slot width | Dual-slot, 268 mm length |
| Features | |
| CUDA support | 9.0 |
| Performance / Benchmarks | |
| FP32 throughput | 62.08 TFLOPS |
| FP16 throughput | 248.3 TFLOPS |
Overview
Product name
H100 PCIe 96 GB
NVIDIA H100 PCIe 96 GB
Architecture
H100 PCIe 96 GB
Hopper
Generation / family
H100 PCIe 96 GB
NVIDIA H-Series
GPU codename
H100 PCIe 96 GB
GH100
Launch date
H100 PCIe 96 GB
2023-03-21
Market segment
H100 PCIe 96 GB
Data Center in NVIDIA H-Series
Board type / entry type
H100 PCIe 96 GB
Data Center GPU
GPU
Process node
H100 PCIe 96 GB
TSMC 5 nm
Die size
H100 PCIe 96 GB
814 mm²
Transistor count
H100 PCIe 96 GB
80 billion
GPU chip
H100 PCIe 96 GB
GH100
SM / multiprocessor count
H100 PCIe 96 GB
132
CUDA Cores
H100 PCIe 96 GB
16896
Tensor Cores
H100 PCIe 96 GB
528
ROPs
H100 PCIe 96 GB
24
TMUs
H100 PCIe 96 GB
528
Clocks
Base / Core clock
H100 PCIe 96 GB
1,665 MHz
Boost clock
H100 PCIe 96 GB
1,837 MHz
Memory clock
H100 PCIe 96 GB
1,313 MHz
Memory
Memory size
H100 PCIe 96 GB
96 GB
Memory type
H100 PCIe 96 GB
HBM3
Memory bus width
H100 PCIe 96 GB
5,120-bit
Memory bandwidth
H100 PCIe 96 GB
3,360 GB/s
Bus / Interface
Bus interface
H100 PCIe 96 GB
PCIe 5.0 x16
AGP / PCI / PCIe distinction
H100 PCIe 96 GB
PCIe
Power
TDP / TBP / board power
H100 PCIe 96 GB
700 W
Recommended PSU
H100 PCIe 96 GB
1,100 W
Power connectors
H100 PCIe 96 GB
8-pin EPS
Slot width
H100 PCIe 96 GB
Dual-slot, 268 mm length
Display / Media
Features
CUDA support
H100 PCIe 96 GB
9.0
Performance / Benchmarks
FP32 throughput
H100 PCIe 96 GB
62.08 TFLOPS
FP16 throughput
H100 PCIe 96 GB
248.3 TFLOPS