H100 SXM5 96 GB

Data Center GPU

Hopper NVIDIA H-Series Data Center Server HBM3 2023 NVIDIA

Save this GPU, then open another GPU page to compare them side by side.

At a Glance

Entry Type: Data Center GPU
Architecture: Hopper
Series: NVIDIA H-Series
GPU Die: GH100
Launch Date: 2023-03-21
CUDA Cores: 16,896
TMUs: 528
ROPs: 24
Memory: 96 GB HBM3
Bus Width: 5,120-bit
TDP/TBP: 700 W
Rec. PSU: 1,100 W
Interface: PCIe 5.0 x16
Data Confidence: Partial

GPU Specs

Identity
Entry Type	Data Center GPU
Official Name	NVIDIA H100 SXM5 96 GB
GPU Codename	GH100
Architecture	Hopper
Launch Date	2023-03-21
Market Segment Notes	Data Center in NVIDIA H-Series
Core Specs
GPU Die	GH100
Process Node	TSMC 5 nm
Transistor Count	80 billion
Die Size	814 mm²
CUDA Cores	16896
SM Count	132
TMUs	528
ROPs	24
AI Units / Tensor Cores	528
Base Clock	1,350 MHz
Boost Clock	1,980 MHz
Pixel Fillrate	47.52 GP/s
Texture Fillrate	1045.4 GT/s
FP32 Throughput	66.91 TFLOPS
FP16 Throughput	267.6 TFLOPS
FP64 Throughput	33.45 TFLOPS
Memory
Memory Size	96 GB
Memory Type	HBM3
Memory Bus Width	5,120-bit
Memory Clock	1,313 MHz
Memory Bandwidth	3,360 GB/s
L2 Cache	50 MB
L1 Cache	250 KB
Board and Display
TDP / TBP	700 W
Recommended PSU	1,100 W
Power Connectors	8-pin EPS
Interface	PCIe 5.0 x16
Slot Width	SXM Module
Board Partner Model	Reference or OEM specification
Reference Design	NVIDIA reference design
Software
CUDA Compute Capability	9.0
OpenCL Support	OpenCL 3.0
Driver Branch Notes	Driver support depends on architecture, operating system, and current NVIDIA driver branch.
Windows Support Notes	Check the current NVIDIA driver branch and OEM support policy for this exact GPU.
Linux Support Notes	Check the current NVIDIA Linux driver branch, distribution packages, and kernel compatibility for this exact GPU.

Overview

H100 SXM5 96 GB is an NVIDIA GPU entry in the NVIDIA H-Series family. It is listed with Hopper architecture and GH100 silicon.

Key reference data: 16,896 CUDA cores/shaders, 96 GB HBM3 memory, 5,120-bit memory bus, 700 W board power class.

Server accelerators should be checked against platform compatibility, cooling, power delivery, firmware, and driver or CUDA support.

Why It Mattered

H100 SXM5 96 GB belongs to the Hopper data-center generation, where transformer acceleration, HBM capacity, interconnect, and server form factor matter more than display features. It is tracked separately so accelerator buyers can distinguish PCIe, SXM, and OEM configurations.

Collector Notes

For archival use, record the accelerator form factor, memory capacity, board part number, firmware or VBIOS, cooling type, bracket, interconnect support, power connectors, and the server or workstation it came from.

Used-Market Caution

Before buying used, confirm PCIe versus SXM or OAM form factor, passive airflow needs, auxiliary power, HBM size, firmware locks, ECC or retired-page errors, seller proof from nvidia-smi under load, and whether any vGPU or enterprise licensing is required.

Known Issues

Known issues pending source review.

SourcesPartial

Sources reviewed: 2026-06-20

This entry is still being source-checked.

Specifications are currently based on reference/spec-dump sources. Historical notes require additional source review.

Data confidence and source status

Partial entry. Core specifications may be present, but history, variant notes, known issues, and source review may be incomplete.

Verified: core specifications and historical notes have been reviewed against listed sources.
Partial: core specifications may be present, but history, variant notes, known issues, and source review may be incomplete.
Imported: spec-only imported entry pending editorial source review.
Needs source review: narrative notes are incomplete until reviewed.

Independent reference sources

TechPowerUp GPU SpecsModel-level specification reference for this GPU entryOpen source

Derived datasets and spec dumps

RightNow GPU DatabaseOpen data inventory used for bulk normalization and cross-checking Derived/spec-dump source. Treat as a reference dataset, not independent historical verification.Open source

Found an incorrect spec, missing source, or variant issue?

Submit a correction

Overview

Why It Mattered

Collector Notes

Used-Market Caution

Known Issues

H100 CNX

H100 NVL 94 GB

H100 PCIe 80 GB

H100 PCIe 96 GB

Independent reference sources

Derived datasets and spec dumps