GPU Wiki

Compare NVIDIA GPUs

Select up to four GPU Wiki entries to compare matching specifications row by row. The comparison uses the site database and keeps generation-specific specs visibly separate.

Swap Clear
Row order:
Muted cells indicate unavailable, not applicable, or not directly comparable specifications.
Spec A40 PCIe
Overview
Product name NVIDIA A40 PCIe
Architecture Ampere
Generation / family NVIDIA A-Series
GPU codename GA102
Launch date 2020-10-05
Market segment Data Center in NVIDIA A-Series
Board type / entry type Data Center GPU
GPU
Process node Samsung 8 nm
Die size 628 mm²
Transistor count 28.3 billion
GPU chip GA102
SM / multiprocessor count 84
CUDA Cores 10752
Tensor Cores 336
RT Cores 84
ROPs 112
TMUs 336
Clocks
Base / Core clock 1,305 MHz
Boost clock 1,740 MHz
Memory clock 1,812 MHz
Memory
Memory size 48 GB
Memory type GDDR6
Memory bus width 384-bit
Memory bandwidth 695.8 GB/s
Bus / Interface
Bus interface PCIe 4.0 x16
AGP / PCI / PCIe distinction PCIe
Power
TDP / TBP / board power 300 W
Recommended PSU 700 W
Power connectors 8-pin EPS
Slot width Dual-slot, 267 mm length
Display / Media
Display outputs 3x DisplayPort 1.4a
Features
DirectX support DirectX 12.2
OpenGL support OpenGL 4.6
Vulkan support Vulkan 1.4
CUDA support 8.6
Shader Model 6.8
Ray tracing support Hardware RT units present
Performance / Benchmarks
FP32 throughput 37.42 TFLOPS
FP16 throughput 37.42 TFLOPS