Ultra-Bandwidth Solutions Memory Comparison
Ultra-Bandwidth Solutions | GDDR6 | GDDR6X | HBM2E |
---|---|---|---|
Workload |
Graphics AI Inference Accelerator |
Graphics AI Inference Accelerator |
AI Training Accelerator |
Platform (Example) |
Titan RTX RX5700 XT |
GeForce® RTX™ 3090Ti GeForce® RTX™ 3080Ti |
A100 |
Number of Placements | 12 | 12 | 5 |
Gb/s/pin | 14-16 |
19-24 | 2.5-3.2 |
GB/s/placement | 56-64 | 76-96 | 388-408 |
GB/s/system | 672-768 | 912-1152 | 1555-2039 |
Configuration (Example) |
384 IO (12pcs x 32 IO package) |
384 IO (12pcs x 32 IO package) |
5120 IO |
Frame Buffer of Typical System | 12GB | 24GB | 40-80GB |
Average Device Power (pJ/bit) | 7.5 | 7.25 | 6.0 |
Typical IO Channel |
PCB (P2P SM) |
PCB (P2P SM) |
Si Interposer (2.5D integration) |