AMD · Not specified

Instinct MI250X

The AMD Instinct MI250X accelerator is designed to supercharge HPC workloads and power discovery in the era of exascale. It is optimized for high-performance computing tasks.

Instinct MI250X — illustration of the card's form factor
VRAM
128 GB
FP32 TFLOPS
47.9 TFLOPS
CUDA Cores
14,080
TDP
500 W

Provider Marketplace

Cheapest
$1.35/hour
Starting from
Best Value
Awaiting listings
No additional provider yet
Enterprise Choice
Awaiting listings
No additional provider yet

All Cloud Providers

1 Options available
Runcrate logo
RuncrateCheapest
On-Demand
$1.35/ hour
Estimated Cost
Provision

Estimates onlyrates are collected automatically from public provider pages and may be out of date. Prices vary by region, commitment term, and availability, and typically exclude storage, egress, and tax. Confirm current pricing with the provider before purchasing. Last collected .

Compute Performance

FP6447.9 TFLOPS
FP3247.9 TFLOPS
FP16383 TFLOPS
BF16383 TFLOPS
INT8383 TOPS
INT4383 TOPS

Architecture

MicroarchitectureCDNA2
Process NodeTSMC 6nm FinFET
Compute Units220
CUDA Cores14080
Matrix EngineMatrix Core Technologies
Boost Clock1700 MHz
Dynamic PrecisionSupported (INT4/INT8/FP16/FP32/BF16/FP64)

Memory & VRAM

Memory TypeHBM2e
Total Capacity128 GB
Bandwidth3.2 TB/s
Bus Width8192-bit
ECC SupportYes (Full-Chip)

Connectivity & Scaling

InterconnectInfinity Fabric
IB Bandwidth100 GB/s
PCIe InterfacePCIe® 4.0 xx16

Power & Efficiency

TDP500 W
Peak Power560
Thermal LimitsPassive OAM

Physical Design

Form FactorOAM Module
CoolingPassive OAM

Thermals & Cooling

DC Heat500W | 560W Peak

System Compatibility

Required PCIePCIe® 4.0 x16
MotherboardForm Factor: Servers; GPU Form Factor: OAM Module; Bus: PCIe® 4.0 x16
Rack PowerThermal Design Power (TDP) 500W | 560W Peak

Benchmarks & Throughput

Scaling Efficiency

Infinity Fabric™ Links 8; Peak Infinity Fabric™ Link Bandwidth 100 GB/s

Multi-GPU Scalability

Scaling Characteristics

Network Bottlenecks400 GB/s Peak Aggregate Infinity Fabric
ParallelismInfinity Fabric™ Links 8

Workload Readiness

HPC / Simulation

Yes

Scientific Computing

Yes

Market Authority

Supercomputer Usage

AMD Instinct MI250X accelerators power some of the world’s top supercomputers.

Key Strengths

The MI250X excels in high-performance computing and AI training tasks.

  • ·AI Training: Optimized for large-scale AI model training with high throughput.
  • ·HPC Performance: Delivers exceptional performance for scientific and engineering simulations.
  • ·Energy Efficiency: Designed for efficient power usage in data centers.

Limitations

The MI250X has some limitations in terms of availability and compatibility.

  • ·Availability: Limited availability in certain regions and platforms.
  • ·Compatibility: Requires specific server infrastructure for deployment.

Expert Insight

The Instinct MI250X represents a powerful alternative for diversified workloads. When comparing cloud providers, consider not just the hourly rate, but also the interconnect bandwidth (InfiniBand/NVLink) and regional availability which can significantly impact total cost of ownership for large-scale training.

Glossary Terms

FP32 TFLOPS
VRAM
TDP
Cores
Information updated daily. Cloud pricing subject to vendor availability.