NVIDIA

RTX 6000 Ada

RTX 6000 Ada — illustration of the card's form factor
VRAM
48GB
FP32 TFLOPS
91.1 TFLOPS
CUDA Cores
18,176
TDP
300 W

Provider Marketplace

Cheapest
$0.52/hour
Starting from
Best Value
$0.79/hour
Starting from
Enterprise Choice
$1.30/hour
Starting from

All Cloud Providers

6 Options available
Verda logo
VerdaCheapest
Spot · preemptible
$0.52/ hour
Estimated Cost
Provision
RunPod logo
On-Demand
$0.74/ hour
Estimated Cost
Provision
TensorDock logo
On-Demand
$0.75/ hour
Estimated Cost
Provision
$0.79/ hour
Estimated Cost
Provision
Runcrate logo
On-Demand
$1.07/ hour
Estimated Cost
View Provider
RedSwitches logo
On-DemandMontrealCanada
$1.30/ hour
Estimated Cost
Provision

Estimates onlyrates are collected automatically from public provider pages and may be out of date. Prices vary by region, commitment term, and availability, and typically exclude storage, egress, and tax. Confirm current pricing with the provider before purchasing. Last collected .

Compute Performance

FP3291.1 TFLOPS
FP81457 TFLOPS

Architecture

MicroarchitectureAda Lovelace
CUDA Cores18176
Tensor CoresFourth-generation, 568 Tensor Cores
RT CoresThird-generation, 142 RT Cores
Sparse AccelerationSupported (sparsity feature)
Dynamic PrecisionSupported (FP8, FP32, mixed precision)

Memory & VRAM

Memory TypeGDDR6
Total Capacity48GB
Bandwidth960 GB/s
Bus Width384-bit
ECC SupportYes

Connectivity & Scaling

PCIe InterfacePCIe 4.0 xx16
GPUDirect RDMAYes

Virtualization

vGPU ReadinessSupported (NVIDIA vPC/vApps, NVIDIA RTX Virtual Workstation)
GPU SharingvGPU (NVIDIA RTX Virtual Workstation) — multiple virtual workstation instances
Virt EfficiencyNear bare-metal (vendor claim)

Power & Efficiency

TDP300 W
Peak Power300
Connectors1x PCIe CEM5 16-pin
Thermal LimitsActive

Physical Design

Form FactorPCIe
FHFLYes
Slot WidthDual-slot
Dimensions4.4” H x 10.5” L
CoolingActive

Software Ecosystem

CUDACUDA 11.6

Server & Deployment

OEM AvailabilityAvailable through OEM workstations (NVIDIA RTX-powered AI workstations).
PreconfiguredAvailable via NVIDIA design and visualization partners or the NVIDIA store.

System Compatibility

Required PCIePCIe 4.0 x16
MotherboardPCIe 4.0 x16 slot; dual-slot, full-height card (4.4” H x 10.5” L)
OS CompatWindows 10 and Linux

Benchmarks & Throughput

Structured Sparsity

Supported (sparsity feature used for FP8 performance)

Training Benchmarks

PyTorch, BERT Large Pre-Training, precision: mixed.

Inference Benchmarks

TensorRT, ResNet-50 V1.5 Inference, precision: mixed.

Multi-GPU Scalability

Workload Readiness

LLM Training

Yes

Diffusion Models

Yes

Multimodal AI

Yes

HPC / Simulation

Yes

Scientific Computing

Yes

Market Authority

Community Benchmarks

SPECviewperf 2020 geomean; Chaos V-Ray v5.0; Stable Diffusion webUI v1.3.1

Enterprise Cases

3D Volumetric Time-Lapse with Forager; Live Graphics Production with Vizrt; Building Realistic Renders and 4D Sequences of Construction Projects With NVIDIA RTX (Layton Construction)

Key Strengths

Limitations

Expert Insight

The RTX 6000 Ada represents a strategic leap in AI compute. When comparing cloud providers, consider not just the hourly rate, but also the interconnect bandwidth (InfiniBand/NVLink) and regional availability which can significantly impact total cost of ownership for large-scale training.

Glossary Terms

FP32 TFLOPS
VRAM
TDP
Cores
Information updated daily. Cloud pricing subject to vendor availability.