NVIDIA · November 2020
A100
80GB PCIe
The NVIDIA A100 80GB PCIe is a high-performance GPU designed for data centers, targeting AI, machine learning, and high-performance computing workloads. It is part of the Ampere architecture, offering significant improvements in performance and memory capacity over its predecessors. The 80GB variant provides ample memory for large-scale models and datasets, making it ideal for demanding applications.
Provider Marketplace
All Cloud Providers
Estimates only — rates are collected automatically from public provider pages and may be out of date. Prices vary by region, commitment term, and availability, and typically exclude storage, egress, and tax. Confirm current pricing with the provider before purchasing. Last collected .
Compute Performance
Architecture
Memory & VRAM
Connectivity & Scaling
Virtualization
Power & Efficiency
Physical Design
Thermals & Cooling
Software Ecosystem
Server & Deployment
System Compatibility
Benchmarks & Throughput
Structured Sparsity
Supported (up to 2X more performance)
Training Benchmarks
DLRM: up to 3X throughput increase over A100 40GB; up to 1.3 TB unified memory per node
Inference Benchmarks
BERT-Large: up to 249X throughput over CPUs; RNN-T: up to 1.25X over A100 40GB
Scaling Efficiency
NVLink bridge: 600 GB/s between bridged A100 GPUs (10x PCIe Gen4)
Multi-GPU Scalability
Scaling Efficiency
Scaling Characteristics
Workload Readiness
LLM Training
156 TFLOPS
LLM Inference
up to 249X over CPUs
HPC / Simulation
9.7 TFLOPS
Scientific Computing
19.5 TFLOPS
Market Authority
MLPerf Ranking
Leadership in MLPerf with multiple performance records
Community Benchmarks
MLPerf benchmark results and MLPerf Inference demonstrated market-leading performance
Key Strengths
This GPU excels at AI training and inference, offering exceptional performance for deep learning frameworks like TensorFlow and PyTorch. Its large memory capacity and high bandwidth make it particularly effective for large-scale models and data-intensive tasks. The A100's support for multi-instance GPU (MIG) technology allows for efficient resource partitioning.
Limitations
While the A100 80GB PCIe offers excellent performance, it lacks NVLink support, which can be a limitation for workloads requiring high inter-GPU communication. Its high power consumption necessitates adequate power supply and cooling infrastructure. Availability can be constrained due to high demand and production limitations.
Also in the Lineup
Expert Insight
The A100 represents a strategic leap in AI compute. When comparing cloud providers, consider not just the hourly rate, but also the interconnect bandwidth (InfiniBand/NVLink) and regional availability which can significantly impact total cost of ownership for large-scale training.