NVIDIA
L40
Provider Marketplace
All Cloud Providers
Estimates only — rates are collected automatically from public provider pages and may be out of date. Prices vary by region, commitment term, and availability, and typically exclude storage, egress, and tax. Confirm current pricing with the provider before purchasing. Last collected .
Compute Performance
Architecture
Memory & VRAM
Connectivity & Scaling
Virtualization
Power & Efficiency
Physical Design
Software Ecosystem
Server & Deployment
System Compatibility
Benchmarks & Throughput
Structured Sparsity
Supported
Inference Benchmarks
delivering 5X higher inference performance compared to the previous generation
Scaling Efficiency
NVLink Support: No
Multi-GPU Scalability
Scaling Characteristics
Workload Readiness
Vision Training
Supported for visual computing workloads
Diffusion Models
Accelerates image generative AI / inference
HPC / Simulation
Supported for large-scale modeling and simulation
Scientific Computing
90.5
Market Authority
Key Strengths
Limitations
Also in the Lineup
Expert Insight
The L40 represents a strategic leap in AI compute. When comparing cloud providers, consider not just the hourly rate, but also the interconnect bandwidth (InfiniBand/NVLink) and regional availability which can significantly impact total cost of ownership for large-scale training.