RTX 4090 GPUs
on Vast.ai

The RTX 4090, Nvidia's latest high-end GPU, released in September 2022, offers significant performance and power efficiency improvements with its Ada Lovelace architecture.

Vast Pricing

RTX 4090 GPU Details

CategoryDetail
GPU NameAD102
GPU CodenameAD102
ArchitectureAda Lovelace
GPCs11
TPCs64
SMs128
CUDA Cores / SM128
CUDA Cores / GPU16384
Tensor Cores / SM4 (4th Gen)
Tensor Cores / GPU512 (4th Gen)
OFA TOPS305
RT Cores128 (3rd Gen)
GPU Boost Clock (MHz)2520
Peak FP32 TFLOPS (non-Tensor)82.6
Peak FP16 TFLOPS (non-Tensor)82.6
Peak BF16 TFLOPS (non-Tensor)82.6
Peak INT32 TOPS (non-Tensor)41.3
RT TFLOPS191
Peak FP8 Tensor TFLOPS with FP16 Accumulate660.6/1321.22
Peak FP8 Tensor TFLOPS with FP32 Accumulate660.6/1321.22
Peak FP16 Tensor TFLOPS with FP16 Accumulate330.3/660.62
Peak FP16 Tensor TFLOPS with FP32 Accumulate165.2/330.42
Peak BF16 Tensor TFLOPS with FP32 Accumulate165.2/330.42
Peak TF32 Tensor TFLOPS82.6/165.22
Peak INT8 Tensor TOPS660.6/1321.22
Peak INT4 Tensor TOPS1321.2/2642.42
Frame Buffer Memory Size and Type24 GB GDDR6X
Memory Interface384-bit
Memory Clock (Data Rate)21 Gbps
Memory Bandwidth1008 GB/sec
ROPs176
Pixel Fill-rate (Gigapixels/sec)443.5
Texture Units512
Texel Fill-rate (Gigatexels/sec)1290.2
L1 Data Cache/Shared Memory16384 KB
L2 Cache Size73728 KB
Register File Size32768 KB
Video Engines2 x NVENC (8th Gen), 1 x NVDEC (5th Gen)
TGP (Total Graphics Power)450 W
Transistor Count76.3 Billion
Die Size608.5 mm2
Manufacturing ProcessTSMC 4N NVIDIA Custom Process
PCI Express InterfaceGen 4
Vast AI

© 2025 Vast.ai. All rights reserved.

Vast.ai