Rent RTX 4090 GPUs on Vast.ai

RTX 4090 GPU

Overview

The Nvidia RTX 4090 is the latest high-end graphics card by Nvidia, released in September 2022. It is based on the Ada Lovelace architecture and boasts significant improvements in performance and power efficiency over the previous generation.

GPU Rental Pricing

You can rent the RTX 4090 by the hour with prices ranging from $0.40/hr to $1.34/hr. Try the RTX 4090 now.

GPU Details

CategoryDetail
GPU NameAD102
GPU CodenameAD102
ArchitectureAda Lovelace
GPCs11
TPCs64
SMs128
CUDA Cores / SM128
CUDA Cores / GPU16384
Tensor Cores / SM4 (4th Gen)
Tensor Cores / GPU512 (4th Gen)
OFA TOPS305
RT Cores128 (3rd Gen)
GPU Boost Clock (MHz)2520
Peak FP32 TFLOPS (non-Tensor)82.6
Peak FP16 TFLOPS (non-Tensor)82.6
Peak BF16 TFLOPS (non-Tensor)82.6
Peak INT32 TOPS (non-Tensor)41.3
RT TFLOPS191
Peak FP8 Tensor TFLOPS with FP16 Accumulate660.6/1321.22
Peak FP8 Tensor TFLOPS with FP32 Accumulate660.6/1321.22
Peak FP16 Tensor TFLOPS with FP16 Accumulate330.3/660.62
Peak FP16 Tensor TFLOPS with FP32 Accumulate165.2/330.42
Peak BF16 Tensor TFLOPS with FP32 Accumulate165.2/330.42
Peak TF32 Tensor TFLOPS82.6/165.22
Peak INT8 Tensor TOPS660.6/1321.22
Peak INT4 Tensor TOPS1321.2/2642.42
Frame Buffer Memory Size and Type24 GB GDDR6X
Memory Interface384-bit
Memory Clock (Data Rate)21 Gbps
Memory Bandwidth1008 GB/sec
ROPs176
Pixel Fill-rate (Gigapixels/sec)443.5
Texture Units512
Texel Fill-rate (Gigatexels/sec)1290.2
L1 Data Cache/Shared Memory16384 KB
L2 Cache Size73728 KB
Register File Size32768 KB
Video Engines2 x NVENC (8th Gen), 1 x NVDEC (5th Gen)
TGP (Total Graphics Power)450 W
Transistor Count76.3 Billion
Die Size608.5 mm2
Manufacturing ProcessTSMC 4N NVIDIA Custom Process
PCI Express InterfaceGen 4
Vast AI
  • Contact
  • Get in Touch