Most deployedCloud GPU
NVIDIA

GeForce RTX 4090

GeForce RTX 4090 is available through OneInfer GPU marketplace with live provider pricing, regions, VRAM, and deployment options from the API.

VRAM
24GB
Best price
$0.37/gpu/hr
Providers
10 available
Regions
25 regions
VRAM
24GB
CUDA cores
16,384
TDP
450W
Bandwidth
N/A
Process node
5nm
Launch date
N/A

Available from 10 providers

Sorted by price · click price to re-sort
ProviderRegionsConfigPrice / hr ▾Availability
vastaivastai
US-AZ-01, OC-AU-01, SA-BR-01, CA-BC-01, EU-BG-01, US-CA-01, EU-DK-01, EU-HU-01, US-IN-01, EU-IE-01, US-KS-01, EU-NO-01, EU-RO-01, EU-ES-01, EU-SE-01, AS-TW-01, US-TX-01, US-WA-011x 24GB$0.37Limited
vastaivastai
US-CA-01, AS-JP-01, EU-RO-01, US-TX-01, US-VA-011x 24GB$0.47Limited
vastaivastai
EU-BG-01, EU-DK-01, US-IA-01, EU-IE-01, CN-JS-01, EU-NO-01, US-OR-01, CA-QC-01, EU-RO-01, US-TX-01, US-VA-012x 24GB$0.76In stock
vastaivastai
US-TX-012x 24GB$1.60In stock
vastaivastai
CN-JS-014x 24GB$1.92In stock
vastaivastai
EU-NO-013x 24GB$1.93In stock
vastaivastai
EU-BG-01, US-IA-01, EU-NO-014x 24GB$2.14In stock
vastaivastai
EU-GB-015x 24GB$3.00In stock
vastaivastai
US-TX-014x 24GB$3.20In stock
vastaivastai
EU-BG-01, US-WA-018x 24GB$4.27In stock

Full specifications

Data from GPU specs and provider APIs
AI TOPS1,321
FP8 TFLOPS1,321
FP16 TFLOPS82.58
BF16 TFLOPS82.58
FP32 TFLOPS82.58
INT8 TOPS1,321
Sparse multiplier2

Benchmarks

GeForce RTX 4090 vs comparable GPUs on the platform

Inference throughput

7B model · tokens/sec

B200 SXM15,000
H200 SXM8,500
H100620
A100500
GeForce RTX 5090180

Training performance

Overall training multiplier

B200 SXM30x
H200 SXM18x
H10015x
A1003.4x
L40S2.8x

GeekBench OpenCL

Compute benchmark score

GeForce RTX 5090367,740
H200 SXM343,598
L40S337,706
H100336,474
B200 SXM333,768

Best for

LLM fine-tuningHigh-throughput inferenceMulti-modal model trainingLarge-batch distributed trainingRAG pipelines at scale

Similar GPUs

Ready to deploy GeForce RTX 4090?

Spin up an instance in minutes from your choice of 10 providers.