ABCDEFGHIJKLMNOPQRSTUVWXYZAAABACADAEAFAGAH
1
ProviderSystemOverallAccess
Total price/hr excl data uploaded/downloaded
Total base GPU price/hr
Storage price/hr for 300GB
CPU pricingRAM pricingUpload pricingDownload pricingAvailability?Signup issues?
Confusing or difficult website?
Total GPU ramSystem ramOther detailsUser notesURL
2
Vastai
2x A6000 (Not A6000 Ada, and Not RTX 6000 - same applies to all below)
Sometimes good, sometimes bad
Instant$1.35$1.16$0.19IncludedIncluded$0.03 per GB$0.01 per GBYesNoSlightly96 GB129 GB815 GB SSD"In Vast AI, I’ve had good experiences but also bad. Sometimes, really cheap providers in remote areas like St Petersburg, Russia or Sweden turn out to be not reliable at all. The training is extremely slow even though it’s supposedly a 3090, so I’d say vast ai is a use at your own risk"

"hard to get availability in US zones, easier at nighttime with some hosts in Sweden"

"One thing to note about vastai , is that their spot instances can be flaky and hard to reserve"
https://cloud.vast.ai/
3
FluidStack2x A6000BestInstant$1.60$1.60IncludedIncludedIncludedIncludedIncludedYesNoNo96 GB110 GB
12 vCPUs, 1TB SSD
https://console2.fluidstack.io/deploy
4
Lambda2x A6000BestInstant$1.60$1.60IncludedIncludedIncludedIncludedIncludedYesNoNo96 GB200 GB1TB SSD
https://cloud.lambdalabs.com/instances
5
Runpod2x A40 or 2x A6000BestInstant$1.62$1.58$0.04IncludedIncludedIncludedIncludedYesNoNo96 GB377 GB
https://www.runpod.io/console/gpu-secure-cloud
6
Crusoe2x A100 80GB PCIeNot recommendedWaitlist$1.84$1.84IncludedIncludedIncludedIncluded, I thinkIncluded, I think
No instant signup
Yes, no instant signup
96 GB240 GB2TB SSD
https://crusoecloud.com/pricing/
7
Oracle4x A10Not recommended
My account failed verification
$2.44$2.00$0.01$0.43Included
Included to 10TB
Included to 10TBYesYes-96 GB1024 GB7.68 TB SSD"Probably easier if you are from an enterprise"
https://www.oracle.com/cloud/compute/pricing/ and https://docs.oracle.com/en-us/iaas/Content/Compute/References/computeshapes.htm
8
Oblivus2x A40 or 2xA6000Good but higher pricingInstant$3.03$2.80$0.03$0.13$0.07IncludedIncludedYesNoNo96 GB110 GB
12 vCPUs. Rate is approx 8% lower if you pay with bank transfer and use a business account, instead of credit card
https://console.oblivus.com/dashboard/oblivuscloud/deploy/
9
CoreWeave2x A40 or 2x A6000Not recommendedManual approval$3.50$2.56$0.03$0.16$0.75IncludedIncludedYes
Yes, took a while to get verified
Kinda96 GB150 GB
16 vCPU, 300 GB SSD
https://www.coreweave.com/gpu-cloud-pricing and https://cloud.coreweave.com/virtualservers
10
AWS4x A10Not recommendedInstant$5.70$5.67$0.03IncludedIncludedIncluded100 GB includedYesNoYes96 GB192 GB
https://instances.vantage.sh/aws/ec2/g5.12xlarge and https://aws.amazon.com/ebs/pricing/
11
Azure2x A100 80GB (NC48ads)Not recommendedInstant$7.35$7.35$0.01IncludedIncludedIncludedIncludedYesNoYes160 GB440 GB
Yes, it's a better setup than 2xA6000s, but if you want 2x A100s, the other providers are cheaper anyway.
"Requires filing a support ticket for some number of VCPUs"
https://instances.vantage.sh/azure/vm/nc48ads-v4 and https://azure.microsoft.com/en-us/pricing/details/storage/blobs/
12
Google Cloud
2x A100 80GB (a2-ultragpu-2g)
Not recommendedInstant$10.09$7.85$0.04$2.20IncludedIncluded$0.11 per GBYesNoYes160 GB340 GB
Yes, it's a better setup than 2xA6000s, but if you want 2x A100s, the other providers are cheaper anyway.
https://console.cloud.google.com/compute/instancesAdd
13
14
https://llm-utils.org/Nvidia+H100+and+A100+GPUs+-+comparing+available+capacity+at+GPU+cloud+providers
15
16
Thanks to Ravi, Nitish, Jakob, Doruk, Sashank and César for comments.
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100