Serverless GPU Prices
Prices for true serverless GPUs
Hero Image

Serverless GPU Prices

16
0.000111/s
0.3996/h
-42%
40410
0.000111/s
0.3996/h
-89%
16
0.00015/s
0.54/h
-21%
0.000164/s
0.5904/h
-14%
16203
0.000185/s
0.666/h
-3%
24
0.000192/s
0.6912/h
-39%
16
0.0002/s
0.72/h
0
24
0.000208/s
0.7488/h
-35%
0.000222/s
0.7992/h
-31%
1684
0.000225/s
0.81/h
+18%
24
0.00026/s
0.936/h
0
24
0.000292/s
1.0512/h
-22%
0.000306/s
1.1016/h
-19%
16164
0.00031/s
1.116/h
+62%
24307
0.000341/s
1.2276/h
0
24
0.00044/s
1.584/h
+39%
48
0.00048/s
1.728/h
-9%
24328
0.00053/s
1.908/h
+66%
24328
0.00053/s
1.908/h
+41%
0.000542/s
1.9512/h
-29%
48164
0.000575/s
2.07/h
-12%
4810014
0.000575/s
2.07/h
+9%
40
0.000583/s
2.0988/h
-45%
48
0.00069/s
2.484/h
0
80
0.000694/s
2.4984/h
-34%
487210
0.000725/s
2.61/h
+12%
40
0.000833/s
2.9988/h
-21%
40
0.000972/s
3.4992/h
-8%
486510
0.000975/s
3.51/h
+29%
80
0.001097/s
3.9492/h
-41%
80
0.001111/s
3.9996/h
+5%
407210
0.00115/s
4.14/h
+9%
80
0.0013/s
4.68/h
+23%
8014410
0.0014/s
5.04/h
+33%
8020020
0.001491/s
5.3676/h
+42%
408512
0.00194/s
6.984/h
+84%
80
0.001986/s
7.1496/h
+7%
80
0.0025/s
9/h
+34%
38468048
0.0058/s
20.88/h

Serverless GPU Vendors

VendorFree TierTrue ServerlessPricing PageDeploymentWebhooks
ReplicateUnspecifiedtruehttps://replicate.com/pricingCog SDKSupported
Inferless30 USDtruehttps://www.inferless.com/pricingInferless CLINot supported
RunpodUnknowntruehttps://www.runpod.io/serverless-gpuDockerSupported
Modal30 USD per monthtruehttps://modal.com/pricingModal SDKNot supported
ModelZ.ai1.41 USDtruehttps://modelz.ai/pricingDockerNot supported
Beam.cloud10 hourstruehttps://www.beam.cloud/pricingBeam SDKSupported
Mystic.ai20 USDtruehttps://www.mystic.ai/pricing/serverlessMystic SDKNot supported
Fal.aiUnknowntruehttps://www.vultr.com/pricing/#cloud-gpuFal.ai SDK. Enterprise only.Supported

T4

L4

A40

A100

H100

Recent benchmarks

Hello GPU

hello_gpu by replicate on t4
Median14.78s
Average22.8s
Failures0
14.73s 12:03:57 AM
94.01s 12:05:21 AM
13.8s 12:01:26 AM
12.97s 12:01:21 AM
14.81s 12:01:22 AM
18.4s 12:01:34 AM
28.58s 12:02:05 AM
21.91s 12:01:29 AM
16.72s 12:01:37 AM
19.43s 12:02:09 AM
27.27s 12:02:40 AM
144.54s 12:03:12 AM
11.56s 12:02:05 AM
14.29s 12:02:06 AM
17.63s 12:01:53 AM
14.34s 12:01:27 AM
14.8s 12:03:22 AM
11.19s 12:02:37 AM
14.76s 12:01:55 AM
15.04s 12:02:24 AM
12.41s 12:02:03 AM
13.31s 12:02:35 AM
17.29s 12:01:51 AM
11.17s 12:01:48 AM
36.99s 12:03:32 AM
25.1s 12:02:00 AM
16.68s 12:01:49 AM
11.1s 12:01:58 AM
9.89s 12:02:25 AM
11.24s 12:02:22 AM
11.19s 12:01:54 AM
12.5s 12:02:10 AM
hello_gpu by mystic on t4
MedianNaNs
AverageNaNs
Failures32
0.1s 12:00:36 AM
0.07s 12:00:48 AM
0.12s 12:00:01 AM
0.03s 12:00:05 AM
0.06s 12:00:06 AM
0.11s 12:00:12 AM
0.06s 12:00:32 AM
0.05s 12:00:04 AM
0.06s 12:00:15 AM
0.03s 12:00:48 AM
0.04s 12:00:13 AM
0.07s 12:00:50 AM
0.08s 12:00:43 AM
0.03s 12:00:39 AM
0.05s 12:00:31 AM
0.06s 12:00:03 AM
0.04s 12:00:58 AM
0.05s 12:00:21 AM
0.03s 12:00:16 AM
0.09s 12:00:59 AM
0.04s 12:00:46 AM
0.06s 12:00:56 AM
0.09s 12:00:08 AM
0.05s 12:00:33 AM
0.05s 12:00:32 AM
0.03s 12:00:33 AM
0.11s 12:00:34 AM
0.04s 12:00:40 AM
0.03s 12:01:03 AM
0.05s 12:00:49 AM
0.1s 12:00:31 AM
0.08s 12:00:50 AM

Hello Torch

hello_torch by replicate on t4
Median85.35s
Average104.66s
Failures0
201.34s 12:03:57 AM
275.8s 12:05:21 AM
85.29s 12:01:26 AM
79.32s 12:01:21 AM
79.23s 12:01:22 AM
82.83s 12:01:34 AM
92.85s 12:02:05 AM
88.39s 12:01:29 AM
81.64s 12:01:37 AM
84.34s 12:02:09 AM
147.23s 12:02:40 AM
118.57s 12:03:12 AM
82.26s 12:02:05 AM
87.08s 12:02:06 AM
82.01s 12:01:53 AM
84.28s 12:01:27 AM
144.06s 12:03:22 AM
135.36s 12:02:37 AM
98.84s 12:01:55 AM
84.92s 12:02:24 AM
77.03s 12:02:03 AM
102.24s 12:02:35 AM
106.62s 12:01:51 AM
77.72s 12:01:48 AM
180.28s 12:03:32 AM
87.06s 12:02:00 AM
75.3s 12:01:49 AM
82.07s 12:01:58 AM
85.41s 12:02:25 AM
96.89s 12:02:22 AM
83.3s 12:01:54 AM
79.48s 12:02:10 AM
hello_torch by mystic on t4
MedianNaNs
AverageNaNs
Failures32
0.1s 12:00:36 AM
0.09s 12:00:48 AM
0.1s 12:00:01 AM
0.03s 12:00:05 AM
0.05s 12:00:06 AM
0.13s 12:00:12 AM
0.05s 12:00:32 AM
0.05s 12:00:04 AM
0.06s 12:00:15 AM
0.03s 12:00:48 AM
0.04s 12:00:13 AM
0.09s 12:00:50 AM
0.08s 12:00:43 AM
0.03s 12:00:39 AM
0.07s 12:00:31 AM
0.06s 12:00:03 AM
0.03s 12:00:58 AM
0.05s 12:00:21 AM
0.03s 12:00:16 AM
0.09s 12:00:59 AM
0.03s 12:00:46 AM
0.06s 12:00:56 AM
0.08s 12:00:08 AM
0.05s 12:00:33 AM
0.05s 12:00:32 AM
0.03s 12:00:33 AM
0.11s 12:00:34 AM
0.06s 12:00:40 AM
0.03s 12:01:03 AM
0.05s 12:00:49 AM
0.09s 12:00:31 AM
0.09s 12:00:50 AM