Serverless GPU Prices
Prices for true serverless GPUs
Hero Image

Serverless GPU Prices

16
0.000111/s
0.3996/h
-42%
40410
0.000111/s
0.3996/h
-90%
16
0.00015/s
0.54/h
-21%
0.000164/s
0.5904/h
-14%
16203
0.000185/s
0.666/h
-3%
24
0.000192/s
0.6912/h
-39%
16
0.0002/s
0.72/h
0
24
0.000208/s
0.7488/h
-35%
0.000222/s
0.7992/h
-31%
1684
0.000225/s
0.81/h
+18%
24
0.00026/s
0.936/h
0
24
0.000292/s
1.0512/h
-22%
0.000306/s
1.1016/h
-19%
16164
0.00031/s
1.116/h
+62%
24307
0.000341/s
1.2276/h
0
24
0.00044/s
1.584/h
+39%
48
0.00048/s
1.728/h
-9%
24328
0.00053/s
1.908/h
+66%
24328
0.00053/s
1.908/h
+41%
48164
0.000575/s
2.07/h
-12%
4810014
0.000575/s
2.07/h
+9%
48
0.00069/s
2.484/h
0
487210
0.000725/s
2.61/h
+12%
40
0.000772/s
2.7792/h
-29%
40
0.000833/s
2.9988/h
-24%
80
0.000944/s
3.3984/h
-14%
40
0.000972/s
3.4992/h
-11%
80
0.001111/s
3.9996/h
+2%
407210
0.00115/s
4.14/h
+5%
80
0.001267/s
4.5612/h
-34%
80
0.0013/s
4.68/h
+19%
8014410
0.0014/s
5.04/h
+28%
8020020
0.001491/s
5.3676/h
+36%
408512
0.00194/s
6.984/h
+77%
80
0.001986/s
7.1496/h
+4%
80
0.0025/s
9/h
+30%
38468048
0.0058/s
20.88/h

Serverless GPU Vendors

VendorFree TierTrue ServerlessPricing PageDeploymentWebhooks
ReplicateUnspecifiedtruehttps://replicate.com/pricingCog SDKSupported
Inferless30 USDtruehttps://www.inferless.com/pricingInferless CLINot supported
RunpodUnknowntruehttps://www.runpod.io/serverless-gpuDockerSupported
Modal30 USD per monthtruehttps://modal.com/pricingModal SDKNot supported
ModelZ.ai1.41 USDtruehttps://modelz.ai/pricingDockerNot supported
Beam.cloud10 hourstruehttps://www.beam.cloud/pricingBeam SDKSupported
Mystic.ai20 USDtruehttps://www.mystic.ai/pricing/serverlessMystic SDKNot supported
Fal.aiUnknowntruehttps://www.vultr.com/pricing/#cloud-gpuFal.ai SDK. Enterprise only.Supported

T4

L4

A40

A100

H100

Recent benchmarks

Hello GPU

hello_gpu by replicate on t4
Median15.01s
Average25.38s
Failures0
22.06s 12:02:20 AM
11.97s 12:02:25 AM
33.48s 12:03:15 AM
10.58s 12:01:42 AM
24.02s 12:02:06 AM
12.59s 12:02:20 AM
11.39s 12:02:25 AM
17.5s 12:05:20 AM
39.28s 12:01:33 AM
42.09s 12:02:26 AM
20.96s 12:02:21 AM
11.09s 12:01:29 AM
15.44s 12:01:46 AM
47.75s 12:04:21 AM
20.05s 12:02:06 AM
87.29s 12:02:11 AM
12.1s 12:01:37 AM
17.84s 12:02:07 AM
30.64s 12:02:07 AM
12.25s 12:01:40 AM
9.82s 12:02:16 AM
12.04s 12:01:43 AM
14.58s 12:01:23 AM
14.01s 12:02:38 AM
12.06s 12:02:16 AM
21.8s 12:04:40 AM
12.45s 12:02:03 AM
160.09s 12:03:29 AM
11.5s 12:01:50 AM
13.43s 12:01:47 AM
12.94s 12:02:15 AM
17.07s 12:02:08 AM
hello_gpu by mystic on t4
Median54.76s
Average50.88s
Failures10
39.85s 12:02:33 AM
100.05s 12:02:36 AM
100.07s 12:02:34 AM
100.1s 12:01:55 AM
84.48s 12:01:58 AM
100.06s 12:02:24 AM
40.37s 12:02:38 AM
87.04s 12:02:02 AM
6.96s 12:01:43 AM
86.72s 12:01:57 AM
45.21s 12:02:39 AM
10.11s 12:01:39 AM
100.05s 12:01:56 AM
67.17s 12:02:11 AM
75.1s 12:02:15 AM
63.55s 12:02:10 AM
74.96s 12:01:55 AM
57.52s 12:02:24 AM
100.14s 12:02:01 AM
8.13s 12:01:40 AM
47.42s 12:02:19 AM
81.07s 12:01:55 AM
11.13s 12:01:44 AM
100.04s 12:02:36 AM
54.54s 12:02:33 AM
42.46s 12:02:40 AM
100.1s 12:02:20 AM
54.98s 12:02:30 AM
67.09s 12:02:11 AM
13.44s 12:01:49 AM
100.08s 12:02:22 AM
100.08s 12:02:19 AM

Hello Torch

hello_torch by replicate on t4
Median89.2s
Average108.86s
Failures0
81.05s 12:02:20 AM
88.72s 12:02:25 AM
144.93s 12:03:15 AM
84.11s 12:01:42 AM
111.26s 12:02:06 AM
95.92s 12:02:20 AM
83.89s 12:02:25 AM
298.31s 12:05:20 AM
82.58s 12:01:33 AM
129.59s 12:02:26 AM
81.41s 12:02:21 AM
86.33s 12:01:29 AM
86.62s 12:01:46 AM
233.06s 12:04:21 AM
90.83s 12:02:06 AM
98.81s 12:02:11 AM
81.92s 12:01:37 AM
83.07s 12:02:07 AM
106.56s 12:02:07 AM
89.2s 12:01:40 AM
92.39s 12:02:16 AM
88.43s 12:01:43 AM
78.54s 12:01:23 AM
104.44s 12:02:38 AM
82.06s 12:02:16 AM
219.8s 12:04:40 AM
82.42s 12:02:03 AM
146.07s 12:03:29 AM
76.69s 12:01:50 AM
95.22s 12:01:47 AM
90.06s 12:02:15 AM
89.19s 12:02:08 AM
hello_torch by mystic on t4
Median93.94s
Average88.8s
Failures24
94.3s 12:02:33 AM
100.06s 12:02:36 AM
100.07s 12:02:34 AM
100.1s 12:01:55 AM
100.2s 12:01:58 AM
53.62s 12:02:24 AM
100.06s 12:02:38 AM
100.1s 12:02:02 AM
92.38s 12:01:43 AM
100.11s 12:01:57 AM
100.07s 12:02:39 AM
95.62s 12:01:39 AM
88.34s 12:01:56 AM
100.05s 12:02:11 AM
100.13s 12:02:15 AM
97.17s 12:02:10 AM
100.05s 12:01:55 AM
100.08s 12:02:24 AM
100.14s 12:02:01 AM
93.59s 12:01:40 AM
95.41s 12:02:19 AM
100.12s 12:01:55 AM
100.05s 12:01:44 AM
100.05s 12:02:36 AM
100.08s 12:02:33 AM
100.06s 12:02:40 AM
100.1s 12:02:20 AM
100.13s 12:02:30 AM
100.14s 12:02:11 AM
100.09s 12:01:49 AM
100.08s 12:02:22 AM
100.08s 12:02:19 AM