Serverless GPU Prices
Prices for true serverless GPUs
Hero Image

Serverless GPU Prices

16
0.000089/s
0.3204/h
-51%
16
0.000111/s
0.3996/h
-39%
40410
0.000111/s
0.3996/h
-91%
0.000164/s
0.5904/h
-9%
16203
0.000185/s
0.666/h
+2%
16
0.0002/s
0.72/h
0
24
0.000208/s
0.7488/h
-39%
1684
0.000225/s
0.81/h
+25%
24
0.00026/s
0.936/h
0
0.000291/s
1.0476/h
-15%
24
0.000292/s
1.0512/h
-22%
0.000306/s
1.1016/h
-19%
16164
0.00031/s
1.116/h
+72%
24307
0.000341/s
1.2276/h
0
24
0.00044/s
1.584/h
0
48
0.00048/s
1.728/h
-9%
24328
0.00053/s
1.908/h
+55%
24328
0.00053/s
1.908/h
+41%
48164
0.000575/s
2.07/h
-12%
4810014
0.000575/s
2.07/h
+9%
48
0.00069/s
2.484/h
0
487210
0.000725/s
2.61/h
+12%
40
0.000833/s
2.9988/h
-32%
40
0.001036/s
3.7296/h
-15%
80
0.001111/s
3.9996/h
-9%
407210
0.00115/s
4.14/h
-6%
80
0.0013/s
4.68/h
+6%
8014410
0.0014/s
5.04/h
+15%
8020020
0.001491/s
5.3676/h
+22%
80
0.001522/s
5.4792/h
+25%
80
0.001553/s
5.5908/h
+27%
408512
0.00194/s
6.984/h
+59%
0.002125/s
7.65/h
-8%
80
0.0025/s
9/h
+8%
38468048
0.0058/s
20.88/h

Serverless GPU Vendors

VendorFree TierTrue ServerlessPricing PageDeploymentWebhooks
ReplicateUnspecifiedtruehttps://replicate.com/pricingCog SDKSupported
Inferless30 USDtruehttps://www.inferless.com/pricingInferless CLINot supported
RunpodUnknowntruehttps://www.runpod.io/serverless-gpuDockerSupported
Modal30 USD per monthtruehttps://modal.com/pricingModal SDKNot supported
ModelZ.ai1.41 USDtruehttps://modelz.ai/pricingDockerNot supported
Beam.cloud10 hourstruehttps://www.beam.cloud/pricingBeam SDKSupported
Mystic.ai20 USDtruehttps://www.mystic.ai/pricing/serverlessMystic SDKNot supported
Fal.aiUnknowntruehttps://www.vultr.com/pricing/#cloud-gpuFal.ai SDK. Enterprise only.Supported

T4

L4

A40

A100

H100

Recent benchmarks

Hello GPU

hello_gpu by replicate on t4
Median60.01s
Average69.95s
Failures0
36.05s 12:02:49 AM
139.02s 7:49:38 PM
20.6s 12:02:21 AM
76.01s 12:03:18 AM
133.45s 7:49:25 PM
86.86s 12:03:30 AM
23.95s 12:02:13 AM
96.66s 7:48:46 PM
14.96s 12:04:10 AM
172.81s 12:07:10 AM
134.93s 7:49:21 PM
60.01s 12:03:25 AM
23.68s 12:01:53 AM
110.14s 7:49:13 PM
20.73s 12:02:13 AM
13.57s 12:01:22 AM
101.64s 7:48:46 PM
34.59s 12:02:01 AM
29.31s 12:02:24 AM
hello_gpu by inferless on t4
Median123.76s
Average127.37s
Failures2
199.4s 7:50:38 PM
146.42s 7:49:38 PM
107.88s 7:48:54 PM
146.19s 7:49:29 PM
123.76s 7:49:26 PM
112.6s 7:48:57 PM
156.01s 7:49:50 PM
hello_gpu by runpod on 16gb
Median130.85s
Average129.68s
Failures0
154.63s 7:49:53 PM
142.22s 7:49:34 PM
105.97s 7:48:52 PM
145.25s 7:49:28 PM
119.47s 7:49:22 PM
110.51s 7:48:55 PM
hello_gpu by mystic on t4
Median135.74s
Average124.31s
Failures11
100.07s 12:02:13 AM
153.54s 7:49:52 PM
100.04s 12:02:26 AM
100.06s 12:02:07 AM
144.75s 7:49:36 PM
100.08s 12:01:58 AM
100.05s 12:02:24 AM
138.09s 7:49:25 PM
100.08s 12:01:50 AM
100.05s 12:02:15 AM
290.67s 7:51:54 PM
100.16s 12:01:54 AM
7.46s 12:01:47 AM
135.74s 7:49:38 PM
100.04s 12:02:14 AM
9.97s 12:01:44 AM
114.01s 7:48:58 PM
100.08s 12:02:10 AM
100.06s 12:02:18 AM
124.59s 7:49:19 PM
hello_gpu by modal on t4
Median167.62s
Average164.71s
Failures0
192.51s 7:49:38 PM
180.63s 7:49:25 PM
138.68s 7:48:46 PM
171.62s 7:49:21 PM
163.62s 7:49:13 PM
141.22s 7:48:46 PM
hello_gpu by beam on t4
MedianNaNs
AverageNaNs
Failures6
139.39s 7:49:38 PM
133.51s 7:49:25 PM
96.81s 7:48:46 PM
135.29s 7:49:21 PM
111.41s 7:49:14 PM
101.83s 7:48:46 PM

Hello Torch

hello_torch by replicate on t4
Median105.16s
Average135.32s
Failures0
136.02s 12:02:49 AM
105.16s 7:49:38 PM
92.11s 12:02:21 AM
174.06s 12:03:18 AM
90.15s 7:49:25 PM
193.23s 12:03:30 AM
86.1s 12:02:13 AM
85.03s 7:48:46 PM
240.28s 12:04:10 AM
395.59s 12:07:10 AM
116.71s 7:49:21 PM
194.04s 12:03:25 AM
106.29s 12:01:53 AM
99.68s 7:49:13 PM
98.53s 12:02:13 AM
76.04s 12:01:22 AM
83.89s 7:48:46 PM
91.94s 12:02:01 AM
106.17s 12:02:24 AM
hello_torch by mystic on t4
Median262.46s
Average319.4s
Failures13
100.06s 12:02:13 AM
436.82s 7:54:35 PM
100.04s 12:02:26 AM
100.07s 12:02:07 AM
262.46s 7:51:34 PM
100.48s 12:01:58 AM
100.05s 12:02:24 AM
237.52s 7:51:04 PM
100.1s 12:01:50 AM
100.05s 12:02:15 AM
260.56s 7:51:24 PM
100.16s 12:01:54 AM
100.07s 12:01:47 AM
410.64s 7:54:13 PM
100.03s 12:02:14 AM
100.06s 12:01:44 AM
390.1s 7:53:34 PM
100.1s 12:02:10 AM
100.06s 12:02:18 AM
237.69s 7:51:12 PM
hello_torch by inferless on t4
MedianNaNs
AverageNaNs
Failures7
169.4s 7:50:08 PM
163.71s 7:49:55 PM
126.92s 7:49:13 PM
165.49s 7:49:49 PM
141.21s 7:49:44 PM
132.15s 7:49:16 PM
126.03s 7:49:20 PM
hello_torch by runpod on 16gb
Median130.36s
Average128.16s
Failures0
147.99s 7:49:46 PM
141.77s 7:49:33 PM
105.58s 7:48:52 PM
144.74s 7:49:28 PM
118.95s 7:49:21 PM
109.94s 7:48:54 PM
hello_torch by modal on t4
Median164.86s
Average162.05s
Failures0
190.21s 7:49:38 PM
177.36s 7:49:25 PM
136.36s 7:48:46 PM
168.65s 7:49:21 PM
161.06s 7:49:13 PM
138.67s 7:48:46 PM
hello_torch by beam on t4
MedianNaNs
AverageNaNs
Failures6
139.32s 7:49:38 PM
133.51s 7:49:25 PM
96.81s 7:48:46 PM
135.29s 7:49:21 PM
111.39s 7:49:14 PM
101.83s 7:48:46 PM