Serverless GPU Prices
Prices for true serverless GPUs
Hero Image

Serverless GPU Prices

16
0.000111/s
0.3996/h
-43%
0.000164/s
0.5904/h
-16%
16
0.00017222/s
0.62/h
-11%
16203
0.000185/s
0.666/h
-5%
16
0.0002/s
0.72/h
0
24
0.000208/s
0.7488/h
-39%
1684
0.000225/s
0.81/h
+16%
24
0.00026/s
0.936/h
0
0.000291/s
1.0476/h
-15%
0.000306/s
1.1016/h
-21%
16164
0.00031/s
1.116/h
+59%
24307
0.000341/s
1.2276/h
0
24
0.00044/s
1.584/h
0
24
0.00046716/s
1.6818/h
+21%
24328
0.00053/s
1.908/h
+55%
48164
0.000575/s
2.07/h
-12%
48
0.00069/s
2.484/h
0
48
0.00069/s
2.484/h
0
487210
0.000725/s
2.61/h
+12%
40
0.000833/s
2.9988/h
-39%
40
0.001036/s
3.7296/h
-24%
80
0.001111/s
3.9996/h
-18%
407210
0.00115/s
4.14/h
-15%
80
0.0013/s
4.68/h
-4%
8014410
0.0014/s
5.04/h
+3%
8020020
0.001491/s
5.3676/h
+10%
80
0.001553/s
5.5908/h
+14%
80
0.00177361/s
6.385/h
+31%
408512
0.00194/s
6.984/h
+43%
0.002125/s
7.65/h
-8%
80
0.0025/s
9/h
+8%
38468048
0.0058/s
20.88/h

Serverless GPU Vendors

VendorFree TierTrue ServerlessPricing PageDeploymentWebhooks
ReplicateUnspecifiedtruehttps://replicate.com/pricingCog SDKSupported
Inferless30 USDtruehttps://www.inferless.com/pricingInferless CLINot supported
RunpodUnknowntruehttps://www.runpod.io/serverless-gpuDockerSupported
Modal30 USD per monthtruehttps://modal.com/pricingModal SDKNot supported
ModelZ.ai1.41 USDtruehttps://modelz.ai/pricingDockerNot supported
Beam.cloud10 hourstruehttps://www.beam.cloud/pricingBeam SDKSupported
Mystic.ai20 USDtruehttps://www.mystic.ai/pricing/serverlessMystic SDKNot supported

T4

L4

A40

A100

H100

Recent benchmarks

Hello GPU

hello_gpu by modal on t4
Median5.72s
Average8.25s
Failures0
2.1s 4:54:23 AM
3.39s 10:54:19 PM
12.71s 4:54:24 PM
1.9s 10:54:22 AM
7.5s 4:54:21 AM
7.51s 10:54:27 PM
6.39s 4:54:26 PM
31.64s 10:54:43 AM
5.04s 4:54:22 AM
4.36s 10:54:23 PM
hello_gpu by beam on t4
Median7.23s
Average6.77s
Failures0
7.1s 4:54:23 AM
7.29s 10:54:19 PM
7.37s 4:54:24 PM
7.57s 10:54:22 AM
6.22s 4:54:21 AM
7.18s 10:54:27 PM
4.83s 4:54:26 PM
7.35s 10:54:32 AM
4.83s 4:54:22 AM
8.01s 10:54:23 PM
hello_gpu by runpod on 16gb
Median10.95s
Average11.29s
Failures0
10.61s 4:54:23 AM
10.95s 10:54:19 PM
13.12s 4:54:24 PM
9.81s 10:54:22 AM
10.83s 4:54:21 AM
10.54s 10:54:27 PM
12.55s 4:54:26 PM
12.06s 10:54:32 AM
11.1s 4:54:22 AM
hello_gpu by inferless on t4
Median11.13s
Average17.64s
Failures0
29.48s 4:54:37 AM
10.98s 10:54:19 PM
11.44s 4:54:24 PM
11.13s 10:54:22 AM
10.82s 4:54:21 AM
32.71s 10:54:41 PM
10.8s 4:54:26 PM
10.54s 10:54:32 AM
30.86s 4:54:39 AM
hello_gpu by mystic on t4
Median21.45s
Average43.46s
Failures3
26.96s 4:54:35 AM
100.13s 12:02:14 AM
10.32s 10:54:19 PM
30.1s 4:54:39 PM
181.45s 10:57:09 AM
27.43s 4:54:35 AM
100.07s 12:02:21 AM
15.93s 10:54:27 PM
14.03s 4:54:26 PM
105.87s 10:55:57 AM
11.5s 4:54:22 AM
100.08s 12:02:13 AM
10.98s 10:54:23 PM
hello_gpu by replicate on t4
Median27.68s
Average42.6s
Failures0
25.18s 4:54:33 AM
86.03s 12:04:13 AM
29.49s 10:54:38 PM
57.14s 4:55:06 PM
60.65s 10:55:08 AM
25.53s 4:54:33 AM
21.24s 12:02:27 AM
80.7s 10:55:29 PM
26.46s 4:54:35 PM
62.46s 10:55:13 AM
27.68s 4:54:36 AM
24.98s 12:03:42 AM
26.3s 10:54:34 PM

Hello Torch

hello_torch by modal on t4
Median12.68s
Average16.42s
Failures0
11.14s 4:54:23 AM
11.77s 10:54:20 PM
15.46s 4:54:25 PM
10.7s 10:54:22 AM
16.79s 4:54:24 AM
15.94s 10:54:27 PM
12.68s 4:54:26 PM
42.86s 10:54:54 AM
10.45s 4:54:22 AM
hello_torch by beam on t4
Median12.78s
Average12.5s
Failures0
13.22s 4:54:23 AM
10.45s 10:54:19 PM
14.23s 4:54:24 PM
12.78s 10:54:22 AM
12.48s 4:54:21 AM
10.5s 10:54:27 PM
13.52s 4:54:26 PM
10.76s 10:54:32 AM
14.6s 4:54:23 AM
hello_torch by runpod on 16gb
Median12.79s
Average13.34s
Failures0
12.24s 4:54:23 AM
12.66s 10:54:21 PM
14.94s 4:54:24 PM
11.48s 10:54:22 AM
12.43s 4:54:21 AM
12.25s 10:54:27 PM
14.18s 4:54:26 PM
13.69s 10:54:32 AM
12.91s 4:54:22 AM
16.62s 10:54:24 PM
hello_torch by inferless on t4
Median19.36s
Average19.58s
Failures7
30.31s 4:54:38 AM
30.33s 10:54:39 PM
19.36s 4:54:28 PM
30.37s 10:54:38 AM
30.33s 4:54:38 AM
18.65s 10:54:27 PM
30.45s 4:54:39 PM
20.72s 10:54:32 AM
30.17s 4:54:39 AM
30.36s 10:54:38 PM
hello_torch by mystic on t4
Median112.51s
Average114.31s
Failures3
197.92s 4:57:26 AM
100.14s 12:02:14 AM
99.95s 10:55:48 PM
117.86s 4:56:07 PM
156.8s 10:56:44 AM
118.01s 4:56:05 AM
100.06s 12:02:21 AM
114.63s 10:56:03 PM
103.23s 4:55:52 PM
23.36s 10:54:34 AM
100.98s 4:55:49 AM
100.07s 12:02:13 AM
110.38s 10:55:58 PM
hello_torch by replicate on t4
Median174.2s
Average169.64s
Failures0
115.24s 4:56:03 AM
218.89s 12:04:13 AM
104.94s 10:55:53 PM
329.7s 4:59:39 PM
127.91s 10:56:15 AM
99.33s 4:55:47 AM
109.06s 12:02:27 AM
120.95s 10:56:09 PM
198.94s 4:57:28 PM
174.2s 10:57:05 AM
175.91s 4:57:04 AM
189.37s 12:03:42 AM
240.87s 10:58:09 PM