Serverless GPU Prices
Prices for true serverless GPUs
Serverless GPU Prices
| 16 | 0.000111/s 0.3996/h -42% | ||||
| 40 | 4 | 10 | 0.000111/s 0.3996/h -90% | ||
| 16 | 0.00015/s 0.54/h -21% | ||||
0.000164/s 0.5904/h -14% | |||||
| 16 | 20 | 3 | 0.000185/s 0.666/h -3% | ||
| 24 | 0.000192/s 0.6912/h -39% | ||||
| 16 | 0.0002/s 0.72/h 0 | ||||
| 24 | 0.000208/s 0.7488/h -35% | ||||
0.000222/s 0.7992/h -31% | |||||
| 16 | 8 | 4 | 0.000225/s 0.81/h +18% | ||
| 24 | 0.00026/s 0.936/h 0 | ||||
| 24 | 0.000292/s 1.0512/h -22% | ||||
0.000306/s 1.1016/h -19% | |||||
| 16 | 16 | 4 | 0.00031/s 1.116/h +62% | ||
| 24 | 30 | 7 | 0.000341/s 1.2276/h 0 | ||
| 24 | 0.00044/s 1.584/h +39% | ||||
| 48 | 0.00048/s 1.728/h -9% | ||||
| 24 | 32 | 8 | 0.00053/s 1.908/h +66% | ||
| 24 | 32 | 8 | 0.00053/s 1.908/h +41% | ||
| 48 | 16 | 4 | 0.000575/s 2.07/h -12% | ||
| 48 | 100 | 14 | 0.000575/s 2.07/h +9% | ||
| 48 | 0.00069/s 2.484/h 0 | ||||
| 48 | 72 | 10 | 0.000725/s 2.61/h +12% | ||
| 40 | 0.000772/s 2.7792/h -29% | ||||
| 40 | 0.000833/s 2.9988/h -24% | ||||
| 80 | 0.000944/s 3.3984/h -14% | ||||
| 40 | 0.000972/s 3.4992/h -11% | ||||
| 80 | 0.001111/s 3.9996/h +2% | ||||
| 40 | 72 | 10 | 0.00115/s 4.14/h +5% | ||
| 80 | 0.001267/s 4.5612/h -34% | ||||
| 80 | 0.0013/s 4.68/h +19% | ||||
| 80 | 144 | 10 | 0.0014/s 5.04/h +28% | ||
| 80 | 200 | 20 | 0.001491/s 5.3676/h +36% | ||
| 40 | 85 | 12 | 0.00194/s 6.984/h +77% | ||
| 80 | 0.001986/s 7.1496/h +4% | ||||
| 80 | 0.0025/s 9/h +30% | ||||
| 384 | 680 | 48 | 0.0058/s 20.88/h |
Serverless GPU Vendors
| Vendor | Free Tier | True Serverless | Pricing Page | Deployment | Webhooks |
|---|---|---|---|---|---|
| Replicate | Unspecified | true | https://replicate.com/pricing | Cog SDK | Supported |
| Inferless | 30 USD | true | https://www.inferless.com/pricing | Inferless CLI | Not supported |
| Runpod | Unknown | true | https://www.runpod.io/serverless-gpu | Docker | Supported |
| Modal | 30 USD per month | true | https://modal.com/pricing | Modal SDK | Not supported |
| ModelZ.ai | 1.41 USD | true | https://modelz.ai/pricing | Docker | Not supported |
| Beam.cloud | 10 hours | true | https://www.beam.cloud/pricing | Beam SDK | Supported |
| Mystic.ai | 20 USD | true | https://www.mystic.ai/pricing/serverless | Mystic SDK | Not supported |
| Fal.ai | Unknown | true | https://www.vultr.com/pricing/#cloud-gpu | Fal.ai SDK. Enterprise only. | Supported |
Popular GPUs
Recent benchmarks
Hello GPU
11.5s 12:01:34 AM
12.47s 12:02:05 AM
85.64s 12:09:10 AM
14.1s 12:03:49 AM
13.21s 12:01:51 AM
14s 12:02:01 AM
14.54s 12:02:05 AM
35.69s 12:04:50 AM
29.13s 12:01:49 AM
26.02s 12:02:02 AM
14.5s 12:01:55 AM
15.36s 12:02:03 AM
15.73s 12:02:14 AM
11.28s 12:02:11 AM
30.56s 12:02:22 AM
68.56s 12:03:02 AM
17.15s 12:02:23 AM
14.72s 12:01:49 AM
33.64s 12:03:52 AM
30.41s 12:01:30 AM
12.25s 12:01:40 AM
13.4s 12:02:27 AM
204.36s 12:04:09 AM
12.53s 12:01:34 AM
143.55s 12:03:22 AM
11.6s 12:01:57 AM
28.31s 12:02:07 AM
30.6s 12:03:55 AM
12.2s 12:02:47 AM
11.84s 12:01:56 AM
15.57s 12:02:20 AM
45.68s 12:02:08 AM
0.1s 12:00:07 AM
0.12s 12:00:13 AM
0.09s 12:00:25 AM
0.09s 12:00:07 AM
0.03s 12:00:20 AM
0.03s 12:00:37 AM
0.12s 12:00:44 AM
0.07s 12:00:36 AM
0.09s 12:00:03 AM
0.12s 12:00:27 AM
0.18s 12:00:20 AM
0.11s 12:00:21 AM
100.08s 12:02:13 AM
100.04s 12:02:30 AM
100.19s 12:02:07 AM
100.04s 12:02:29 AM
100.04s 12:01:59 AM
100.09s 12:01:59 AM
100.04s 12:02:10 AM
100.11s 12:01:48 AM
100.07s 12:01:51 AM
100.08s 12:02:25 AM
100.06s 12:02:28 AM
100.08s 12:01:40 AM
100.08s 12:02:41 AM
100.08s 12:02:11 AM
100.08s 12:02:10 AM
100.13s 12:02:01 AM
100.08s 12:02:12 AM
100.05s 12:02:07 AM
100.14s 12:02:15 AM
100.08s 12:02:07 AM
Hello Torch
hello_torch by replicate on t4
Median98.89s
Average127.46s
Failures0
90.09s 12:01:34 AM
116.38s 12:02:05 AM
528.49s 12:09:10 AM
225.71s 12:03:49 AM
94.54s 12:01:51 AM
86.49s 12:02:01 AM
81.81s 12:02:05 AM
254.74s 12:04:50 AM
109.18s 12:01:49 AM
95.44s 12:02:02 AM
95.42s 12:01:55 AM
101.86s 12:02:03 AM
101.96s 12:02:14 AM
81.28s 12:02:11 AM
114.58s 12:02:22 AM
132.44s 12:03:02 AM
124.22s 12:02:23 AM
89.45s 12:01:49 AM
201.82s 12:03:52 AM
81.79s 12:01:30 AM
85.42s 12:01:40 AM
102.7s 12:02:27 AM
83.9s 12:04:09 AM
90.79s 12:01:34 AM
87.3s 12:03:22 AM
83.2s 12:01:57 AM
97.19s 12:02:07 AM
214.22s 12:03:55 AM
135.24s 12:02:47 AM
85.2s 12:01:56 AM
105.14s 12:02:20 AM
100.6s 12:02:08 AM
hello_torch by mystic on t4
MedianNaNs
AverageNaNs
Failures32
0.1s 12:00:07 AM
0.1s 12:00:13 AM
0.09s 12:00:25 AM
0.13s 12:00:07 AM
0.03s 12:00:20 AM
0.03s 12:00:37 AM
0.12s 12:00:44 AM
0.07s 12:00:36 AM
0.08s 12:00:03 AM
0.12s 12:00:27 AM
0.17s 12:00:20 AM
0.11s 12:00:21 AM
100.08s 12:02:13 AM
100.05s 12:02:30 AM
100.14s 12:02:07 AM
100.04s 12:02:29 AM
100.04s 12:01:59 AM
100.08s 12:01:59 AM
100.04s 12:02:10 AM
100.1s 12:01:48 AM
100.08s 12:01:51 AM
100.14s 12:02:25 AM
100.06s 12:02:28 AM
100.08s 12:01:40 AM
100.08s 12:02:41 AM
100.07s 12:02:11 AM
100.08s 12:02:10 AM
100.11s 12:02:01 AM
100.08s 12:02:12 AM
100.04s 12:02:07 AM
100.13s 12:02:15 AM
100.08s 12:02:07 AM