16GB cards
Prices for true serverless GPUs
16GB is a category of cards in Runpod. Since Runpod does not offer the more standard T4 card, other cards with 16GB GPU memoery is used for benchmarks with Runpod.
16GB Serverless GPU Prices
16GB Serverless GPU Vendors
| Vendor | Free Tier | True Serverless | Pricing Page | Deployment | Webhooks |
|---|---|---|---|---|---|
| Replicate | Unspecified | true | https://replicate.com/pricing | Cog SDK | Supported |
| Inferless | 30 USD | true | https://www.inferless.com/pricing | Inferless CLI | Not supported |
| Runpod | Unknown | true | https://www.runpod.io/serverless-gpu | Docker | Supported |
| Modal | 30 USD per month | true | https://modal.com/pricing | Modal SDK | Not supported |
| ModelZ.ai | 1.41 USD | true | https://modelz.ai/pricing | Docker | Not supported |
| Beam.cloud | 10 hours | true | https://www.beam.cloud/pricing | Beam SDK | Supported |
| Mystic.ai | 20 USD | true | https://www.mystic.ai/pricing/serverless | Mystic SDK | Not supported |
Recent benchmarks for 16GB
37.42s 12:01:26 AM
17.31s 12:01:48 AM
65.29s 12:02:27 AM
11.35s 12:01:52 AM
12.35s 12:01:57 AM
24.01s 12:02:37 AM
142.7s 7:49:42 PM
13.18s 12:02:05 AM
20.57s 12:02:10 AM
13.46s 12:03:53 AM
114.63s 12:04:37 AM
91.68s 7:48:54 PM
hello_torch by mystic on t4
Median71.68s
Average136.52s
Failures9
100.1s 12:01:45 AM
100.07s 12:02:08 AM
100.06s 12:02:39 AM
100.05s 12:02:04 AM
71.68s 12:02:15 AM
44.14s 12:02:41 AM
293.75s 7:52:13 PM
100.07s 12:02:15 AM
100.08s 12:02:15 AM
100.08s 12:01:49 AM
100.07s 12:02:13 AM
391.9s 7:53:54 PM
hello_torch by replicate on t4
Median88.88s
Average113.71s
Failures0
80.6s 12:01:26 AM
77.8s 12:01:48 AM
87.9s 12:02:27 AM
85.39s 12:01:52 AM
82.3s 12:01:57 AM
95.89s 12:02:37 AM
118.41s 7:49:42 PM
89.87s 12:02:05 AM
95.66s 12:02:10 AM
227.53s 12:03:53 AM
246.83s 12:04:37 AM
76.33s 7:48:54 PM
hello_torch by inferless on t4
Median112.76s
Average112.76s
Failures1
143.1s 7:49:43 PM
112.76s 7:49:14 PM
147.17s 7:49:47 PM
96.38s 7:48:58 PM
hello_torch by runpod on 16gb
Median126.84s
Average126.84s
Failures0
152.47s 7:49:52 PM
101.21s 7:49:03 PM
100.08s 12:01:45 AM
100.06s 12:02:08 AM
100.05s 12:02:39 AM
100.04s 12:02:04 AM
100.05s 12:02:15 AM
100.06s 12:02:41 AM
150.64s 7:49:50 PM
100.05s 12:02:15 AM
100.08s 12:02:15 AM
14.12s 12:01:49 AM
100.07s 12:02:13 AM
340.41s 7:53:02 PM
hello_torch by modal on t4
Median169.92s
Average169.92s
Failures0
194.53s 7:49:42 PM
145.32s 7:48:54 PM
hello_torch by beam on t4
MedianNaNs
AverageNaNs
Failures2
142.87s 7:49:42 PM
91.8s 7:48:54 PM