16GB Serverless prices

16GB cards

Prices for true serverless GPUs

16GB is a category of cards in Runpod. Since Runpod does not offer the more standard T4 card, other cards with 16GB GPU memoery is used for benchmarks with Runpod.

16GB Serverless GPU Prices

Show shared


Mystic.ai	Nvidia T4	16			0.000111/s 0.3996/h -42%
Beam.cloud	T4 GPU	16			0.00015/s 0.54/h -21%
Modal	Nvidia T4				0.000164/s 0.5904/h -14%
Inferless	T4	16	20	3	0.000185/s 0.666/h -3%
Runpod	A4000	16			0.0002/s 0.72/h 0
Replicate	T4	16	8	4	0.000225/s 0.81/h +18%
ModelZ.ai	T4 GPU	16	16	4	0.00031/s 1.116/h +62%

16GB Serverless GPU Vendors

Vendor	Free Tier	True Serverless	Pricing Page	Deployment	Webhooks
Replicate	Unspecified	true	https://replicate.com/pricing	Cog SDK	Supported
Inferless	30 USD	true	https://www.inferless.com/pricing	Inferless CLI	Not supported
Runpod	Unknown	true	https://www.runpod.io/serverless-gpu	Docker	Supported
Modal	30 USD per month	true	https://modal.com/pricing	Modal SDK	Not supported
ModelZ.ai	1.41 USD	true	https://modelz.ai/pricing	Docker	Not supported
Beam.cloud	10 hours	true	https://www.beam.cloud/pricing	Beam SDK	Supported
Mystic.ai	20 USD	true	https://www.mystic.ai/pricing/serverless	Mystic SDK	Not supported

Recent benchmarks for 16GB

hello_gpu by replicate on t4

Median20.51s

Average33.1s

Failures0

189.38s 12:03:53 AM

22.06s 12:02:20 AM

11.97s 12:02:25 AM

33.48s 12:03:15 AM

10.58s 12:01:42 AM

24.02s 12:02:06 AM

12.59s 12:02:20 AM

11.39s 12:02:25 AM

17.5s 12:05:20 AM

39.28s 12:01:33 AM

42.09s 12:02:26 AM

20.96s 12:02:21 AM

11.09s 12:01:29 AM

15.44s 12:01:46 AM

47.75s 12:04:21 AM

20.05s 12:02:06 AM

hello_gpu by mystic on t4

Median56.19s

Average54.3s

Failures6

100.16s 12:02:23 AM

39.85s 12:02:33 AM

100.05s 12:02:36 AM

100.07s 12:02:34 AM

100.1s 12:01:55 AM

84.48s 12:01:58 AM

100.06s 12:02:24 AM

40.37s 12:02:38 AM

87.04s 12:02:02 AM

6.96s 12:01:43 AM

86.72s 12:01:57 AM

45.21s 12:02:39 AM

10.11s 12:01:39 AM

100.05s 12:01:56 AM

67.17s 12:02:11 AM

75.1s 12:02:15 AM

hello_torch by replicate on t4

Median87.67s

Average116.34s

Failures0

82.81s 12:03:53 AM

81.05s 12:02:20 AM

88.72s 12:02:25 AM

144.93s 12:03:15 AM

84.11s 12:01:42 AM

111.26s 12:02:06 AM

95.92s 12:02:20 AM

83.89s 12:02:25 AM

298.31s 12:05:20 AM

82.58s 12:01:33 AM

129.59s 12:02:26 AM

81.41s 12:02:21 AM

86.33s 12:01:29 AM

86.62s 12:01:46 AM

233.06s 12:04:21 AM

90.83s 12:02:06 AM

hello_torch by mystic on t4

Median92.38s

Average84.85s

Failures11

100.15s 12:02:23 AM

94.3s 12:02:33 AM

100.06s 12:02:36 AM

100.07s 12:02:34 AM

100.1s 12:01:55 AM

100.2s 12:01:58 AM

53.62s 12:02:24 AM

100.06s 12:02:38 AM

100.1s 12:02:02 AM

92.38s 12:01:43 AM

100.11s 12:01:57 AM

100.07s 12:02:39 AM

95.62s 12:01:39 AM

88.34s 12:01:56 AM

100.05s 12:02:11 AM

100.13s 12:02:15 AM