Home


Mystic.ai	Nvidia T4	16			0.000111/s 0.3996/h -42%
Fal.ai	A100	40	4	10	0.000111/s 0.3996/h -90%
Beam.cloud	T4 GPU	16			0.00015/s 0.54/h -21%
Modal	Nvidia T4				0.000164/s 0.5904/h -14%
Inferless	T4	16	20	3	0.000185/s 0.666/h -3%
Beam.cloud	RTX 4090 GPU	24			0.000192/s 0.6912/h -39%
Runpod	A4000	16			0.0002/s 0.72/h 0
Mystic.ai	Nvidia L4	24			0.000208/s 0.7488/h -35%
Modal	Nvidia L4				0.000222/s 0.7992/h -31%
Replicate	T4	16	8	4	0.000225/s 0.81/h +18%
Runpod	A5000	24			0.00026/s 0.936/h 0
Beam.cloud	A10G GPU	24			0.000292/s 1.0512/h -22%
Modal	Nvidia A10G				0.000306/s 1.1016/h -19%
ModelZ.ai	T4 GPU	16	16	4	0.00031/s 1.116/h +62%
Inferless	A10	24	30	7	0.000341/s 1.2276/h 0
Runpod	4090	24			0.00044/s 1.584/h +39%
Runpod	A6000	48			0.00048/s 1.728/h -9%
ModelZ.ai	L4 Tensor Core GPU	24	32	8	0.00053/s 1.908/h +66%
Fal.ai	A10G	24	32	8	0.00053/s 1.908/h +41%
Replicate	A40	48	16	4	0.000575/s 2.07/h -12%
Fal.ai	A6000	48	100	14	0.000575/s 2.07/h +9%
Runpod	L40	48			0.00069/s 2.484/h 0
Replicate	A40 (Large)	48	72	10	0.000725/s 2.61/h +12%
Mystic.ai	Nvidia A100 40GB	40			0.000833/s 2.9988/h -27%
Modal	Nvidia A100, 40 GB	40			0.000881/s 3.1716/h -23%
Beam.cloud	A100 GPU	40			0.000972/s 3.4992/h -15%
Mystic.ai	Nvidia A100 80GB	80			0.001111/s 3.9996/h -2%
Replicate	A100 (40GB)	40	72	10	0.00115/s 4.14/h +1%
Runpod	A100	80			0.0013/s 4.68/h +14%
Modal	Nvidia A100, 80 GB	80			0.001319/s 4.7484/h +16%
Replicate	A100 (80GB)	80	144	10	0.0014/s 5.04/h +23%
Inferless	A100	80	200	20	0.001491/s 5.3676/h +31%
Modal	Nvidia H100	80			0.001644/s 5.9184/h -20%
ModelZ.ai	AI00 40GB GPU	40	85	12	0.00194/s 6.984/h +71%
Beam.cloud	H100 GPU	80			0.001986/s 7.1496/h -3%
Runpod	H100	80			0.0025/s 9/h +22%
Replicate	8x A40 (Large)	384	680	48	0.0058/s 20.88/h

Serverless GPU Vendors

Vendor	Free Tier	True Serverless	Pricing Page	Deployment	Webhooks
Replicate	Unspecified	true	https://replicate.com/pricing	Cog SDK	Supported
Inferless	30 USD	true	https://www.inferless.com/pricing	Inferless CLI	Not supported
Runpod	Unknown	true	https://www.runpod.io/serverless-gpu	Docker	Supported
Modal	30 USD per month	true	https://modal.com/pricing	Modal SDK	Not supported
ModelZ.ai	1.41 USD	true	https://modelz.ai/pricing	Docker	Not supported
Beam.cloud	10 hours	true	https://www.beam.cloud/pricing	Beam SDK	Supported
Mystic.ai	20 USD	true	https://www.mystic.ai/pricing/serverless	Mystic SDK	Not supported
Fal.ai	Unknown	true	https://www.vultr.com/pricing/#cloud-gpu	Fal.ai SDK. Enterprise only.	Supported

Popular GPUs

Recent benchmarks

Hello GPU

hello_gpu by replicate on t4

Median20.21s

Average51.75s

Failures0

236.94s 12:05:30 AM

85.66s 7:48:49 PM

12.28s 12:01:36 AM

18.23s 12:01:47 AM

95.11s 7:49:08 PM

10.89s 12:01:46 AM

13.2s 12:02:21 AM

89.23s 7:48:48 PM

12.87s 12:01:50 AM

21.95s 12:01:53 AM

95.48s 7:48:37 PM

13.31s 12:01:34 AM

28.92s 12:01:48 AM

90.06s 7:48:42 PM

12.23s 12:02:09 AM

15.58s 12:04:57 AM

97.72s 7:48:45 PM

13.42s 12:02:18 AM

20.21s 12:02:05 AM

hello_gpu by mystic on t4

Median80.84s

Average111.5s

Failures6

100.03s 12:01:50 AM

240.84s 7:51:21 PM

100.04s 12:02:00 AM

100.08s 12:02:08 AM

254.09s 7:51:43 PM

100.03s 12:02:05 AM

44.95s 12:01:42 AM

246.24s 7:51:21 PM

12.46s 12:01:54 AM

100.06s 12:01:56 AM

251.21s 7:51:13 PM

100.05s 12:01:53 AM

9.39s 12:01:46 AM

103.23s 7:48:52 PM

52.15s 12:02:26 AM

50.59s 12:02:36 AM

113.95s 7:49:02 PM

17.18s 12:02:32 AM

58.45s 12:02:25 AM

106.21s 7:48:52 PM

hello_gpu by runpod on 16gb

Median97.76s

Average97.74s

Failures0

94.45s 7:48:54 PM

102.05s 7:49:11 PM

96.99s 7:48:52 PM

103.44s 7:48:45 PM

90.97s 7:48:42 PM

98.54s 7:48:46 PM

hello_gpu by inferless on t4

Median117.16s

Average117.13s

Failures1

106.95s 7:49:07 PM

116.25s 7:49:26 PM

131.47s 7:49:27 PM

155.76s 7:49:38 PM

111.16s 7:49:00 PM

118.86s 7:49:06 PM

118.07s 7:49:04 PM

hello_gpu by modal on t4

Median139.93s

Average140.55s

Failures0

140.96s 7:48:49 PM

157.04s 7:49:08 PM

139.49s 7:48:48 PM

133.03s 7:48:37 PM

132.44s 7:48:42 PM

140.37s 7:48:45 PM

hello_gpu by beam on t4

MedianNaNs

AverageNaNs

Failures6

85.74s 7:48:49 PM

95.25s 7:49:08 PM

89.43s 7:48:48 PM

95.61s 7:48:37 PM

90.26s 7:48:42 PM

97.78s 7:48:45 PM

Hello Torch

hello_torch by replicate on t4

Median82.89s

Average104.28s

Failures0

320.89s 12:05:30 AM

74.02s 7:48:49 PM

75.92s 12:01:36 AM

75.59s 12:01:47 AM

83.52s 7:49:08 PM

81.07s 12:01:46 AM

84.18s 12:02:21 AM

78.25s 7:48:48 PM

92.84s 12:01:50 AM

96.27s 12:01:53 AM

85s 7:48:37 PM

81.26s 12:01:34 AM

104.92s 12:01:48 AM

78.08s 7:48:42 PM

80.18s 12:02:09 AM

244.19s 12:04:57 AM

82.89s 7:48:45 PM

82.96s 12:02:18 AM

79.23s 12:02:05 AM

hello_torch by runpod on 16gb

Median101.81s

Average101.06s

Failures0

94.1s 7:48:54 PM

104.32s 7:49:14 PM

97.31s 7:48:52 PM

104.47s 7:48:46 PM

99.3s 7:48:48 PM

106.87s 7:48:54 PM

hello_torch by inferless on t4

Median113.5s

Average113.5s

Failures6

113.5s 7:49:13 PM

125.39s 7:49:35 PM

119.61s 7:49:15 PM

125.74s 7:49:07 PM

120.27s 7:49:09 PM

127.99s 7:49:16 PM

126.8s 7:49:13 PM

hello_torch by mystic on t4

Median224.02s

Average218.52s

Failures11

100.04s 12:01:50 AM

207.91s 7:50:48 PM

100.04s 12:02:00 AM

100.1s 12:02:08 AM

224.9s 7:51:14 PM

100.03s 12:02:05 AM

13.46s 12:01:42 AM

219.33s 7:50:54 PM

100.05s 12:01:54 AM

94.88s 12:01:56 AM

224.02s 7:50:46 PM

100.06s 12:01:53 AM

100.05s 12:01:46 AM

303.51s 7:52:12 PM

100.04s 12:02:26 AM

100.13s 12:02:36 AM

379.2s 7:53:27 PM

100.07s 12:02:32 AM

100.04s 12:02:25 AM

299.44s 7:52:05 PM

hello_torch by beam on t4

MedianNaNs

AverageNaNs

Failures6

85.78s 7:48:49 PM

95.2s 7:49:08 PM

89.43s 7:48:48 PM

95.59s 7:48:37 PM

90.37s 7:48:42 PM

97.78s 7:48:45 PM

hello_torch by modal on t4

Median136.09s

Average136.71s

Failures0

137.02s 7:48:49 PM

152.99s 7:49:08 PM

136.24s 7:48:48 PM

130.9s 7:48:37 PM

127.17s 7:48:42 PM

135.95s 7:48:45 PM

Serverless GPU Prices

Serverless GPU Vendors

Popular GPUs

Recent benchmarks

Hello GPU

Hello Torch