Inferless
Inferless is a new serverless GPU provider that is in a private beta as of March 2024.

Inferless Serverless GPU Prices

16203
0.000185/s
0.666/h
0
24307
0.000341/s
1.2276/h
0
8020020
0.001491/s
5.3676/h
0

Recent benchmarks

hello_gpu by inferless on t4
Median120.78s
Average125.85s
Failures5
143.11s 7:49:43 PM
112.8s 7:49:14 PM
166.95s 7:49:52 PM
137.78s 7:49:34 PM
117.24s 7:49:06 PM
106.95s 7:49:07 PM
116.25s 7:49:26 PM
131.47s 7:49:27 PM
155.76s 7:49:38 PM
111.16s 7:49:00 PM
118.86s 7:49:06 PM
118.07s 7:49:04 PM
109.87s 7:49:23 PM
154.94s 7:49:52 PM
124.82s 7:49:24 PM
121.9s 7:49:18 PM
134.66s 7:49:58 PM
130.39s 7:49:37 PM
122.42s 7:49:24 PM
120.78s 7:49:19 PM
112.7s 7:49:24 PM
114.7s 7:49:20 PM
117.93s 7:50:16 PM
159.22s 7:50:00 PM
166.85s 7:50:02 PM
138.1s 7:53:02 PM
147.5s 7:49:39 PM
129.12s 7:49:26 PM
140.22s 7:49:47 PM
116.01s 7:49:05 PM
120.28s 7:49:19 PM
174.15s 7:50:42 PM
hello_torch by inferless on t4
Median130.03s
Average133.7s
Failures22
143.1s 7:49:43 PM
112.76s 7:49:14 PM
136.94s 7:49:22 PM
125.87s 7:49:21 PM
126.27s 7:49:15 PM
113.5s 7:49:13 PM
125.39s 7:49:35 PM
119.61s 7:49:15 PM
125.74s 7:49:07 PM
120.27s 7:49:09 PM
127.99s 7:49:16 PM
126.8s 7:49:13 PM
127.73s 7:49:41 PM
124.95s 7:49:22 PM
141.96s 7:49:41 PM
128.28s 7:49:25 PM
131.78s 7:49:55 PM
139.53s 7:49:46 PM
140.98s 7:49:43 PM
128.22s 7:49:26 PM
121.5s 7:49:33 PM
133.25s 7:49:39 PM
127.09s 7:50:25 PM
178.38s 7:50:19 PM
182.99s 7:50:18 PM
149.16s 7:53:13 PM
114.33s 7:49:05 PM
138.29s 7:49:35 PM
140.46s 7:49:47 PM
135.62s 7:49:24 PM
135.56s 7:49:35 PM
144.13s 7:50:12 PM