Modal
Modal is a cloud provider and development framework that combines development and deployment in Python.
RAM
0.00000667/s
0.024/h
0
CPU
2
0.000038/s
0.1368/h
0
0.000164/s
0.5904/h
0
0.000222/s
0.7992/h
0
0.000306/s
1.1016/h
0
40
0.000772/s
2.7792/h
-10%
80
0.000944/s
3.3984/h
+10%
80
0.001267/s
4.5612/h
0

Recent benchmarks

hello_tts by modal on a10g
Median131.1s
Average137.18s
Failures0
183.84s 7:49:42 PM
126.36s 7:48:54 PM
132.27s 7:48:52 PM
129.93s 7:48:51 PM
126.74s 7:48:45 PM
126.75s 7:48:49 PM
129.68s 7:49:08 PM
127.9s 7:48:48 PM
121.74s 7:48:37 PM
114.29s 7:48:42 PM
125.28s 7:48:45 PM
125.1s 7:48:43 PM
144.21s 7:49:11 PM
127.04s 7:48:51 PM
147.87s 7:49:12 PM
139.28s 7:49:00 PM
179.15s 7:49:37 PM
149.43s 7:49:16 PM
146.72s 7:49:19 PM
132.9s 7:49:00 PM
136.9s 7:49:03 PM
144.65s 7:49:09 PM
hello_torch by modal on t4
Median145.32s
Average149.67s
Failures0
194.53s 7:49:42 PM
145.32s 7:48:54 PM
143.03s 7:48:52 PM
140.88s 7:48:51 PM
137.02s 7:48:45 PM
137.02s 7:48:49 PM
152.99s 7:49:08 PM
136.24s 7:48:48 PM
130.9s 7:48:37 PM
127.17s 7:48:42 PM
135.95s 7:48:45 PM
134.01s 7:48:43 PM
158.35s 7:49:11 PM
139.5s 7:48:51 PM
160.82s 7:49:12 PM
149.52s 7:49:00 PM
188.94s 7:49:37 PM
167.19s 7:49:16 PM
162.97s 7:49:19 PM
146.05s 7:49:00 PM
154.57s 7:49:03 PM
hello_gpu by modal on t4
Median148.74s
Average153.79s
Failures0
198.3s 7:49:42 PM
148.74s 7:48:54 PM
146.54s 7:48:52 PM
145.04s 7:48:51 PM
140.39s 7:48:45 PM
140.96s 7:48:49 PM
157.04s 7:49:08 PM
139.49s 7:48:48 PM
133.03s 7:48:37 PM
132.44s 7:48:42 PM
140.37s 7:48:45 PM
137.85s 7:48:43 PM
166.31s 7:49:11 PM
144.29s 7:48:51 PM
165.05s 7:49:12 PM
152.81s 7:49:00 PM
192.53s 7:49:37 PM
170.52s 7:49:16 PM
167.63s 7:49:18 PM
151.76s 7:49:00 PM
158.48s 7:49:03 PM

About Modal

Modal.com is quite mature and offers a CLI, Python SDK and web dashboard to work with. You can deploy any function or web apps in Python on the platform, and configure them to use GPUs if you need.

The Python SDK is well designed and makes it very easy to deploy your code to the cloud, and either invoke it from another Python script or by http requests in any language.

Webhooks are not supported by the platform. There is quite good observability in the web dashboard, including logs and memory usage.

Cold start times are among the best according to our measurements, and their pricing is competitive. Modal also offers 30USD of free credits every month (as of March 2024), which is the best free tier any serverless GPU vendor has.

Their basic subscription with no fixed monthly fee allows up to 10 concurrent GPUs and up to 1000 containers deployed, while the team plan to 100USD per month scales to much more.