T4
T4 is a low-tier modern processor. It has 16GB of GPU RAM and is a good economic choice for inference on small and medium models.
Hero Image

T4 Serverless GPU Prices

16
0.000111/s
0.3996/h
-42%
16
0.00015/s
0.54/h
-21%
0.000164/s
0.5904/h
-14%
16203
0.000185/s
0.666/h
-3%
1684
0.000225/s
0.81/h
+18%
16164
0.00031/s
1.116/h
+62%

T4 Serverless GPU Vendors

VendorFree TierTrue ServerlessPricing PageDeploymentWebhooks
ReplicateUnspecifiedtruehttps://replicate.com/pricingCog SDKSupported
Inferless30 USDtruehttps://www.inferless.com/pricingInferless CLINot supported
Modal30 USD per monthtruehttps://modal.com/pricingModal SDKNot supported
ModelZ.ai1.41 USDtruehttps://modelz.ai/pricingDockerNot supported
Beam.cloud10 hourstruehttps://www.beam.cloud/pricingBeam SDKSupported
Mystic.ai20 USDtruehttps://www.mystic.ai/pricing/serverlessMystic SDKNot supported

Recent benchmarks for T4

hello_gpu by replicate on t4
Median20.85s
Average44.98s
Failures0
37.42s 12:01:26 AM
17.31s 12:01:48 AM
65.29s 12:02:27 AM
11.35s 12:01:52 AM
12.35s 12:01:57 AM
24.01s 12:02:37 AM
142.7s 7:49:42 PM
13.18s 12:02:05 AM
20.57s 12:02:10 AM
13.46s 12:03:53 AM
114.63s 12:04:37 AM
91.68s 7:48:54 PM
20.85s 12:02:48 AM
hello_torch by mystic on t4
Median71.68s
Average136.52s
Failures10
100.1s 12:01:45 AM
100.07s 12:02:08 AM
100.06s 12:02:39 AM
100.05s 12:02:04 AM
71.68s 12:02:15 AM
44.14s 12:02:41 AM
293.75s 7:52:13 PM
100.07s 12:02:15 AM
100.08s 12:02:15 AM
100.08s 12:01:49 AM
100.07s 12:02:13 AM
391.9s 7:53:54 PM
100.04s 12:01:53 AM
hello_gpu by mystic on t4
Median84.45s
Average130.86s
Failures9
100.08s 12:01:45 AM
100.06s 12:02:08 AM
100.05s 12:02:39 AM
100.04s 12:02:04 AM
100.05s 12:02:15 AM
100.06s 12:02:41 AM
150.64s 7:49:50 PM
100.05s 12:02:15 AM
100.08s 12:02:15 AM
14.12s 12:01:49 AM
100.07s 12:02:13 AM
340.41s 7:53:02 PM
18.25s 12:01:53 AM
hello_torch by replicate on t4
Median89.87s
Average116.86s
Failures0
80.6s 12:01:26 AM
77.8s 12:01:48 AM
87.9s 12:02:27 AM
85.39s 12:01:52 AM
82.3s 12:01:57 AM
95.89s 12:02:37 AM
118.41s 7:49:42 PM
89.87s 12:02:05 AM
95.66s 12:02:10 AM
227.53s 12:03:53 AM
246.83s 12:04:37 AM
76.33s 7:48:54 PM
154.69s 12:02:48 AM
hello_torch by inferless on t4
Median112.76s
Average112.76s
Failures1
143.1s 7:49:43 PM
112.76s 7:49:14 PM
hello_gpu by inferless on t4
Median112.8s
Average112.8s
Failures1
143.11s 7:49:43 PM
112.8s 7:49:14 PM
hello_torch by modal on t4
Median169.92s
Average169.92s
Failures0
194.53s 7:49:42 PM
145.32s 7:48:54 PM
hello_gpu by modal on t4
Median173.52s
Average173.52s
Failures0
198.3s 7:49:42 PM
148.74s 7:48:54 PM
hello_torch by beam on t4
MedianNaNs
AverageNaNs
Failures2
142.87s 7:49:42 PM
91.8s 7:48:54 PM
hello_gpu by beam on t4
MedianNaNs
AverageNaNs
Failures2
142.81s 7:49:42 PM
91.82s 7:48:54 PM