T4
T4 is a low-tier modern processor. It has 16GB of GPU RAM and is a good economic choice for inference on small and medium models.
Hero Image

T4 Serverless GPU Prices

16
0.000111/s
0.3996/h
-42%
16
0.00015/s
0.54/h
-21%
0.000164/s
0.5904/h
-14%
16203
0.000185/s
0.666/h
-3%
1684
0.000225/s
0.81/h
+18%
16164
0.00031/s
1.116/h
+62%

T4 Serverless GPU Vendors

VendorFree TierTrue ServerlessPricing PageDeploymentWebhooks
ReplicateUnspecifiedtruehttps://replicate.com/pricingCog SDKSupported
Inferless30 USDtruehttps://www.inferless.com/pricingInferless CLINot supported
Modal30 USD per monthtruehttps://modal.com/pricingModal SDKNot supported
ModelZ.ai1.41 USDtruehttps://modelz.ai/pricingDockerNot supported
Beam.cloud10 hourstruehttps://www.beam.cloud/pricingBeam SDKSupported
Mystic.ai20 USDtruehttps://www.mystic.ai/pricing/serverlessMystic SDKNot supported

Recent benchmarks for T4

hello_gpu by replicate on t4
Median16.44s
Average24.03s
Failures0
13.21s 12:01:51 AM
14s 12:02:01 AM
14.54s 12:02:05 AM
35.69s 12:04:50 AM
29.13s 12:01:49 AM
26.02s 12:02:02 AM
14.5s 12:01:55 AM
15.36s 12:02:03 AM
15.73s 12:02:14 AM
11.28s 12:02:11 AM
30.56s 12:02:22 AM
68.56s 12:03:02 AM
17.15s 12:02:23 AM
14.72s 12:01:49 AM
33.64s 12:03:52 AM
30.41s 12:01:30 AM
hello_torch by replicate on t4
Median98.65s
Average115.44s
Failures0
94.54s 12:01:51 AM
86.49s 12:02:01 AM
81.81s 12:02:05 AM
254.74s 12:04:50 AM
109.18s 12:01:49 AM
95.44s 12:02:02 AM
95.42s 12:01:55 AM
101.86s 12:02:03 AM
101.96s 12:02:14 AM
81.28s 12:02:11 AM
114.58s 12:02:22 AM
132.44s 12:03:02 AM
124.22s 12:02:23 AM
89.45s 12:01:49 AM
201.82s 12:03:52 AM
81.79s 12:01:30 AM
hello_gpu by mystic on t4
MedianNaNs
AverageNaNs
Failures16
0.03s 12:00:20 AM
0.03s 12:00:37 AM
0.12s 12:00:44 AM
0.07s 12:00:36 AM
0.09s 12:00:03 AM
0.12s 12:00:27 AM
0.18s 12:00:20 AM
0.11s 12:00:21 AM
100.08s 12:02:13 AM
100.04s 12:02:30 AM
100.19s 12:02:07 AM
100.04s 12:02:29 AM
100.04s 12:01:59 AM
100.09s 12:01:59 AM
100.04s 12:02:10 AM
100.11s 12:01:48 AM
hello_torch by mystic on t4
MedianNaNs
AverageNaNs
Failures16
0.03s 12:00:20 AM
0.03s 12:00:37 AM
0.12s 12:00:44 AM
0.07s 12:00:36 AM
0.08s 12:00:03 AM
0.12s 12:00:27 AM
0.17s 12:00:20 AM
0.11s 12:00:21 AM
100.08s 12:02:13 AM
100.05s 12:02:30 AM
100.14s 12:02:07 AM
100.04s 12:02:29 AM
100.04s 12:01:59 AM
100.08s 12:01:59 AM
100.04s 12:02:10 AM
100.1s 12:01:48 AM