Pricing Tiers

Pay-as-you-go

For individual developers and hobbyists

No platform fee

$50 free credits at signup

Platform, Web UI, and SDK

Slack Community

All pre-trained models

Scale

For teams with large monthly data processing or generation needs

$300/month platform fee

$250 free credits per month

Monthly

Annual

Scale

For teams with large monthly data processing or generation needs

$300/month platform fee

$250 free credits per month

Monthly

Annual

Scale

For teams with large monthly data processing or generation needs

$300/month platform fee

$250 free credits per month

Monthly

Annual

Everything in Pay-as-you-go and…

24-hour email support SLA

External Integrations (HuggingFace)

Enterprise

For organizations with highly custom needs

Custom platform fee

Custom credits per month

Everything in Team and…

Custom support packages

Custom Integrations

Compare Features

Pay-as-you-go

Scale

Enterprise

Jobs

Input Tokens / Job

250 Million

1 Billion

Custom Quotas

Tokens / Day

2 Billion

20 Billion

Custom Quotas

Custom Models

All pre-trained models

10

Unlimited

All pre-trained models

p0 Jobs (prototyping)

p1 Jobs (1 hour)

p2 Jobs (30 mins)

p3 Jobs (20 mins)

Custom Acceleration

Data

Data retention

Up to 90 days

Up to 180 days

Unlimited Retention

Our managed cloud

Bring your own s3-compatible bucket

Custom data residency

Up to 90 days

Up to 180 days

Bring your own cloud

Our managed cloud

Our managed cloud

Pay-as-you-go

Scale

Enterprise

Jobs

Models

All pre-trained models

Job Types
(concurrency, speed)

p0 (prototyping), p1 (1 hour)

Job Quotas (scale)

Up to 250m input tokens/job 2 Billion tokens/day

Data

Data Retention

Up to 90 days

Data Residency

Our managed storage

Compute Residency

Our managed cloud

Pay-as-you-go

Scale

Enterprise

Jobs

Models

All pre-trained models

Job Types
(concurrency, speed)

p0 (prototyping), p1 (1 hour)

Job Quotas (scale)

Up to 250m input tokens/job 2 Billion tokens/day

Data

Data Retention

Up to 90 days

Data Residency

Our managed storage

Compute Residency

Our managed cloud

Available Models

We select frontier open-source models that are very adept at typical batch inference tasks. If you need help finding the right model for you task, please reach out to team@sutro.sh and we would be happy to help.

Text and Vision Models

Model ID

Avg. Cost / 1m tokens

Context Window

$0.02

131,072

$0.03

131,072

$0.28

131,072

$0.03

262,144

$0.06

32,768

$0.15

32,768

$0.04

262,144

$0.35

131,072

$0.03

131,072

$0.07

131,072

$0.15

131,072

$0.03

131,072

$0.08

131,072

Reasoning Models

Model ID

Avg. Cost / 1m tokens

Context Window

Embedding Models

Model ID

Avg. Cost / 1m tokens

Context Window

Custom Models

We also offer support for custom and fine-tuned models on a per-request basis. To discuss such needs, please reach out at team@sutro.sh.

Notes

  1. We serve quantized versions for some of the models we offer. This is done to pass on further time and cost savings to users, however if you have a workload that could benefit from full precision inference - we'd like to learn more - please reach out to team@sutro.sh.

  2. Average token prices are based on blended input and output costs, weighted according to representative batch inference workload shapes. Actual pricing will depend on total usage. We encourage users to estimate costs ahead of job submission using the dry run functionality described in the documentation. For questions on pricing, please reach out to team@sutro.sh.

What Will You Scale with Sutro?