bedrock provisioned throughput · checked october 2026

Bedrock Provisioned Throughput: what it buys, when you need it, and when it pays off.

Provisioned Throughput reserves capacity for one Bedrock model, measured in model units, at a fixed hourly price. You choose no commitment, 1 month or 6 months; longer terms cost less per hour. You must buy it to run a customized model. On a base model it only beats on-demand at steady, high volume.

billing unit
model unit per hour
terms
none, 1 month, 6 months
required for
customized models
billing stops
when you delete it
TL;DR
  • Provisioned Throughput (PT) buys a fixed level of throughput for one model at a fixed hourly price per model unit (MU). An MU covers a set number of input and output tokens per minute for that model. AWS sends you to your account manager for the exact MU figures.
  • You pick a term: no commitment (delete any time), 1 month or 6 months (you cannot delete before the term ends). Longer terms cost less per hour. Billing runs every hour until you delete the PT, used or not. If you customized a model, AWS says you must buy PT to use it.
  • On a base model, PT is cheaper than on-demand only above a break-even volume, which you can work out from your token logs. Below that, stay on on-demand. If a partner builds and sizes the workload, the partner can file POC or IW funding when it qualifies and AWS approves.
the concept

IWhat Provisioned Throughput is

On-demand bills per token. Provisioned Throughput bills per hour for reserved capacity.

With on-demand inference you pay for each input and output token, and your throughput is limited by shared account quotas. With Provisioned Throughput you buy a number of model units for one specific model. Each MU gives a set number of input tokens and output tokens per minute, across all requests. You pay a fixed price per MU per hour, whatever you actually use.

The hourly price depends on three things: the model (a customized model costs the same as the base model it came from), the number of MUs, and the term. After you buy it, you get a provisioned model ARN and call that instead of the base model ID.

the trade-off

IIOn-demand vs Provisioned Throughput

The choice is usage pricing and shared limits vs capacity pricing and reserved throughput.

on-demand vs provisioned throughput
On-demandProvisioned Throughput
How you payPer input and output tokenPer model unit per hour
Cost when idleNothingFull hourly price
ThroughputShared account quotas; you can be throttledReserved for your model
CommitmentNoneNone, 1 month or 6 months
Customized modelsNot usable this wayRequired
FitsVariable, low or unknown traffic; prototypesSteady high volume; customized models; paths that must not throttle
Batch inference (50% below on-demand for select models, per the pricing page) and prompt caching are often cheaper ways to cut on-demand cost before committing.
when it is not optional

IIIWhen you must use Provisioned Throughput

One case is a rule. One is a judgment call.

  • Customized models: AWS's PT page says: "If you customized a model, you must purchase Provisioned Throughput to be able to use it." That covers fine-tuned and distilled models. Budget the hosting before you start a fine-tune; see Bedrock fine-tuning and model distillation.
  • Paths that cannot be throttled: Even on a base model, a checkout flow or a real-time agent under an SLA may need reserved throughput. First check whether a quota increase or cross-Region inference solves it; see Bedrock quotas.
pricing

IVPricing: model units and the three terms

Longer commitments cost less per hour and lock you in.

  • No commitment: Highest hourly price. Delete any time. Good for testing a customized model or covering a short spike.
  • 1 month: Lower hourly price. You cannot delete the PT until the month ends.
  • 6 months: Lowest hourly price. You cannot delete it until the six months end. Only for a stable model and proven volume.

An AWS example shows the shape (pricing page, checked 10 October 2026): for Cohere Command, $49.50 per MU per hour with no commitment, $39.60 on a 1-month term and $23.77 on a 6-month term. Another example: one MU of a Llama 2 model on a 1-month term at $21.18 per hour comes to $15,757.92 for a 31-day month. Rates differ by model, so check the pricing page for yours.

the math

VThe break-even against on-demand

PT wins on a base model only above a certain monthly token volume. Work it out from your own logs.

  • 1. Price the PT per month: Hourly price per MU, times the number of MUs, times the hours in the month (about 730). It is the same whether you use it or not.
  • 2. Price your traffic on-demand: Take a month of input and output tokens from your logs and multiply by the model's on-demand rates.
  • 3. Compare: If step 2 is higher than step 1, and stays higher, PT saves money. If not, stay on on-demand.
  • 4. Check capacity: Make sure the MUs you price can carry your peak tokens per minute. Your account manager can give the MU figures.

Two common mistakes: sizing from average traffic (so peaks still throttle) and forgetting that idle nights and weekends are billed. Utilization is the whole game. If your traffic is spiky or still growing, PT on a base model is usually the wrong call.

operations

VIHow to buy and manage Provisioned Throughput

A short checklist.

  • Pick the model: A base model, or your customized model. Throughput is reserved for that one model.
  • Pick the term and the number of MUs: Size from measured peak tokens per minute. Ask your account manager about MU figures and limit increases.
  • Buy it and switch the model ID: Call the provisioned model ARN instead of the base model ID in your inference calls.
  • Watch utilization: Track invocations and token throughput in Amazon CloudWatch. Low use means you over-bought.
  • Delete it when you are done: Billing continues until you delete the PT. A forgotten no-commitment PT is a silent hourly charge. For committed terms, check whether auto-renew is on.
paying for the build

VIIWho can file AWS funding for a Bedrock build

There are two kinds of AWS money for a Bedrock build. A partner files one. You apply for the other yourself.

Partner-filed funding. An AWS consulting partner can file POC (proof of concept) funding to test a Bedrock workload, whether or not you run on AWS today. If you already run on AWS and are adding new AI work, the partner can file incremental workload (IW) funding instead. For startups this is often $50K to $150K. Depends on the workload; AWS approves. The work has to be real, and the partner has to be the one doing it.

AWS Activate, which you apply for yourself. Activate Founders gives $1,000 to start, up to $5,000, with no investor needed. Activate Portfolio gives up to $200,000 if your VC, accelerator or angel group is an Activate Provider and gives you its Org ID. A consulting partner cannot apply for Activate on your behalf. AWS made Activate credits usable for third-party models on Bedrock in April 2024. Note that AWS promotional credits do not pay upfront fees for Savings Plans or Reserved Instances; check the credit terms for any commitment you plan.

For most startups without a VC, the partner route is the larger of the two. CloudRoute matches you with one vetted AWS partner for free. Partners pay CloudRoute a monthly membership plus 10% of AWS-approved funding.

Who files it
FundingWho files itAmountWhen it fits
Proof of concept (POC) fundingYour matched AWS partner$50K to $150K for startups. Depends on the workload; AWS approves.You want to test something, whether or not you are on AWS today.
Incremental workload (IW) fundingYour matched AWS partner$50K to $150K for startups. Depends on the workload; AWS approves.You are already on AWS and are launching new work: a new AI feature, a new customer or a new contract.
AWS Activate FoundersFounder applies$1,000 to start, up to $5,000Self-funded startups with no investor or accelerator behind them.
AWS Activate PortfolioFounder appliesup to $200,000Startups backed by a VC firm, accelerator or angel investor that is an AWS Activate Provider.
AWS Credits for AI StartupsInvite only (AWS account manager)$200,000 or more, by invitationAI startups ready to scale after Activate Portfolio, invited by AWS.
Facts checked on October 10, 2026. AWS decides every application.
before you commit
A vetted AWS partner can size the capacity, build the workload and file POC or IW funding when it qualifies.
Get matched free with a vetted AWS partner who can file it
how a match works

How a match works (example)

  1. You tell us about the work

    You fill in a short form: what you run today, what you want to move, test or build, your stage and your region.

  2. We pick one partner

    We read your answers and pick one vetted AWS consulting partner that fits the work, the stack and the region. We reply within 24 hours; your matched partner reaches out within 5 business days.

  3. The partner checks POC funding

    Your matched partner scopes the test with you. Then it checks whether the test qualifies for POC (proof of concept) funding. A POC can fit whether or not you run on AWS today.

  4. The partner files, AWS decides

    If the work qualifies, the partner files the funding request with AWS. AWS reviews it and decides. The amount depends on the workload.

  5. You pay nothing

    CloudRoute is free for startups. Partners pay CloudRoute a monthly membership plus 10% of AWS-approved funding.

AWS Activate credits are separate, and you apply for them yourself. Use Activate Founders if no investor backs you. Use Activate Portfolio with the Org ID or invite from your VC, accelerator, incubator or angel group if it is an Activate Provider. A consulting partner cannot apply for Activate on your behalf.

faq

Common questions

What is Amazon Bedrock Provisioned Throughput?
Reserved capacity for one Bedrock model, bought in model units at a fixed hourly price per unit. It gives a set throughput for that model and is billed every hour until you delete it, whether you use it or not.
What is a model unit in Bedrock Provisioned Throughput?
A model unit (MU) covers a set number of input tokens and output tokens per minute for a specific model, across all requests. The figures differ by model; AWS says to contact your account manager for what an MU specifies and for limit increases.
Is Provisioned Throughput required for fine-tuned models?
Yes. AWS's Provisioned Throughput page says that if you customized a model, you must purchase Provisioned Throughput to use it. Plan for that hourly cost before you fine-tune or distill.
What commitment terms does Provisioned Throughput offer?
No commitment (delete any time), 1 month and 6 months. You cannot delete a committed PT before its term ends. The longer the term, the lower the hourly price.
How much does Provisioned Throughput cost?
It depends on the model, the number of MUs and the term. In an AWS pricing page example (checked 10 October 2026), Cohere Command cost $49.50 per MU per hour with no commitment, $39.60 on 1 month and $23.77 on 6 months. Check the pricing page for your model.
When should I use Provisioned Throughput instead of on-demand?
When you run a customized model, when a path must not be throttled and quotas or cross-Region inference will not fix it, or when your steady monthly token volume costs more on-demand than the PT would. For variable, low or growing traffic, stay on on-demand.
Can AWS funding pay for a Bedrock build?
If a partner builds the workload, the partner can file POC funding to test it, or incremental workload (IW) funding if you already run on AWS. For startups this is often $50K to $150K. Depends on the workload; AWS approves. Separately, you can apply for AWS Activate yourself. CloudRoute matches you with a partner for free.

Get a partner who can build it and file the funding

Tell us what you are building on Bedrock. We match you with one vetted AWS partner. If the work qualifies, the partner files POC funding for a test, or incremental workload (IW) funding for new work on AWS: often $50K to $150K for startups. Depends on the workload; AWS approves. CloudRoute is free for startups.