One AWS API for foundation models from many providers, with no servers to run and your data kept in your AWS account. What Bedrock is, the model catalog, access and the Converse API, real prices, AgentCore and the feature suite, security, and when to pick SageMaker instead. Facts checked on aws.amazon.com on 10 October 2026.
Amazon Bedrock is a managed AWS service that gives you foundation models from many providers through a single API, with no infrastructure to run. You send a prompt, get a response, and pay for the tokens.
Before Bedrock, a team that wanted a large language model in production had two hard options. Rent GPUs, download open weights and run the serving stack yourself, or send your data to a single model vendor's API. Bedrock removes both problems. AWS runs the inference fleet behind the API. And your prompts and outputs are not used to train the base models, are not shared with the model providers, and stay in your AWS account and the Region you call.
The second reason is choice without lock-in. No single model is best at everything, and through the Converse API, switching models is often a one-line change to a model ID.
The third reason is that Bedrock is an application platform, not just a model gateway. AWS adds managed building blocks that most teams would otherwise build themselves: Agents, Knowledge Bases for RAG, Guardrails, fine-tuning and distillation, Flows, Prompt Management, model evaluation, and AgentCore for running agents in production. Section V covers each.
Amazon Bedrock is one managed API for many foundation models, with serverless inference, AWS-native security, and built-in tools for RAG, agents, guardrails and customization. You never touch a GPU, and your data is not used to train the base models.
Breadth is Bedrock's defining feature. On 10 October 2026 the <a href="https://aws.amazon.com/bedrock/pricing/">Bedrock pricing page</a> listed models from 19 providers: AI21 Labs, Amazon, Anthropic, Cohere, DeepSeek, Google, Luma AI, Meta, MiniMax AI, Mistral AI, Moonshot AI, NVIDIA, OpenAI, Qwen, Stability AI, TwelveLabs, Writer, xAI and Z AI. Versions and Regions change often, so confirm the live list in the Bedrock console.
A few patterns help before reading the table. Anthropic's Claude family is the most widely used set of models on Bedrock for reasoning, coding and agent work, in tiers that trade cost against capability. Amazon's Nova family covers low-cost text and multimodal models (Micro, Lite, Pro, Premier), the newer Nova 2 generation (Nova 2 Lite, with Nova 2 Pro and Omni in preview), images (Canvas), video (Reel) and speech (Sonic). Open-weight models from Meta, Mistral, DeepSeek, Qwen and others can be compared side by side without self-hosting. Embedding models from Amazon and Cohere power retrieval.
You do not have to pick one provider for a whole application. A common pattern sends cheap, high-volume calls (classification, extraction, routing) to a small model such as Nova Micro, Nova Lite or Claude Haiku, and escalates only the hard reasoning steps to a frontier model. All of it runs through the same Converse API and lands on one bill.
| Provider | Representative models | Modality | Best-fit use |
|---|---|---|---|
| Anthropic | Claude Opus, Claude Sonnet, Claude Haiku | Text, chat, vision, tools | Frontier reasoning, coding, agents, long-context analysis |
| Amazon Nova | Micro, Lite, Pro, Premier; Nova 2 Lite; Canvas; Reel; Sonic | Text, image, video, speech | Lowest cost and latency; image, video and voice |
| Amazon Titan | Titan Text Embeddings V2; Titan Multimodal Embeddings | Embeddings | Embeddings for RAG and search |
| Meta | Llama (instruct and smaller variants) | Text, chat, vision | Open weights you can fine-tune |
| Mistral AI | Mistral Large and smaller models | Text, chat | Fast, low-cost high-throughput tasks |
| Cohere | Command, Embed, Rerank | Text, embeddings, rerank | Enterprise search, retrieval, reranking |
| Stability AI | Stable Diffusion and Stable Image | Image generation | Marketing, product and creative imagery |
| DeepSeek, Qwen, AI21 Labs | Reasoning and long-context models | Text, reasoning | Low-cost open reasoning; long context |
| More providers | OpenAI, Google, Moonshot AI, MiniMax AI, NVIDIA, Writer, xAI, Z AI, Luma AI, TwelveLabs | Varies by model | Check each model's modality and Region in the console |
Getting to a first call is short. Access to many models is on by default, IAM controls who can call what, you pick a Region, and you call models with the Converse API.
AWS now enables access to many Bedrock models by default, as long as your IAM role has the right AWS Marketplace permissions. The first call to a third-party model starts its Marketplace subscription in the background. Anthropic models also need a one-time use-case form per account. Some models need extra account-level access (AWS model access guide, checked 10 October 2026).
Grant roles actions such as bedrock:InvokeModel and bedrock:Converse, scoped to specific model ARNs; CloudTrail logs the calls. Pick a Region for data residency, latency and model availability. When you hit capacity limits, cross-region inference profiles can serve a request from several Regions in one geography.
InvokeModel is the original, lower-level API: you send a provider-specific JSON body and parse a provider-specific response. The Converse API is the recommended path: one request and response schema across chat models, with multi-turn conversations, system prompts, tool use and streaming. With Converse, switching models is usually just a new modelId. Use InvokeModel for image or embedding endpoints, or for a provider-specific parameter Converse does not expose.
A minimal Converse call in Python (boto3) looks like this:
import boto3
brt = boto3.client("bedrock-runtime", region_name="us-east-1")
resp = brt.converse(
modelId="anthropic.claude-sonnet", # swap this string to switch models
messages=[{"role": "user", "content": [{"text": "Summarize our refund policy in 3 bullets."}]}],
inferenceConfig={"maxTokens": 512, "temperature": 0.2},
)
print(resp["output"]["message"]["content"][0]["text"])
The same call works for Claude, Llama, Mistral, Nova, Cohere and more: only modelId changes. Model IDs shown are illustrative; copy the exact IDs from the Bedrock console.
Bedrock has no platform fee and no minimum. You pay for what you run, through a few levers. The table shows list prices for Amazon's own models, checked on the AWS pricing page on 10 October 2026.
On-demand is the default: a price per million input tokens and per million output tokens, set per model, with no commitment. Output costs several times more than input. Image and video models bill per image or per second of video. AWS also offers service tiers (Standard, Flex, Priority and Reserved) that trade price against latency and capacity.
Batch processes large sets of prompts asynchronously at a 50% lower price than on-demand for supported models. For offline work (overnight document processing, bulk classification, embedding a corpus), batch should be the default.
Provisioned Throughput reserves model capacity by the hour, with discounts for 1-month and 6-month commitments. It gives steady throughput and is needed to serve some custom models. It only pays off at high, steady volume.
Prompt caching stores repeated context (a long system prompt, a document, tool definitions) so you do not pay full input price to process it again on every call. For Nova 2 models, AWS prices cache reads at 75% less than on-demand input. Expect extra charges for model customization and for services around the model, such as the vector store behind a Knowledge Base.
| Model | Input / 1M tokens | Output / 1M tokens | Typical role |
|---|---|---|---|
| Amazon Nova Micro | $0.035 | $0.14 | High-volume classification and routing |
| Amazon Nova Lite | $0.06 | $0.24 | Cheap multimodal chat and extraction |
| Amazon Nova 2 Lite | $0.33 | $2.75 | Low-cost reasoning, 1M-token context |
| Amazon Nova Pro | $0.80 | $3.20 | Balanced multimodal work |
| Amazon Nova Premier | $2.50 | $12.50 | Hardest Nova tasks; distillation teacher |
| Titan Text Embeddings V2 | $0.02 | n/a (vectors) | RAG and semantic search |
Teams standardize on Bedrock rather than a bare model API because of the managed layer around the models. Each feature below would otherwise be a project of its own.
These pieces compose. A typical production assistant uses a Knowledge Base for grounding, wraps the model in Guardrails, takes actions through an Agent or AgentCore, keeps its prompts in Prompt Management, and was chosen with model evaluation, all under one IAM and billing boundary.
For most companies the deciding factor in favor of Bedrock is governance, not a benchmark. Bedrock is designed so that adopting generative AI does not mean loosening your data controls.
Your data is yours. Prompts, responses and anything you send to Bedrock are not used to train the base models and are not shared with the model providers. Content is encrypted in transit and at rest, you can use your own KMS keys, and a request is processed in the Region you call. Cross-region inference stays inside a defined geography, such as EU Regions for an EU profile.
It plugs into your existing controls. Reach Bedrock privately from your VPC through PrivateLink, govern access with IAM, record every call in CloudTrail, and log full payloads for audit. Bedrock is in AWS's main compliance programs (such as SOC, ISO 27001, HIPAA eligibility and PCI DSS, depending on Region); confirm scope for your Region in AWS Artifact. This is the most common reason teams pick Bedrock over sending sensitive data to a public model endpoint.
Bedrock is not the only way to run AI on AWS, and it is not always the right one. The rule comes down to how much of the ML stack you want to own and how much data governance matters.
Bedrock answers "I want existing foundation models through a managed, secure API with the least operations." Amazon SageMaker answers "I need to own the ML lifecycle: my own model or architecture, custom training, control of serving, or classical ML." A vendor's API directly answers "I want this vendor's newest model the moment it ships, and my data can leave AWS."
They work together: Bedrock for the generative AI layer, SageMaker for a custom forecasting or vision model, in one account. Details on Bedrock vs SageMaker and Bedrock vs OpenAI.
| Dimension | Amazon Bedrock | Amazon SageMaker | Direct vendor API |
|---|---|---|---|
| Best for | Using foundation models in apps, fast | Owning the full ML lifecycle or custom models | One vendor's newest model, day one |
| Infra you manage | None (serverless) | You configure training and endpoints | None (vendor-hosted) |
| Model choice | 19 providers, one API | Any model you bring or build | That one vendor only |
| Data governance | Stays in your AWS account and Region | Stays in your AWS account and Region | Leaves AWS to the vendor |
| Custom or classical ML | Fine-tune foundation models only | Full: any architecture, any ML | No |
| Paid with AWS credits | Yes | Yes | No |
A first Bedrock application takes a day, not a quarter. The harder problem is the bill once the application is real and traffic grows.
The fast path: pick one workhorse model and one embeddings model in your Region, attach an IAM policy scoped to those model ARNs, make a first Converse call, then point a Knowledge Base at a folder of documents in S3 if you need grounding, and wrap it in a Guardrail. You now have a grounded, governed assistant without a single GPU.
Then the cost arrives: generative AI is cheap per call and expensive in aggregate. The levers from section IV keep it in check: route easy calls to small models, run offline work as batch, turn on prompt caching, and reserve capacity only once volume is steady. See Bedrock pricing, prompt caching and batch inference.
Bedrock usage is AWS spend, so AWS credits pay it. AWS made Activate credits usable for third-party models on Bedrock, Claude included, in April 2024 (AWS announcement). Activate Founders ($1,000 to start, up to $5,000): Apply yourself at aws.amazon.com/startups/credits. No investor, accelerator or partner needed. Activate Portfolio (up to $200,000): Apply yourself with the Org ID (or an invite) from your AWS Activate Provider. Apply within 12 months of your latest funding date. A consulting partner cannot file it.
Credits from Anthropic are a separate pool. Anthropic says Claude for Startups credits work only on its own Claude API, not on Bedrock. More on Anthropic startup credits and who qualifies.
For most startups the larger route is partner-filed funding. A vetted AWS partner can file POC (proof of concept) funding to test a Bedrock build, or incremental workload (IW) funding when you already run on AWS and launch a new AI feature. For startups that is $50K to $150K. Depends on the workload; AWS approves.
| Funding | Who files it | Amount | When it fits |
|---|---|---|---|
| Migration Acceleration Program (MAP) | Your matched AWS partner | $50K to $150K for startups. Depends on the workload; AWS approves. | You are not on AWS yet and want to migrate. |
| Proof of concept (POC) funding | Your matched AWS partner | $50K to $150K for startups. Depends on the workload; AWS approves. | You want to test something, whether or not you are on AWS today. |
| Incremental workload (IW) funding | Your matched AWS partner | $50K to $150K for startups. Depends on the workload; AWS approves. | You are already on AWS and are launching new work: a new AI feature, a new customer or a new contract. |
| AWS Activate Founders | Founder applies | $1,000 to start, up to $5,000 | Self-funded startups with no investor or accelerator behind them. |
| AWS Activate Portfolio | Founder applies | up to $200,000 | Startups backed by a VC firm, accelerator or angel investor that is an AWS Activate Provider. |
| AWS Credits for AI Startups | Invite only (AWS account manager) | $200,000 or more, by invitation | AI startups ready to scale after Activate Portfolio, invited by AWS. |
CloudRoute matches you with a vetted AWS partner who can build the Bedrock workload with you and file POC or IW funding when the work qualifies. Startups pay CloudRoute nothing; partners pay CloudRoute a monthly membership plus 10% of AWS-approved funding. More on the funding: Amazon Bedrock credits, AWS POC funding explained and AWS credits for AI startups.
You fill in a short form: what you run today, what you want to move, test or build, your stage and your region.
We read your answers and pick one vetted AWS consulting partner that fits the work, the stack and the region. We reply within 24 hours; your matched partner reaches out within 5 business days.
Your matched partner scopes the test with you. Then it checks whether the test qualifies for POC (proof of concept) funding. A POC can fit whether or not you run on AWS today.
If the work qualifies, the partner files the funding request with AWS. AWS reviews it and decides. The amount depends on the workload.
CloudRoute is free for startups. Partners pay CloudRoute a monthly membership plus 10% of AWS-approved funding.
AWS Activate credits are separate, and you apply for them yourself. Use Activate Founders if no investor backs you. Use Activate Portfolio with the Org ID or invite from your VC, accelerator, incubator or angel group if it is an Activate Provider. A consulting partner cannot apply for Activate on your behalf.
CloudRoute matches you with a vetted AWS partner who can build the Bedrock workload with you. When the work qualifies, the partner files POC or incremental workload (IW) funding: $50K to $150K for startups. Depends on the workload; AWS approves. You apply for AWS Activate credits yourself. CloudRoute is free for startups.