Supported Regions and models for batch inference - Amazon Bedrock

Supported Regions and models for batch inference

The following list provides links to general information about regional and model support in Amazon Bedrock:

Model US East (N. Virginia) US West (Oregon) Asia Pacific (Tokyo) Asia Pacific (Seoul) Asia Pacific (Mumbai) Asia Pacific (Singapore) Asia Pacific (Sydney) Canada (Central) Europe (Frankfurt) Europe (Ireland) Europe (London) Europe (Paris) South America (São Paulo)
Amazon Nova Lite Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No
Amazon Nova Micro Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No
Amazon Nova Pro Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No
Amazon Titan Multimodal Embeddings G1 Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Orange triangular warning sign with an exclamation mark in the center. Gated Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes
Amazon Titan Text Embeddings V2 Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes
Anthropic Claude 3.5 Haiku Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No
Anthropic Claude 3.5 Sonnet Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Orange triangular warning sign with an exclamation mark in the center. Gated Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No
Anthropic Claude 3.5 Sonnet v2 Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No
Anthropic Claude 3 Haiku Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Orange triangular warning sign with an exclamation mark in the center. Gated Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Orange triangular warning sign with an exclamation mark in the center. Gated Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes
Anthropic Claude 3 Opus Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No
Anthropic Claude 3 Sonnet Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Orange triangular warning sign with an exclamation mark in the center. Gated Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes
Meta Llama 3.1 405B Instruct Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No
Meta Llama 3.1 70B Instruct Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No
Meta Llama 3.1 8B Instruct Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No
Meta Llama 3.2 11B Instruct Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No
Meta Llama 3.2 1B Instruct Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No
Meta Llama 3.2 3B Instruct Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No
Meta Llama 3.2 90B Instruct Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No
Meta Llama 3.3 70B Instruct Green circular icon with a white checkmark symbol inside. Yes Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No
Mistral AI Mistral Large (24.07) Red circular icon with an X symbol, indicating cancellation or denial. No Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No
Mistral AI Mistral Small (24.02) Green circular icon with a white checkmark symbol inside. Yes Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No Red circular icon with an X symbol, indicating cancellation or denial. No

Batch inference also supports the use of inference profiles. Some models are only supported through cross-region inference in some Regions. For more information about the cross-region inference profiles that you can use, see Supported cross-region inference profiles. For more information about setting up your own application inference profile, see Create an application inference profile.

Note

You can't use batch inference with Anthropic Claude 3 Haiku inference profiles.