Anthropic LLM models
Learn more about Anthropic LLM models and how to connect your AWS Bedrock account to access Anthropic models
Anthropic’s Claude LLM models are focused on safe, reliable, and ethical AI responses. They are often better at reasoning and ‘thoughtful’ tasks.
Setting Up AWS Bedrock with Relevance
Relevance supports two secure methods for connecting your AWS Bedrock account to access Anthropic models. Choose the option that best fits your organization’s security requirements.
Key Benefits
Cross-Region Inference: Relevance automatically distributes requests across AWS regions to ensure consistent service availability and performance, even during high-demand periods.
Usage Oversight: Both setup methods provide access to all supported Anthropic Claude models available in your selected AWS regions. You will be able to have increased cost control and insight into model usage.
Option 1: IAM Credentials (Quick Setup)
Best for: Testing, proof-of-concepts, and organizations with flexible security policies.
Prerequisites
- AWS account with Anthropic models enabled in Bedrock
- Administrative access to create IAM users and policies
Setup Steps
1. Create IAM Policy
In your AWS console, create a new policy with these permissions:
2. Create IAM user
- Create a new IAM user in your AWS account
- Attach the policy created in step 1
- Generate access keys for this user
3. Configure Relevance
In your Relevance dashboard:
- Navigate to Integrations & App Keys → AWS Bedrock
- Enter your credentials:
- Access Key ID
- Secret Access Key
- Region (your preferred AWS region)
- Select your desired Claude model
Option 2: Role Assumption (Enterprise Security)
Best for: Enterprise organisations requiring enhanced security, short-lived credentials, and detailed usage tracking.
Prerequisites
- Enterprise Relevance plan
- AWS account with Anthropic models enabled in Bedrock
- Administrative access to create IAM roles and policies
1. Contact your account team
Reach out to your Relevance Account Executive to initiate the role assumption setup. They will coordinate with our implementation team to exchange the necessary account details.
2. Create AWS role
Create an IAM role in your AWS account with this trust policy:
3. Create and attach permissions policy
Create a policy with Bedrock permissions and attach it to your role:
4. Configure Relevance
In your Relevance dashboard:
- Navigate to Integrations → AWS Bedrock
- Enter your configuration:
- Region (your preferred AWS region)
- Role ARN (the ARN of the role you created)
If you run into any issues with either of these options, please reach out to your Account Executive or our support team.
Important considerations
Multi-Region Support
For optimal performance and availability, ensure your AWS policies include permissions for multiple regions. Use *
in the region field or explicitly list all regions where you want Bedrock access.
Model Availability
Different Claude models are available in different AWS regions. Verify model availability in your chosen region using the AWS Bedrock documentation.
Security Precedence
If both IAM credentials and role ARN are configured, Relevance will automatically use the more secure role assumption method.