Documentation Index
Fetch the complete documentation index at: https://backstage.spotify.com/docs/llms.txt
Use this file to discover all available pages before exploring further.
Overview
Amazon Bedrock provides both LLM capabilities and advanced re-ranking models that can be used to improve the relevance of generated content and reduce inconsistencies from document indexing.Important: Model Compatibility Requirements
Before configuring any Bedrock model in AI Gateway, verify these requirements:- On-Demand Throughput Support - Not all models support this mode
- Regional Availability - Model must be available in your AWS region
- Access Permissions - You must have granted access in AWS Console
Step-by-Step Bedrock Setup
1. Check Model Compatibility
Navigate to AWS Console → Amazon Bedrock → Model access Look for these indicators:- “On-demand throughput: Supported”
- Available in your current AWS region
- Access status shows “Available to request” or “Access granted”
2. Request Model Access
- Click “Modify model access”
- Select your desired models
- Click “Request model access”
- Wait for approval (can take minutes to hours)
- Verify “Access granted” status appears
3. Recommended Models (Verified Compatible)
These models are confirmed to work with on-demand throughput: Language Models:Configuration
To use Amazon Bedrock, configure it in the Plugin settings page under theAI Gateway section:
| Field | Description | Example |
|---|---|---|
| Region | AWS region for Bedrock | us-east-1 |
| Access Key ID | Your AWS access key ID | your-access-key-id |
| Secret Access Key | Your AWS secret access key | your-secret-access-key |
| Session Token | Optional, if using temporary credentials | your-session-token |
| Base URL | Optional, to point at a gateway | https://ai-gateway.example.com/bedrock |
| Headers | Optional, e.g. for authentication with gateway | Key: X-Custom-HeaderValue: custom-value |
For Language Models
Set the default language model:For Re-ranking
Optionally configure Bedrock for re-ranking:Common Error Messages & Solutions
Error:Invocation of model ID [model] with on-demand throughput isn't supported
Cause: This model doesn’t support on-demand throughput
Solution: Choose a different model from our recommended list above
Error: You don't have access to the model with the specified model ID
Cause: Model access not granted in AWS Bedrock console
Solution:
- Go to AWS Console → Bedrock → Model access
- Click “Modify model access”
- Select the model and request access
- Wait for approval confirmation
Model capacity exceeded or 429 errors
Cause: The model has reached its managed capacity limit
Solution:
- Wait a few minutes and retry
- Switch to a different model temporarily
- Consider provisioned throughput for high-volume usage
Testing Your Configuration
After setup, test your configuration with a simple request to verify everything works before production use.Regional Availability Notes
Model availability varies by AWS region. If you encounter regional errors:- Check the AWS Bedrock User Guide for model availability by region
- Consider switching to a region where your desired model is available
- Update your AWS credentials/configuration accordingly