Amazon Web Services · Cross-Region Inference Routing
Cross-Region inference routing in Amazon SageMaker AI
Amazon SageMaker AI now offers cross-Region inference routing through a new inference router resource, giving applications one invocation path across real-time endpoints, inference components and asynchronous endpoints in one or more Regions and accounts. The router keeps requests in its local Region while that destination is healthy, shifts new requests to other registered destinations based on a health score, and retries a real-time request once on another destination only when the model did not run. The router does not create capacity, scale endpoints or copy model artefacts, so each destination must already be running in its Region.
Open the source ↗Similar Developer Tools releases
- Together Storage Accelerator
Together AI · Storage Caching Layer · Week 48, 2026
- SageMaker AI inference endpoint monitoring
Amazon Web Services · Endpoint Drift Monitoring · Week 48, 2026
- AgentCore payments for AWS Marketplace x402 products
Amazon Web Services · Agent Marketplace Payments · Week 48, 2026
- NVIDIA Dynamo RL rollout serving
NVIDIA (Amr Elmeleegy, Harry Kim, Kyle Kranen) · RL Rollout Serving · Week 48, 2026
- NVIDIA DAQIRI
NVIDIA · GPU Data Acquisition · Week 48, 2026
- Perplexity Orchestrator API
Perplexity · Model Gateway API · Week 48, 2026
More from Amazon Web Services
- SageMaker AI inference endpoint monitoring
Amazon Web Services · Endpoint Drift Monitoring · Week 48, 2026
- AgentCore payments for AWS Marketplace x402 products
Amazon Web Services · Agent Marketplace Payments · Week 48, 2026
- Amazon Bedrock AgentCore harness with Strands harness defaults
Amazon Web Services · Managed agent harness · Week 48, 2026
- Amazon SageMaker JumpStart Model Leaderboard
Amazon Web Services · Model Leaderboard · Week 48, 2026
- Workload recovery and infrastructure checks on Amazon SageMaker HyperPod
Amazon Web Services · Training Health Checks · Week 48, 2026
- Custom metadata schemas in AWS Agent Registry
Amazon Web Services · Agent Registry Metadata · Week 48, 2026
Published by Quanta AI Labs, an AI agency in India. Browse every week in AI News Weekly.