AWS Machine Learning · Agent Eval Framework

UAEF (Universal Agent Evaluation Framework)

AWS has introduced UAEF, a framework-agnostic system for evaluating AI agents. Adapters convert traces from LangGraph, LangChain, Strands Agents and Amazon Bedrock AgentCore into one canonical format, which is scored with 36 built-in metrics across 7 dimensions, including tool calling, response quality, responsible AI and multi-turn conversation. Results are stored in Amazon DynamoDB and Amazon S3, and the framework compares agent versions to detect regressions. The post says 12 organisations used it and links runnable notebooks for each supported framework; licence is not stated.