Amazon has launched Nova Sonic, a generative AI model designed for superior voice processing and natural-sounding speech ...

Amazon claims that Sonic’s performance is competitive with frontier voice models from OpenAI and Google on benchmarks ... stilted by comparison. Nova Sonic is available through Bedrock, Amazon ...

Maverick quickly secured the number-two spot on LMArena, the AI benchmark site where humans compare ... above OpenAI’s 4o and just under Gemini 2.5 Pro. (A higher ELO score means the model ...

The State of Evaluation study marks the first time that both open and closed-source models have been evaluated against an expanded suite of benchmarks, revealing leaders and laggards in model ...

A discrepancy between first- and third-party benchmark results for OpenAI's o3 AI model is raising questions about the ...

Benchmark performance results typically accompany the launch of every new AI model to showcase how well the models can ...

OpenAI, like many AI labs, thinks AI benchmarks are broken. It says it wants to fix them through a new program. Called the OpenAI Pioneers Program, the program will focus on creating evaluations ...

OpenAI thinks AI benchmarks are ... helping teams assess model performance in practical, high-stakes environments." As the recent controversy with the crowdsourced benchmark LM Arena and Meta's ...

These models scored almost zero similarity to OpenAI — 99.3% and 100% "no-agreement" respectively — indicating independent training. Mistral's Mixtral model has some similarities, but DeepSeek ...