2025-05-01
Popular AI benchmark LMArena allegedly favors large providers, study claims
Researchers say the ranking system favors major providers like OpenAI, Google, and Meta. LMArena disputes the claims.
The article Popular AI benchmark LMArena allegedly favors large providers, study claims appeared first on THE DECODER.
[...]Rating
Innovation
Pricing
Technology
Usability
We have discovered similar tools to what you are looking for. Check out our suggestions for similar AI tools.
2025-10-31
How an Oregon court became the stage for a $115,000 showdown between Meta and Facebook creators
Some of the most successful creators on Facebook aren't names you'd ever recognize. In fact, many of their pages don't have a face or recognizable persona attached. Instead, they run pa [...]
2025-12-10
The 70% factuality ceiling: why Google’s new ‘FACTS’ benchmark is a wake-up call for enterprise AI
There's no shortage of generative AI benchmarks designed to measure the performance and accuracy of a given model on completing various helpful enterprise tasks — from coding to instruction fol [...]
2025-12-16
Zoom says it aced AI’s hardest exam. Critics say it copied off its neighbors.
Zoom Video Communications, the company best known for keeping remote workers connected during the pandemic, announced last week that it had achieved the highest score ever recorded on one of artificia [...]
2025-12-01
OpenAGI emerges from stealth with an AI agent that it claims crushes OpenAI and Anthropic
A stealth artificial intelligence startup founded by an MIT researcher emerged this morning with an ambitious claim: its new AI model can control computers better than systems built by OpenAI and Anth [...]
2025-11-20
Grok 4.1 Fast's compelling dev access and Agent Tools API overshadowed by Musk glazing
Elon Musk's frontier generative AI startup xAI formally opened developer access to its Grok 4.1 Fast models last night and introduced a new Agent Tools API—but the technical milestones were imm [...]
2025-11-07
Terminal-Bench 2.0 launches alongside Harbor, a new framework for testing agents in containers
The developers of Terminal-Bench, a benchmark suite for evaluating the performance of autonomous AI agents on real-world terminal-based tasks, have released version 2.0 alongside Harbor, a new framewo [...]
2025-11-12
Baidu just dropped an open-source multimodal AI that it claims beats GPT-5 and Gemini
Baidu Inc., China's largest search engine company, released a new artificial intelligence model on Monday that its developers claim outperforms competitors from Google and OpenAI on several visio [...]
2025-12-09
Databricks' OfficeQA uncovers disconnect: AI agents ace abstract tests but stall at 45% on enterprise docs
There is no shortage of AI benchmarks in the market today, with popular options like Humanity's Last Exam (HLE), ARC-AGI-2 and GDPval, among numerous others.AI agents excel at solving abstract ma [...]
2025-04-18
Here are the coolest cars at New York International Auto Show 2025
This year marks the 125th anniversary of the New York International Auto Show (NYIAS), and despite concerns over tariffs, there are still a lot of manufacturers here showing off new models including a [...]