2025-07-20
New ARC-AGI-3 benchmark shows that humans still outperform LLMs at pretty basic thinking
ARC-AGI-3 aims to test how well AI systems can handle brand new problems. While people breeze through the challenges, the latest AI models still come up short.
The article New ARC-AGI-3 benchmark shows that humans still outperform LLMs at pretty basic thinking appeared first on THE DECODER.
[...]Rating
Innovation
Pricing
Technology
Usability
We have discovered similar tools to what you are looking for. Check out our suggestions for similar AI tools.
2025-10-08
Samsung AI researcher's new, open reasoning model TRM outperforms models 10,000X larger — on specific problems
The trend of AI researchers developing new, small open source generative models that outperform far larger, proprietary peers continued this week with yet another staggering advancement.Alexia Jolicoe [...]
2025-08-07
Grok 4 edges out GPT-5 in complex reasoning benchmark ARC-AGI
In the ARC-AGI-2 benchmark, which is designed to measure a language model's general reasoning skills, GPT-5 (High) scored 9.9 percent at a cost of $0.73 per task, according to ARC Prize.<br /& [...]
2025-10-09
Tiny AI model outperforms o3‑mini and Gemini 2.5 Pro in ARC‑AGI benchmark
A new mini-model called TRM shows that recursive reasoning with tiny networks can outperform large language models on tasks like Sudoku and the ARC-AGI test - using only a fraction of the compute powe [...]
2025-03-26
OpenAI's top models crash from 75% to just 4% on challenging new ARC-AGI-2 test
The new AI benchmark ARC-AGI-2 significantly raises the bar for AI tests. While humans can easily solve the tasks, even highly developed AI systems such as OpenAI o3 clearly fail.<br /> The arti [...]
2025-05-13
OpenAI says its latest models outperform doctors in medical benchmark
OpenAI has released a new benchmark for testing AI systems in healthcare. Called HealthBench, it's designed to evaluate how well language models handle realistic medical conversations. According [...]
2025-05-27
The Browser Company stops active development of Arc in favor of new AI-focused product
The Browser Company has stopped active development of the popular Arc web browser, according to a blog post from CEO Josh Miller. There will still be updates to fix security issues and the like, but t [...]
2025-10-01
Thinking Machines' first official product is here: meet Tinker, an API for distributed LLM fine-tuning
Thinking Machines, the AI startup founded earlier this year by former OpenAI CTO Mira Murati, has launched its first product: Tinker, a Python-based API designed to make large language model (LLM) fin [...]