METR introduces a new metric to calculate exactly when AI agents become more expensive than humans
METR's new metric, the "expenditure horizon," puts a dollar figure on how cost-effective AI agents are at solving problems. Early results on the NanoGPT speedrun are underwhelming, the metric has blind spots, and the newest generation of models could change the picture.<br /> The article METR introduces a new metric to calculate exactly when AI agents become more expensive than humans appeared first on The Decoder. [...]
Rating
Innovation
Pricing
Technology
Usability
We have discovered similar tools to what you are looking for. Check out our suggestions for similar AI tools.
Anthropic vs. OpenAI red teaming methods reveal different security priorities for enterprise AI
Model providers want to prove the security and robustness of their models, releasing system cards and conducting red-team exercises with each new release. But it can be difficult for enterprises to pa [...]
After Hugging Face incident, METR urges independent root-cause investigations into AI agent misbehavior
Research organization METR is calling for systematic, independently led investigations whenever AI agents act autonomously against their developers' intentions. The push comes partly in response [...]
Upwork study shows AI agents excel with human partners but fail independently
Artificial intelligence agents powered by the world's most advanced language models routinely fail to complete even straightforward professional tasks on their own, according to groundbreaking re [...]
Microsoft says ungoverned AI agents could become corporate 'double agents.' Its fix costs $99 a month.
Microsoft today announced the general availability of Agent 365 and Microsoft 365 Enterprise 7, two products designed to bring security and governance to the rapidly growing population of AI agents op [...]
From human clicks to machine intent: Preparing the web for agentic AI
For three decades, the web has been designed with one audience in mind: People. Pages are optimized for human eyes, clicks and intuition. But as AI-driven agents begin to browse on our behalf, the hum [...]
As enterprises confront AI agent sprawl, xpander wants them to own their own control and context layer
Enterprise AI has a new infrastructure problem: companies are accumulating agents faster than they are developing systems to govern them.Gartner estimates that the average global Fortune 500 company w [...]
OpenAI unveils Workspace Agents, a successor to custom GPTs for enterprises that can plug directly into Slack, Salesforce and more
OpenAI introduced a new paradigm and product today that is likely to have huge implications for enterprises seeking to adopt and control fleets of AI agent workers.Called "Workspace Agents," [...]
Four AI agents coordinating in real time outperformed Claude Opus 4.8 on enterprise coding tasks
As enterprise codebases grow, AI agents tasked with analyzing them are buckling under the weight of long-horizon tasks that require multiple interactions and tool calls. Dividing the work among a team [...]