AI benchmarks have a trust problem and Google wants to fix it
Google Deepmind is testing a double-blind evaluation of a frontier AI model for the first time. Cryptographic protection through Confidential Space is meant to keep Google from seeing the test questions and keep evaluators from seeing the model weights. The pilot project with the Singapore AI Safety Institute uses a Gemini Flash Lite and could set a new standard for tamper-proof AI benchmarks.<br /> The article AI benchmarks have a trust problem and Google wants to fix it appeared first on The Decoder. [...]
Rating
Innovation
Pricing
Technology
Usability
We have discovered similar tools to what you are looking for. Check out our suggestions for similar AI tools.
Agentic reliability and evaluations : Enterprises that got burned by a bad eval are the most likely to remove humans from the loop, not the least
Across 108 enterprises, trust in automated agent evaluation rose sharply in July — and the failure rate it is supposed to predict did not move at all. The share of organizations that fully trust aut [...]
Salesforce Research: Across the C-suite, trust is the key to scaling agentic AI
Presented by SalesforceIn 2025, Salesforce conducted a series of C-suite research studies to capture if and how top decision-makers are building an agentic AI strategy. While the research shows positi [...]
The agent evaluation gap: Enterprise AI organizations have a reality-alignment problem, not a coverage problem — and most are shipping to production anyway
Across 157 enterprises, organizations are granting AI agents more autonomy while trusting the evaluations meant to gate that autonomy less. Half have already shipped an agent that passed their interna [...]
Private Internet Access VPN review: Both more and less than a budget VPN
I came into this review thinking of Private Internet Access (PIA) as one of the better VPNs. It's in the Kape Technologies portfolio, along with the top-tier ExpressVPN and the generally reliable [...]
Google’s new AI agent can draft your emails, monitor your inbox and eventually spend your money
Google on Tuesday unveiled Gemini Spark, a personal AI agent designed to work around the clock — drafting emails, assembling documents, monitoring inboxes, and eventually making purchases — even w [...]
AI IQ is here: a new site scores frontier AI models on the human IQ scale. The results are already dividing tech.
For decades, the IQ test has been one of the most familiar — and most contested — yardsticks for human intelligence. Now, a startup project called AI IQ is applying the same metaphor to artificial [...]
43% of AI-generated code changes need debugging in production, survey finds
The software industry is racing to write code with artificial intelligence. It is struggling, badly, to make sure that code holds up once it ships.A survey of 200 senior site-reliability and DevOps le [...]