2026-06-07
Small language models fail at rare tasks because frequent ones constantly overwrite what they've learned. A new study with models ranging from 4 million to 4 billion parameters shows this mechanism in detail and offers a practical fix: instead of scaling up models, it may be enough to increase how often the target task appears in the training data.<br /> The article Researchers pinpoint [...]
2026-06-07
Clive Chan, by his own account the second hardware employee in OpenAI's custom chip program, is moving to Anthropic. He brings experience from Tesla's Autopilot ASIC and the OpenAI-Broadcom partnership. The move comes as both companies prepare for their IPOs, and Anthropic is reportedly considering developing its own AI chips.<br /> The article Anthropic poaches OpenAI's secon [...]