Meta’s new CWM model learns how code works, not just what it looks like

Meta’s AI research team has released a new large language model (LLM) for coding that enhances code understanding by learning not only what code looks like, but also what it does when executed. The model, named Code World Model (CWM), is trained on vast amounts of data showing how code interacts with its environment, allowing it to build an internal “world model” of how computational systems work.In addition to learning the dynamics of its environment, CWM shows strong performance on standard coding and math benchmarks, opening a potential new direction for training AI agents that can handle more complex, dynamic software development tasks in enterprise environments. CWM is part of a broader set of efforts to push LLMs beyond next-token prediction into developing world models.The lim [...]