“We were looking at it wrong”: The explosive claim that’s upended the AI world

Key points

• Cammarata’s claim is that LLMs might in fact be far easier to understand—and thus to monitor and control—than people previously thought.1
• After a summer filled with revelations that swarms of agents built by top firms like OpenAI and Anthropic have been breaking their containment and causing havoc on the public internet—often while those companies weren’t aware of what their agents were up to—the AI industry is desperate to get a better handle on the technology it has built.1
• Researchers like to say today’s AI is grown like a garden, not built like a bridge.1
• Looking at other models appeared to back this up.1

Sources (1)

• [1]“We were looking at it wrong”: The explosive claim that’s upended the AI world
  MIT Technology Review (AI) · Oct 19, 05:45 PM

  “I think I have good news about the nature of neural networks.” With those simple words of optimism, Nick Cammarata, a researcher at the AI startup Goodfire, kicked off a 26,000-word blog post that has knocked the AI world on its head, sparking wild speculation as well as cautious (and not-so-cautious) celebration.

  Cammarata’s claim is that LLMs might in fact be far easier to understand—and thus to monitor and control—than people previously thought.

Extractive summary: sentences quoted from the sources.