Weight-Space Programming: The Third Lever for LLMs
Gradient descent was never sacred. It was scaffolding — the only general-purpose tool we had for shaping billions of numbers no human could read, so we built...
neural networks
All articles tagged with “neural networks”
3 articles
Mechanistic Interpretability Myths Put to the Test
For years, the conventional wisdom in mechanistic interpretability was grim: neural networks are tangled knots, and before you can understand one you first...
Beyond Self-Attention: What Comes After Transformers
The transformer architecture has been running AI for eight years now. Every major language model, most image generation systems, and an increasing number of...