Weight-Space Programming: The Third Lever for LLMs
Gradient descent was never sacred. It was scaffolding — the only general-purpose tool we had for shaping billions of numbers no human could read, so we built...
All articles tagged with “machine learning”
13 articlesGradient descent was never sacred. It was scaffolding — the only general-purpose tool we had for shaping billions of numbers no human could read, so we built...
Spend ten minutes reading blog posts written since late 2023 and you'll feel it: a creeping sense that everything was written by the same slightly overeager...
When Genie 4's demos landed, my first reaction was the same one I've had since Sora: this is a very good video generator, why are we calling it a world model?...
Somewhere between the second and third coffee, a lot of complexity theorists recently read a sentence they never expected to read: a deterministic algorithm...
Here's an opinion I defended badly at a team lunch last year and have since come to believe even more strongly: if your mental model of a reasoning model is "a...
A dermatologist recently put 200 biopsy-proven skin lesions in front of two frontier LLMs and a fine-tuned copy of Inception v3, a convolutional network Google...
I spent two years building voice assistants on the classic stack: speech-to-text in, language model in the middle, text-to-speech out. Every latency...
Here's a claim that would have gotten me laughed out of any forecasting team five years ago: for most time-series problems, training a model on your own data...
Here's an uncomfortable truth about LLM agents: most of the tokens they produce are expensive filler. A reasoning agent solving a math problem will happily...
A friend of mine runs operations at a mid-sized logistics company, and last spring her team spent three weeks evaluating whether an LLM could take over their...
Here's a cheap trick that's quietly useful: if you only care about the first token an LLM would emit, you can ask it a multiple-choice question and get the...
The most common error message in machine learning isn't a Python traceback or a shape mismatch. It's CUDA out of memory. Your model is too big, your batch size...
K-means is the algorithm everyone learns in their intro ML course and then uses incorrectly for the rest of their career. It's deceptively simple: pick K...