Recursive Self-Improvement
What happens when an AI gets good at making AI better? The feedback loop that could turn steady progress into a sudden takeoff.
The library
Each story takes a single idea behind the arrival of AGI and makes it genuinely understandable.
What happens when an AI gets good at making AI better? The feedback loop that could turn steady progress into a sudden takeoff.
Reverse-engineering the circuits inside a neural network, neuron by neuron, to read what a model actually computes.
Why bigger models, more data and more compute keep paying off on a startlingly smooth curve, and where that curve might bend.
Getting a powerful optimizer to want what we want turns out to be far harder than telling it what to do.
Almost any goal, pursued hard enough, rewards the same sub-goals: gather resources, stay switched on, resist being changed.
How human thumbs-up and thumbs-down get distilled into a reward model that quietly shapes a chatbot's personality.
When the model you trained grows its own optimizer inside, chasing a proxy goal that only looked like yours during training.
Decades of AI research keep relearning one humbling truth: general methods that scale with computation beat clever hand-built knowledge.
Evaluations, compute thresholds, safety cases, international coordination: the policy toolkit taking shape around the most capable models.