Google's Nested Learning paper proposes HOPE, an architecture aiming at continual learning without catastrophic forgetting.
Models are trained once on massive datasets, then deployed as fixed systems. Once training ends they essentially stop learning and are frozen in time. They adapt within a conversation through in-context learning, but that learning is not persistent; once the context is gone, the model reverts to its original state.
HOPE is a new model architecture introduced in Google's paper Nested Learning: The Illusion of Deep Learning Architecture. The authors' claim is ambitious: it could rival transformers while enabling true continual learning without catastrophic forgetting. It is built on a new learning paradigm called nested learning, inspired by the human brain.
It is the phenomenon where attempts to keep updating a trained model cause new learning to overwrite what the model already knew. The paper compares this limitation to anterograde amnesia, a condition where a person can no longer form new long-term memories while existing memories remain intact.
The Continuum Memory System assigns different update frequencies to each module, so knowledge does not change everywhere at once. This multi-frequency design creates a safety net: if one module loses a piece of information, it still exists in other modules that haven't updated yet, allowing that information to propagate back and be recovered.
Unlike a static transformer layer, a neural learning module behaves like a miniature student: it treats incoming information as a context flow it must learn to compress and internalize, solving its own local optimization problem. It acts as an associative memory, memorizing the relationship between the data and its local objective by updating its own weights.
Each module has its own objective, a mathematical goal describing what to learn from the context flow; its own learning rate, deciding how aggressively that part of memory changes; and its own update frequency, how often it updates weights per n tokens. In traditional deep learning these choices are global.
It is the sequence of neural learning modules that follows the self-modifying Titans in a HOPE layer. In practice these are feed forward networks operating at different update frequencies, with data handled first by fast updating modules and progressively passed to slower ones. In HOPE it replaces the transformer's feed forward network.
The Titan block has two pathways. The retrieval path projects the input token into a query using WQ, which passes through a memory module built as a two-layer MLP and retrieves the relevant information as the output. The self-modification path updates the memory itself, and even learns its own optimizer.
On language modeling and common sense reasoning benchmarks, HOPE achieves the best average performance compared to all baselines at both 760 million and 1.3 billion parameters, showing the architectural changes do not cost general language ability. It also outperforms existing continual learning approaches across multiple benchmarks.
The paper highlights two characteristics. The first is neuroplasticity, the brain's capacity to change itself in response to new experiences, memories, learning and even damage, with regions repurposed or reorganized when needed. The second is brain oscillations, where faster waves support rapid adaptation and slower waves drive long-term memory consolidation.
“What if the biggest limitation of today's AI isn't intelligence, but memory?”
“In other words, the models only experience the immediate present.”
“It could rival transformers while enabling true continual learning without catastrophic forgetting.”
“But in the nested learning paradigm, a neural learning module is more like a miniature student.”
“As we'll see later, a single layer in Hope isn't just one student, but a small classroom of them working together.”
“This multi-frequency design creates a safety net for knowledge.”
“The End of Frozen LLMs? (Google’s Hope Explained).” https://www.youtube.com/watch?v=VTQR9n3aqNU. Transcript summary by WhipScribe, https://whipscribe.com/transcript-pages/the-end-of-frozen-llms-googles-hope-explained.html.