by: maxaravind

Author here.<p>I spent the last weekend thinking about continual learning. A lot of people think that we can solve long term memory and learning in LLMs by simply extending the context length to infinity. I analyse a different perspective that challenges this assumption.<p>Let me know how you think about this.

4/19/2026, 12:30:10 PM