2026-10-28 · America/Los_Angeles · 行业新闻 · #6

Sleep framework: A new way for LLMs to retain knowledge in continual learning

We introduce a sleep phase in continual learning, enabling large language models to continuously integrate new facts and enhance reasoning while mitigating catastrophic forgetting or static knowledge cutoffs. Modern LLMs achieve impressive performance via pre-training and in-context learning (ICL). However, once deployed, they remain largely static, operating with a fixed knowledge cutoff date that leaves them unable to acquire long-term capabilities or adapt to new information. While updating models with new data seems like the obvious solution, continual parameter updates often trigger catas

热度 47.0 / 100；排名与评分保留该期记录。