2026-10-15 · America/Los_Angeles · 论文 · #16

Cortex: Consolidating Context into Parametric Memory

Context can improve large language model performance, but these gains may be lost after context removal. Inspired by biological systems consolidation, we formulate Memory Consolidation (MC) as internalizing these gains while preserving non-target capabilities, connecting context-specified editing, skill learning, and behavioral steering under a common objective. We introduce a five-task-family testbed measuring consolidation and retention under single, batch, and sequential updates. We propose Cortex, which generates prospective queries to anticipate uses of context and distills…

热度 49.1 / 100；排名与评分保留该期记录。