Episodic Memory LLM

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2025 Nov 27 23:0
Editor
Edited
Edited
2025 Nov 27 23:2
Refs
Refs
  1. Event Segmentation
      • Calculate how "surprised" the LLM is at the next token (Bayesian Surprise)
      • Set points of high surprise as event boundaries → divide context into natural event units
  1. Boundary Refinement
      • Ensure segmented events are internally similar and distinct from each other
      • Adjust boundaries using graph-based metrics (modularity/conductance)
  1. Memory Retrieval
      • (1) Similarity-based k-NN event retrieval
      • (2) Temporal contiguity-based retrieval
        • → Mimics human memory recall patterns (sequential replay of adjacent items)
  1. LLM Input Construction
      • Local context + initial tokens + retrieved events (similarity/contiguity)
 
 
 
 
 
 
 

Recommendations