Temporally applying LoRA is a good candidateForward Forward Algorithm without a whole memory holding is also supportive Geoffrey Hinton: Using Fast Weights to Store Temporary MemoriesSpeaker: Geoffrey Hinton, U Torontohttps://www.youtube.com/watch?v=GLmptInTNSw