Seonglae ChoRecurrent Transformer
Weight Sharing with LoRA variants
Recursive Transformer Methods
Universal Transformers
Recurrent neural networks (RNNs) sequentially process data by updating their state with each new data point, and have long been the de facto choice for sequence modeling tasks. However, their...
https://arxiv.org/abs/1807.03819
