Find high attention pair using locality-sensitive hashing (LSH)
Configured so that closer data has similar hash values
꼼꼼하고 이해하기 쉬운 Reformer 리뷰
Review of Reformer: The Efficient Transformer
https://tech.scatterlab.co.kr/reformer-review/
LSH Attention
Creator
Creator
Seonglae ChoCreated
Created
2024 Mar 2 7:10Editor
Editor
Seonglae ChoEdited
Edited
2025 Feb 10 11:5Refs