Long-Context Retrieval Models
80M parameter max 32768 tokens
Long-Context Retrieval Models with Monarch Mixer
https://hazyresearch.stanford.edu/blog/2024-01-11-m2-bert-retrieval

togethercomputer/m2-bert-80M-32k-retrieval · Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
https://huggingface.co/togethercomputer/m2-bert-80M-32k-retrieval

Seonglae Cho