Embeddings are arrays of floating point numbers that represent the semantic meaning of a piece of content
Parameters are
- Multi-lingual
- Context window size - max passage size
- Model size - computing resource
- embedding vector length - storage resource
Sentence embedding Notion
Sentence embedding Methods
What is embedding
Leaderboard
OpenAI embedding, AWS or commercial embedding has much larger context window like 8192