Model Souping

A technique that averages the weights of multiple differently-trained models into one. Each model's strengths overlap and remain, while weaknesses cancel out. Particularly effective for embedding models where "global representation quality" is important.