Texonom
Texonom
/
Engineering
Engineering
/Data Engineering/Artificial Intelligence/AI Industry/AI Scaling/
Model Merging
Search

Model Merging

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2024 Mar 30 17:30
Editor
Editor
Seonglae ChoSeonglae Cho
Edited
Edited
2024 May 2 15:20
Refs
Refs
Combining multiple pretrained models into one model, giving it the combined abilities of each individual model without any additional training
Model Merging Notion
Model Stacking
Model Blending
Weighted Averaging
Mergekit
 
 
 
Model Merging Usages
TIES
DARE
Model soups
SLERP
Task Arithmetic
 
 
 
 
Merge Large Language Models with mergekit
A Blog post by Maxime Labonne on Hugging Face
Merge Large Language Models with mergekit
https://huggingface.co/blog/mlabonne/merge-models
Merge Large Language Models with mergekit
Model merging
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Model merging
https://huggingface.co/docs/peft/developer_guides/model_merging
Model merging
 
 
 

Backlinks

Artificial IntelligenceAI TermTransformer ModelingFine Tuning

Recommendations

Texonom
Texonom
/
Engineering
Engineering
/Data Engineering/Artificial Intelligence/AI Industry/AI Scaling/
Model Merging
Copyright Seonglae Cho