Texonom
Texonom
/
Engineering
Engineering
/Data Engineering/Artificial Intelligence/AI Development/AI Framework/Pytorch/
TorchTune
Search

TorchTune

Creator
Creator
Seonglae Cho
Created
Created
2024 Apr 18 4:46
Editor
Editor
Seonglae Cho
Edited
Edited
2024 Apr 18 17:0
Refs
Refs
torchtune
pytorch • Updated 2024 Apr 18 16:54
Model Training Tool

Config based training (
Declarative Programming
)

  • FSDP
  • LoRA
    ,
    QLoRA
  • DPO
 
 
 
 
 

Config templates

torchtune/recipes/configs at main · pytorch/torchtune
A Native-PyTorch Library for LLM Fine-tuning. Contribute to pytorch/torchtune development by creating an account on GitHub.
torchtune/recipes/configs at main · pytorch/torchtune
https://github.com/pytorch/torchtune/tree/main/recipes/configs
torchtune/recipes/configs at main · pytorch/torchtune
 
 

Recommendations

Texonom
Texonom
/
Engineering
Engineering
/Data Engineering/Artificial Intelligence/AI Development/AI Framework/Pytorch/
TorchTune
Copyright Seonglae Cho