Supervised Fine-tuning Trainer
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
https://huggingface.co/docs/trl/sft_trainer#multi-gpu-training
Efficient Training on Multiple GPUs
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
https://huggingface.co/docs/transformers/perf_train_gpu_many#scalability-strategy
Train with a script
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
https://huggingface.co/docs/transformers/run_scripts#distributed-training-and-mixed-precision

Seonglae Cho