Huggingface accelerate.Accelerator

from accelerate import Accelerator

accelerator = Accelerator()
model, optimizer, train_dataloader, lr_scheduler = accelerator.prepare(
    model, optimizer, train_dataloader, lr_scheduler
)

prepare()

Quick tour

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

https://huggingface.co/docs/accelerate/quicktour