Seonglae Cho- device map
if you just want distributed memory
PartialState
Distributed inference with multiple GPUs
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
https://huggingface.co/docs/diffusers/training/distributed_inference
Handling big models for inference
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
https://huggingface.co/docs/accelerate/usage_guides/big_modeling
