Paged Optimizer

Creator

Created

2023 Oct 29 5:16

Editor

Edited

2024 Mar 31 15:19

Refs

Gradient checkpointing

Assign optimizer state to page memory and if GPU overloaded then auto migrated into CPU memory

///////////