Mixed Precision

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2023 Aug 20 15:13
Editor
Edited
Edited
2024 Nov 18 15:15

Overflow errors can be more common

Type Casting 되는 것이 빠른 연산(Linear Layer, Conv Layer)을 변환해서 연산을 수행
Mixed Precision Notion
 
 
Mixed Precision Tools
 
 
 
 

Recommendations