Non-saturating nonlinearity

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2024 Sep 12 21:24
Editor
Edited
Edited
2024 Sep 12 21:26
Refs
Refs
ReLU
do not becoming gradient 0 when input becomes larger which can prevent the
Vanishing Gradient
problem.
 
 
 
 
 
 
 
 

Recommendations