ReLU optimized since ReLU removes negative numbers while Kaiming initialization consistently preserves output distribution and so prevents reduction in output variance
Kaiming initialization
Creator
Creator

Created
Created
2025 Jan 21 15:12Editor
Editor

Edited
Edited
2025 Jan 21 15:16Refs
Refs