Weight Initialization

Creator

Creator

Seonglae Cho

Created

Created

2023 Jun 6 8:40

Editor

Editor

Seonglae Cho

Edited

Edited

2023 Jul 6 9:14

Refs

Refs

weight to small random numbers

bias (zero or small nonzero)

Weight Initialization Usages

He initialization

Xavier Initialization

Gaussian Initialization

0025 Initialization - Deepest Documentation

0025 Initialization - Deepest Documentation

https://deepestdocs.readthedocs.io/en/latest/002_deep_learning_part_1/0025/

Recommendations

//////