Cross Entropy

Creator

Creator

Alan Jo

Created

Created

2023 Apr 27 2:39

Editor

Editor

Alan Jo

Edited

Edited

2024 Feb 24 9:6

Refs

Refs

Shannon entropy

Catastrophic forgetting

Is also H(p)+KL(p|q) and negative log likelihood

posterior prior

KL Divergence 를 minimize하는 건 log likelihood를 maximize하는 것과 같다

Cross Entropy Notion

Recommendations

/////