Neural Network

Neural Network

Creator

Creator

Seong-lae Cho

Created

Created

2019 Nov 5 5:18

Editor

Editor

Seong-lae Cho

Edited

Edited

2024 Sep 30 15:28

Refs

Refs

Computational Graph

Back Propagation

Narrowly defined AI

Neural Network is a differentiable computer.

Data Representation +
Data Classification +
Algorithm

Neural network layer common architecture

layer normalization

main logic like
Attention Mechanism or mlp with activation function

projection to original size (even if it is same dimension size)

residual connection

Neural Network Notion

Neural Network History

Neural Network Structure

Visualization

Tensorflow — Neural Network Playground

Tinker with a real neural network right here in your browser.

Tensorflow — Neural Network Playground

https://playground.tensorflow.org/

Tensorflow — Neural Network Playground

Zero to Hero

Neural Networks: Zero To Hero

A course by Andrej Karpathy on building neural networks, from scratch, in code. We start with the basics of backpropagation and build up to modern deep neural networks, like GPT. In my opinion language models are an excellent place to learn deep learning, even if your intention is to eventually go to other areas like computer vision because most of what you learn will be immediately transferable.

https://karpathy.ai/zero-to-hero.html

Recommendations

/////