Seonglae Chodefined as a directed graph
where the nodes correspond to mathematical operations
Forward pass
evaluates the value of the mathematical expression represented by computational graphs
Backward pass
back-propagates the error to obtain the derivatives given the final and intermediate results