defined as a directed graph

where the nodes correspond to mathematical operations

#### Forward pass

evaluates the value of the mathematical expression represented by computational graphs

#### Backward pass

back-propagates the error to obtain the derivatives given the final and intermediate results