Matrix Derivation

Matrix Derivation

Creator

Creator

Created

Created

2023 Apr 17 7:9

Editor

Editor

Edited

Edited

2025 Apr 28 22:52

Refs

Refs

Transpose of Matrix

x^TB \rightarrow B \newline x^Tb \rightarrow b \newline x^Tx \rightarrow 2x \newline x^TBx \rightarrow 2Bx \newline y^TBx \rightarrow B^Ty \newline

Reduce matrix size when possible, otherwise, just transpose it

Matrix Derivative Usages

Hessian Matrix

Full cheat sheet

atmos.washington.edu

https://atmos.washington.edu/~dennis/MatrixCalculus.pdf

Core cheat sheet

www.gatsby.ucl.ac.uk

http://www.gatsby.ucl.ac.uk/teaching/courses/sntn/sntn-2017/resources/Matrix_derivatives_cribsheet.pdf

Recommendations

///////