### Bayesian reasoning, Bayesian machine learning, Bayesian approach

statistical method that uses Bayes' theorem to update the probability of a hypothesis as more evidence becomes available

Instead of optimizing performance to find optimal parameters for a algorithm, Bayesian ML focus on probability distributions over all such parameters not only optimum, even given data is small.

do not directly estimate and choose exact

Bayesian inference Notion