Support vector machine
SVM is a Discriminative Model rather than a Statistical Model. It dominated machine learning as a powerful classifier throughout the 2000s before the rise of deep learning.
While SVM excels with small datasets, it lacks direct multi-class classification capabilities and requires combining multiple binary classifiers. The model uses weights (w), bias (b), and margin () as key parameters.
SVM Training Process
- Find an initial decision boundary that can separate input data either linearly or non-linearly
- Select support vectors - the data points closest to the initial decision boundary
- Update the decision boundary using these support vectors
- Repeat steps 2-3 until finding the optimal decision boundary
SVM Notion
SVMs