SVM

Creator
Creator
Seonglae Cho
Created
Created
2023 Mar 5 13:6
Editor
Edited
Edited
2025 Mar 24 17:12

Support vector machine

SVM is a
Discriminative Model
rather than a
Statistical Model
. It dominated machine learning as a powerful classifier throughout the 2000s before the rise of deep learning.
While SVM excels with small datasets, it lacks direct multi-class classification capabilities and requires combining multiple binary classifiers. The model uses weights (w), bias (b), and margin (γ\gamma) as key parameters.

SVM Training Process

  1. Find an initial decision boundary that can separate input data either linearly or non-linearly
  1. Select support vectors - the data points closest to the initial decision boundary
  1. Update the decision boundary using these support vectors
  1. Repeat steps 2-3 until finding the optimal decision boundary
SVM Notion
 
 
SVMs
 
 
 

Implementations

 
 

Recommendations