Sunday, March 27, 2011

Some Notes of SVM from S-O-F

This is a very good illustration of how SVM-works:
Links from 
The original is from math.stackexchange.com

The first answer:

As mokus explained, practical support vector machines use a non-linear kernel function to map data into a feature space where they are linearly separable:

SVM mapping one feature space into another

Lots of different functions are used for various kinds of data. Note that an extra dimension is added by the transformation.

(Illustration from Chris Thornton, U. Sussex.)


The 2nd answer: YouTube video that illustrates an example of linearly inseparable points that become separable by a plane when mapped to a higher dimension

 "Non-linear classification", with a link tohttp://en.wikipedia.org/wiki/Kernel_trick which explains the technique more generally.

And for SVM, a very good explanation for the equation- hyperplane is:   the w*x + b = 0
language agnostic - Support vector machines - separating hyperplane question - Stack Overflow

It is the equation of a (hyper)plane using a point and normal vector.
Think of the plane as the set of points P such that the vector passing from P0 to P is perpendicular to the normal
alt text
Check out these pages for explanation:
http://mathworld.wolfram.com/Plane.html
http://en.wikipedia.org/wiki/Plane_%28geometry%29#Definition_with_a_point_and_a_normal_vector


--

♥ ¸¸.•*¨*•♫♪♪♫•*¨*•.¸¸♥

No comments:

Post a Comment