A Learning Framework of Nonparallel Hyperplanes Classifier

Abstract EN

A novel learning framework of nonparallel hyperplanes support vector machines (NPSVMs) is proposed for binary classification and multiclass classification.

This framework not only includes twin SVM (TWSVM) and its many deformation versions but also extends them into multiclass classification problem when different parameters or loss functions are chosen.

Concretely, we discuss the linear and nonlinear cases of the framework, in which we select the hinge loss function as example.

Moreover, we also give the primal problems of several extension versions of TWSVM’s deformation versions.

It is worth mentioning that, in the decision function, the Euclidean distance is replaced by the absolute value |wTx+b|, which keeps the consistency between the decision function and the optimization problem and reduces the computational cost particularly when the kernel function is introduced.

The numerical experiments on several artificial and benchmark datasets indicate that our framework is not only fast but also shows good generalization.