Support Vector Machines for Multi-label Classification
Date Issued
2006
Date
2006
Author(s)
Su, Wen-Hsien
DOI
en-US
Abstract
Multi-label classification is an important subject in machine learning. There
are several available ways to handle such problems. In this thesis we focus on using
support vector machines (SVMs). As multi-label classification can be treated
as an extension of multi-class classification, it is natural to modify multi-class approaches
for multi-label problems. The thesis considers three extensions: “binary,”
“label combination” and maximal margin formulation. We give comprehensive experiments
to check their performances. In addition, we also give detailed derivations
and investigate the implementation details.
As “label combination” is a way that treats each subset of labels as an individual
SVM class, any multi-class method can be directly applied. We discuss several methods
of this type. They are “one-against-one,” “approach in [45, 46],” and “method
by Crammer and Singer.” We compare and analyze their performances. The last
two methods both solve a single optimization problem in training. We find that they
perform well when the size of the data is not large. They are however not suitable
for very large problems due to lengthy training time. In such situations, the “label
combination” approach via “one-against-one” multi-class implementation is an
effective solution. Overall we find that the method “label combination” to directly
transform multi-label to multi-class is a practically viable technique.
Subjects
支向機
支持向量機
多標籤分類
support vector machine
multi-label classification
Type
thesis
File(s)![Thumbnail Image]()
Loading...
Name
ntu-95-P92922007-1.pdf
Size
23.31 KB
Format
Adobe PDF
Checksum
(MD5):68cc775eddaa2243b0aac9ae117cf0cc