You are here

Pareto-Path Multitask Multiple Kernel Learning

TitlePareto-Path Multitask Multiple Kernel Learning
Publication TypeJournal Article
Year of Publication2015
AuthorsLi C, Georgiopoulos M, Anagnostopoulos GC
JournalNeural Networks and Learning Systems, IEEE Transactions on
Start Page51
KeywordsMachine learning, optimization methods, pattern recognition, supervised learning, support vector machines (SVM).

A traditional and intuitively appealing Multitask Multiple Kernel Learning (MT-MKL) method is to optimize the sum (thus, the average) of objective functions with (partially) shared kernel function, which allows information sharing among the tasks. We point out that the obtained solution corresponds to a single point on the Pareto Front (PF) of a multiobjective optimization problem, which considers the concurrent optimization of all task objectives involved in the (MTL) problem. Motivated by this last observation and arguing that the former approach is heuristic, we propose a novel support vector machine MT-MKL framework that considers an implicitly defined set of conic combinations of task objectives. We show that solving our framework produces solutions along a path on the aforementioned PF and that it subsumes the optimization of the average of objective functions as a special case. Using the algorithms we derived, we demonstrate through a series of experimental results that the framework is capable of achieving a better classification performance, when compared with other similar MTL approaches.


Theme by Danetsoft and Danang Probo Sayekti inspired by Maksimer