Knowledge-Based Systems, Volume (151), Year (2018-3) , Pages (62-77)

Title : ( Sparse online feature maps )

Authors: Nima Salehi Moghaddami , Reza Monsefi , Hadi Sadoghi Yazdi ,

Access to full-text not allowed by authors

Citation: BibTeX | EndNote


Online kernel methods suffer from computational and memory complexity in large-scale problems. Due to these drawbacks, budget online kernel learning and kernel approximation (low-dimensional feature map approximation) methods are widely used to speed up time and to reduce memory usage of kernel approaches. In this paper, orthogonal Gram-Schmidt explicit feature maps are applied to online kernel methods. The main advantage of these feature maps come from their orthogonality property. Utilization of these feature maps leads to mutually linearly independent dimensions of feature space, hence, reduce the redundancy in this space. These feature maps can be applied to single-pass online learning methods with $l_2$- and $l_0$-norm regularization to reduce the computational and memory complexity. In this paper, the proposed methods are named: 1) Online Feature Maps (OFEMs) and 2) Sparse Online Feature Maps (SOFEMs). These methods are examined for binary and multiclass single-label classification problems. Extensive experiments are compared with the results of other state-of-the-art methods on standard and real-world datasets. The experimental results show that OFEMs and SOFEMs outperform other methods in the literature.


, Explicit Feature Map, Kernel Methods, Single-pass Online Learning, Gram-Schmidt Orthogonalization Process
برای دانلود از شناسه و رمز عبور پرتال پویا استفاده کنید.

author = {Salehi Moghaddami, Nima and Monsefi, Reza and Sadoghi Yazdi, Hadi},
title = {Sparse online feature maps},
journal = {Knowledge-Based Systems},
year = {2018},
volume = {151},
month = {March},
issn = {0950-7051},
pages = {62--77},
numpages = {15},
keywords = {Explicit Feature Map; Kernel Methods; Single-pass Online Learning; Gram-Schmidt Orthogonalization Process},


%0 Journal Article
%T Sparse online feature maps
%A Salehi Moghaddami, Nima
%A Monsefi, Reza
%A Sadoghi Yazdi, Hadi
%J Knowledge-Based Systems
%@ 0950-7051
%D 2018