TY - GEN
T1 - Fast kernel sparse representation
AU - Li, Hanxi
AU - Gao, Yongsheng
AU - Sun, Jun
PY - 2011
Y1 - 2011
N2 - Two efficient algorithms are proposed to seek the sparse representation on high-dimensional Hilbert space. By proving that all the calculations in Orthogonal Match Pursuit (OMP) are essentially inner-product combinations, we modify the OMP algorithm to apply the kernel-trick. The proposed Kernel OMP (KOMP) is much faster than the existing methods, and illustrates higher accuracy in some scenarios. Furthermore, inspired by the success of group-sparsity, we enforce a rigid group-sparsity constraint on KOMP which leads to a noniterative variation. The constrained cousin of KOMP, dubbed as Single-Step KOMP (S-KOMP), merely takes one step to achieve the sparse coefficients. A remarkable improvement (up to 2,750 times) in efficiency is reported for S-KOMP, with only a negligible loss of accuracy.
AB - Two efficient algorithms are proposed to seek the sparse representation on high-dimensional Hilbert space. By proving that all the calculations in Orthogonal Match Pursuit (OMP) are essentially inner-product combinations, we modify the OMP algorithm to apply the kernel-trick. The proposed Kernel OMP (KOMP) is much faster than the existing methods, and illustrates higher accuracy in some scenarios. Furthermore, inspired by the success of group-sparsity, we enforce a rigid group-sparsity constraint on KOMP which leads to a noniterative variation. The constrained cousin of KOMP, dubbed as Single-Step KOMP (S-KOMP), merely takes one step to achieve the sparse coefficients. A remarkable improvement (up to 2,750 times) in efficiency is reported for S-KOMP, with only a negligible loss of accuracy.
KW - Kernel trick
KW - Orthogonal Matching Pursuit
KW - Sparse Representation
UR - http://www.scopus.com/inward/record.url?scp=84863078673&partnerID=8YFLogxK
U2 - 10.1109/DICTA.2011.20
DO - 10.1109/DICTA.2011.20
M3 - Conference contribution
SN - 9780769545882
T3 - Proceedings - 2011 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2011
SP - 72
EP - 77
BT - Proceedings - 2011 International Conference on Digital Image Computing
T2 - 2011 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2011
Y2 - 6 December 2011 through 8 December 2011
ER -