TY - JOUR
T1 - IK-SVD
T2 - Dictionary learning for spatial big data via incremental atom update
AU - Wang, Lizhe
AU - Lu, Ke
AU - Liu, Peng
AU - Ranjan, Rajiv
AU - Chen, Lajiao
PY - 2014
Y1 - 2014
N2 - A large group of dictionary learning algorithms focus on adaptive sparse representation of data. Almost all of them fix the number of atoms in iterations and use unfeasible schemes to update atoms in the dictionary learning process. It's difficult, therefore, for them to train a dictionary from Big Data. A new dictionary learning algorithm is proposed here by extending the classical K-SVD method. In the proposed method, when each new batch of data samples is added to the training process, a number of new atoms are selectively introduced into the dictionary. Furthermore, only a small group of new atoms as subspace controls the current orthogonal matching pursuit, construction of error matrix, and SVD decomposition process in every training cycle. The information, from both old and new samples, is explored in the proposed incremental K-SVD (IK-SVD) algorithm, but only the current atoms are adaptively updated. This makes the dictionary better represent all the samples without the influence of redundant information from old samples.
AB - A large group of dictionary learning algorithms focus on adaptive sparse representation of data. Almost all of them fix the number of atoms in iterations and use unfeasible schemes to update atoms in the dictionary learning process. It's difficult, therefore, for them to train a dictionary from Big Data. A new dictionary learning algorithm is proposed here by extending the classical K-SVD method. In the proposed method, when each new batch of data samples is added to the training process, a number of new atoms are selectively introduced into the dictionary. Furthermore, only a small group of new atoms as subspace controls the current orthogonal matching pursuit, construction of error matrix, and SVD decomposition process in every training cycle. The information, from both old and new samples, is explored in the proposed incremental K-SVD (IK-SVD) algorithm, but only the current atoms are adaptively updated. This makes the dictionary better represent all the samples without the influence of redundant information from old samples.
KW - Big data
KW - Dictionary learning
KW - Scientific computing
KW - Sparse representation
UR - http://www.scopus.com/inward/record.url?scp=84906572582&partnerID=8YFLogxK
U2 - 10.1109/MCSE.2014.52
DO - 10.1109/MCSE.2014.52
M3 - Article
SN - 1521-9615
VL - 16
SP - 41
EP - 52
JO - Computing in Science and Engineering
JF - Computing in Science and Engineering
IS - 4
M1 - 6799952
ER -