TY - JOUR
T1 - Particle Swarm Optimization based dictionary learning for remote sensing big data
AU - Wang, Lizhe
AU - Geng, Hao
AU - Liu, Peng
AU - Lu, Ke
AU - Kolodziej, Joanna
AU - Ranjan, Rajiv
AU - Zomaya, Albert Y.
N1 - Publisher Copyright:
© 2014 Elsevier B.V. All rights reserved.
PY - 2015
Y1 - 2015
N2 - Dictionary learning, which is based on sparse coding, has been frequently applied to many tasks related to remote sensing processes. Recently, many new non-analytic dictionary-learning algorithms have been proposed. Some are based on online learning. In online learning, data can be sequentially incorporated into the computation process. Therefore, these algorithms can train dictionaries using large-scale remote sensing images. However, their accuracy is decreased for two reasons. On one hand, it is a strategy of updating all atoms at once; on the other, the direction of optimization, such as the gradient, is not well estimated because of the complexity of the data and the model. In this paper, we propose a method of improved online dictionary learning based on Particle Swarm Optimization (PSO). In our iterations, we reasonably selected special atoms within the dictionary and then introduced the PSO into the atom-updating stage of the dictionary-learning model. Furthermore, to guide the direction of the optimization, the prior reference data were introduced into the PSO model. As a result, the movement dimension of the particles is reasonably limited and the accuracy and effectiveness of the dictionary are promoted, but without heavy computational burdens. Experiments confirm that our proposed algorithm improves the performance of the algorithm for large-scale remote sensing images, and our method also has a better effect on noise suppression.
AB - Dictionary learning, which is based on sparse coding, has been frequently applied to many tasks related to remote sensing processes. Recently, many new non-analytic dictionary-learning algorithms have been proposed. Some are based on online learning. In online learning, data can be sequentially incorporated into the computation process. Therefore, these algorithms can train dictionaries using large-scale remote sensing images. However, their accuracy is decreased for two reasons. On one hand, it is a strategy of updating all atoms at once; on the other, the direction of optimization, such as the gradient, is not well estimated because of the complexity of the data and the model. In this paper, we propose a method of improved online dictionary learning based on Particle Swarm Optimization (PSO). In our iterations, we reasonably selected special atoms within the dictionary and then introduced the PSO into the atom-updating stage of the dictionary-learning model. Furthermore, to guide the direction of the optimization, the prior reference data were introduced into the PSO model. As a result, the movement dimension of the particles is reasonably limited and the accuracy and effectiveness of the dictionary are promoted, but without heavy computational burdens. Experiments confirm that our proposed algorithm improves the performance of the algorithm for large-scale remote sensing images, and our method also has a better effect on noise suppression.
KW - Big data
KW - Machine learning
KW - Online dictionary learning
KW - Particle Swarm Optimization
KW - Sparse representation
UR - http://www.scopus.com/inward/record.url?scp=84930520292&partnerID=8YFLogxK
U2 - 10.1016/j.knosys.2014.10.004
DO - 10.1016/j.knosys.2014.10.004
M3 - Article
SN - 0950-7051
VL - 79
SP - 43
EP - 50
JO - Knowledge-Based Systems
JF - Knowledge-Based Systems
ER -