TY - JOUR
T1 - Spherepix
T2 - A Data Structure for Spherical Image Processing
AU - Adarve, Juan David
AU - Mahony, Robert
N1 - Publisher Copyright:
© 2016 IEEE.
PY - 2017/4
Y1 - 2017/4
N2 - This letter introduces the "spherepix" data structure for efficient implementation of low-level image processing operations on spherical images. Efficient implementation of low-level image processing depends heavily on separability of the convolution kernels that form the fundamental building blocks of most algorithms. Due to the curvature of the sphere, it is not possible to place an orthogonal grid pixelation globally on its surface, making direct application of classical separable kernel convolutions impossible. In the spherepix data structure, we propose an alternative approach consisting of a collection of overlapping (near orthogonal) grid patches covering the sphere's surface. Close to the boundaries of patches, we introduce data interpolation between patch grids to ensure information flow between grid patches. After each image processing subroutine, we reconcile data in the overlapping regions to homogenize the global data representation. We claim that the additional computational cost of data interpolation and data reconciliation is easily compensated by the computational saving and algorithmic simplicity of applying existing image processing subroutines in the grid patches. The approach is demonstrated by implementing a SIFT feature point algorithm in spherepix coordinates and comparing precision, recall, and computational cost of the proposed approach to documented modifications of the SIFT algorithm specifically developed for implementation on spherical images.
AB - This letter introduces the "spherepix" data structure for efficient implementation of low-level image processing operations on spherical images. Efficient implementation of low-level image processing depends heavily on separability of the convolution kernels that form the fundamental building blocks of most algorithms. Due to the curvature of the sphere, it is not possible to place an orthogonal grid pixelation globally on its surface, making direct application of classical separable kernel convolutions impossible. In the spherepix data structure, we propose an alternative approach consisting of a collection of overlapping (near orthogonal) grid patches covering the sphere's surface. Close to the boundaries of patches, we introduce data interpolation between patch grids to ensure information flow between grid patches. After each image processing subroutine, we reconcile data in the overlapping regions to homogenize the global data representation. We claim that the additional computational cost of data interpolation and data reconciliation is easily compensated by the computational saving and algorithmic simplicity of applying existing image processing subroutines in the grid patches. The approach is demonstrated by implementing a SIFT feature point algorithm in spherepix coordinates and comparing precision, recall, and computational cost of the proposed approach to documented modifications of the SIFT algorithm specifically developed for implementation on spherical images.
KW - Omnidirectional vision
KW - visual tracking
UR - http://www.scopus.com/inward/record.url?scp=85062909198&partnerID=8YFLogxK
U2 - 10.1109/LRA.2016.2645119
DO - 10.1109/LRA.2016.2645119
M3 - Article
SN - 2377-3766
VL - 2
SP - 483
EP - 490
JO - IEEE Robotics and Automation Letters
JF - IEEE Robotics and Automation Letters
IS - 2
M1 - 7797220
ER -