Anti-occlusion Light-Field Optical Flow Estimation Using Light-Field Super-Pixels

Hao Zhu; Xiaoming Sun; Qi Zhang; Qing Wang; Antonio Robles-Kelly; Hongdong Li

doi:10.1007/978-3-030-21074-8_1

Anti-occlusion Light-Field Optical Flow Estimation Using Light-Field Super-Pixels

Hao Zhu, Xiaoming Sun, Qi Zhang, Qing Wang^*, Antonio Robles-Kelly, Hongdong Li

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Optical flow estimation is one of the most important problem in community. However, current methods still can not provide reliable results in occlusion boundary areas. Light field cameras provide hundred of views in a single shot, so the ambiguity can be better analysed using other views. In this paper, we present a novel method for anti-occlusion optical flow estimation in a dynamic light field. We first model the light field superpixel (LFSP) as a slanted plane in 3D. Then the motion of the occluded pixels in central view slice can be optimized by the un-occluded pixels in other views. Thus the optical flow in occlusion boundary areas can be well computed. Experimental results on both synthetic and real light fields demonstrate the advantages over state-of-the-arts and the performance on 4D optical flow computation.

Original language	English
Title of host publication	Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers
Editors	Gustavo Carneiro, Shaodi You
Publisher	Springer Verlag
Pages	3-12
Number of pages	10
ISBN (Print)	9783030210731
DOIs	https://doi.org/10.1007/978-3-030-21074-8_1
Publication status	Published - 2019
Event	14th Asian Conference on Computer Vision, ACCV 2018 - Perth, Australia Duration: 2 Dec 2018 → 6 Dec 2018

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	11367 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	14th Asian Conference on Computer Vision, ACCV 2018
Country/Territory	Australia
City	Perth
Period	2/12/18 → 6/12/18

Access to Document

10.1007/978-3-030-21074-8_1

Cite this

Zhu, H., Sun, X., Zhang, Q., Wang, Q., Robles-Kelly, A., & Li, H. (2019). Anti-occlusion Light-Field Optical Flow Estimation Using Light-Field Super-Pixels. In G. Carneiro, & S. You (Eds.), Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers (pp. 3-12). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11367 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-21074-8_1

Zhu, Hao ; Sun, Xiaoming ; Zhang, Qi et al. / Anti-occlusion Light-Field Optical Flow Estimation Using Light-Field Super-Pixels. Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers. editor / Gustavo Carneiro ; Shaodi You. Springer Verlag, 2019. pp. 3-12 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{d94855efd7b34338a64569ee28e0f0b3,

title = "Anti-occlusion Light-Field Optical Flow Estimation Using Light-Field Super-Pixels",

abstract = "Optical flow estimation is one of the most important problem in community. However, current methods still can not provide reliable results in occlusion boundary areas. Light field cameras provide hundred of views in a single shot, so the ambiguity can be better analysed using other views. In this paper, we present a novel method for anti-occlusion optical flow estimation in a dynamic light field. We first model the light field superpixel (LFSP) as a slanted plane in 3D. Then the motion of the occluded pixels in central view slice can be optimized by the un-occluded pixels in other views. Thus the optical flow in occlusion boundary areas can be well computed. Experimental results on both synthetic and real light fields demonstrate the advantages over state-of-the-arts and the performance on 4D optical flow computation.",

keywords = "Light field, Optical flow",

author = "Hao Zhu and Xiaoming Sun and Qi Zhang and Qing Wang and Antonio Robles-Kelly and Hongdong Li",

note = "Publisher Copyright: {\textcopyright} 2019, Springer Nature Switzerland AG.; 14th Asian Conference on Computer Vision, ACCV 2018 ; Conference date: 02-12-2018 Through 06-12-2018",

year = "2019",

doi = "10.1007/978-3-030-21074-8_1",

language = "English",

isbn = "9783030210731",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "3--12",

editor = "Gustavo Carneiro and Shaodi You",

booktitle = "Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers",

address = "Germany",

}

Zhu, H, Sun, X, Zhang, Q, Wang, Q, Robles-Kelly, A & Li, H 2019, Anti-occlusion Light-Field Optical Flow Estimation Using Light-Field Super-Pixels. in G Carneiro & S You (eds), Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11367 LNCS, Springer Verlag, pp. 3-12, 14th Asian Conference on Computer Vision, ACCV 2018, Perth, Australia, 2/12/18. https://doi.org/10.1007/978-3-030-21074-8_1

Anti-occlusion Light-Field Optical Flow Estimation Using Light-Field Super-Pixels. / Zhu, Hao; Sun, Xiaoming; Zhang, Qi et al.
Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers. ed. / Gustavo Carneiro; Shaodi You. Springer Verlag, 2019. p. 3-12 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11367 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Anti-occlusion Light-Field Optical Flow Estimation Using Light-Field Super-Pixels

AU - Zhu, Hao

AU - Sun, Xiaoming

AU - Zhang, Qi

AU - Wang, Qing

AU - Robles-Kelly, Antonio

AU - Li, Hongdong

PY - 2019

Y1 - 2019

N2 - Optical flow estimation is one of the most important problem in community. However, current methods still can not provide reliable results in occlusion boundary areas. Light field cameras provide hundred of views in a single shot, so the ambiguity can be better analysed using other views. In this paper, we present a novel method for anti-occlusion optical flow estimation in a dynamic light field. We first model the light field superpixel (LFSP) as a slanted plane in 3D. Then the motion of the occluded pixels in central view slice can be optimized by the un-occluded pixels in other views. Thus the optical flow in occlusion boundary areas can be well computed. Experimental results on both synthetic and real light fields demonstrate the advantages over state-of-the-arts and the performance on 4D optical flow computation.

AB - Optical flow estimation is one of the most important problem in community. However, current methods still can not provide reliable results in occlusion boundary areas. Light field cameras provide hundred of views in a single shot, so the ambiguity can be better analysed using other views. In this paper, we present a novel method for anti-occlusion optical flow estimation in a dynamic light field. We first model the light field superpixel (LFSP) as a slanted plane in 3D. Then the motion of the occluded pixels in central view slice can be optimized by the un-occluded pixels in other views. Thus the optical flow in occlusion boundary areas can be well computed. Experimental results on both synthetic and real light fields demonstrate the advantages over state-of-the-arts and the performance on 4D optical flow computation.

KW - Light field

KW - Optical flow

UR - http://www.scopus.com/inward/record.url?scp=85068479114&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-21074-8_1

DO - 10.1007/978-3-030-21074-8_1

M3 - Conference contribution

SN - 9783030210731

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 3

EP - 12

BT - Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers

A2 - Carneiro, Gustavo

A2 - You, Shaodi

PB - Springer Verlag

T2 - 14th Asian Conference on Computer Vision, ACCV 2018

Y2 - 2 December 2018 through 6 December 2018

ER -

Zhu H, Sun X, Zhang Q, Wang Q, Robles-Kelly A, Li H. Anti-occlusion Light-Field Optical Flow Estimation Using Light-Field Super-Pixels. In Carneiro G, You S, editors, Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers. Springer Verlag. 2019. p. 3-12. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-21074-8_1

Anti-occlusion Light-Field Optical Flow Estimation Using Light-Field Super-Pixels

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this