Monocular Dense 3D Reconstruction of a Complex Dynamic Scene from Two Perspective Frames

Suryansh Kumar, Yuchao Dai, Hongdong Li

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    42 Citations (Scopus)

    Abstract

    This paper proposes a new approach for monocular dense 3D reconstruction of a complex dynamic scene from two perspective frames. By applying superpixel over-segmentation to the image, we model a generically dynamic (hence non-rigid) scene with a piecewise planar and rigid approximation. In this way, we reduce the dynamic reconstruction problem to a '3D jigsaw puzzle ' problem which takes pieces from an unorganized 'soup of superpixels'. We show that our method provides an effective solution to the inherent relative scale ambiguity in structure-from-motion. Since our method does not assume a template prior, or per-object segmentation, or knowledge about the rigidity of the dynamic scene, it is applicable to a wide range of scenarios. Extensive experiments on both synthetic and real monocular sequences demonstrate the superiority of our method compared with the state-of-the-art methods.

    Original languageEnglish
    Title of host publicationProceedings - 2017 IEEE International Conference on Computer Vision, ICCV 2017
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages4659-4667
    Number of pages9
    ISBN (Electronic)9781538610329
    DOIs
    Publication statusPublished - 22 Dec 2017
    Event16th IEEE International Conference on Computer Vision, ICCV 2017 - Venice, Italy
    Duration: 22 Oct 201729 Oct 2017

    Publication series

    NameProceedings of the IEEE International Conference on Computer Vision
    Volume2017-October
    ISSN (Print)1550-5499

    Conference

    Conference16th IEEE International Conference on Computer Vision, ICCV 2017
    Country/TerritoryItaly
    CityVenice
    Period22/10/1729/10/17

    Fingerprint

    Dive into the research topics of 'Monocular Dense 3D Reconstruction of a Complex Dynamic Scene from Two Perspective Frames'. Together they form a unique fingerprint.

    Cite this