Simultaneous multi-class pixel labeling over coherent image sets

Paul Rivera*, Stephen Gould

*Corresponding author for this work

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    2 Citations (Scopus)

    Abstract

    Multi-class pixel labeling is an important problem in computer vision that has many diverse applications, including interactive image segmentation, semantic and geometric scene understanding, and stereo reconstruction. Current state-of-the-art approaches learn a model on a set of training images and then apply the learned model to each image in a test set independently. The quality of the results, therefore, depends strongly on the quality of the learned models and the information available within each training image. Importantly, this approach cannot leverage information available in other images at test time which may help to label the image at hand. Instead of labeling each image independently, we propose a semi-supervised approach that exploits the similarity between regions across many images in coherent image subsets. Specifically, our model finds similar regions in related images and constrains the joint labeling of the images to agree on the labels within these regions. By considering the joint labeling, our model gets to leverage contextual information that is not available when considering images in isolation. We test our approach on the popular 21-class MSRC multi-class image segmentation dataset and show improvement in accuracy over a strong baseline model.

    Original languageEnglish
    Title of host publicationProceedings - 2011 International Conference on Digital Image Computing
    Subtitle of host publicationTechniques and Applications, DICTA 2011
    Pages99-106
    Number of pages8
    DOIs
    Publication statusPublished - 2011
    Event2011 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2011 - Noosa, QLD, Australia
    Duration: 6 Dec 20118 Dec 2011

    Publication series

    NameProceedings - 2011 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2011

    Conference

    Conference2011 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2011
    Country/TerritoryAustralia
    CityNoosa, QLD
    Period6/12/118/12/11

    Fingerprint

    Dive into the research topics of 'Simultaneous multi-class pixel labeling over coherent image sets'. Together they form a unique fingerprint.

    Cite this