Identity-preserving face recovery from portraits

Fatemeh Shiri, Xin Yu, Fatih Porikli, Richard Hartley, Piotr Koniusz

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    14 Citations (Scopus)

    Abstract

    Recovering the latent photorealistic faces from their artistic portraits aids human perception and facial analysis. However, a recovery process that can preserve identity is challenging because the fine details of real faces can be distorted or lost in stylized images. In this paper, we present a new Identity-preserving Face Recovery from Portraits (IFRP) to recover latent photorealistic faces from unaligned stylized portraits. Our IFRP method consists of two components: Style Removal Network (SRN) and Discriminative Network (DN). The SRN is designed to transfer feature maps of stylized images to the feature maps of the corresponding photorealistic faces. By embedding spatial transformer networks into the SRN, our method can compensate for misalignments of stylized faces automatically and output aligned realistic face images. The role of the DN is to enforce recovered faces to be similar to authentic faces. To ensure the identity preservation, we promote the recovered and ground-truth faces to share similar visual features via a distance measure which compares features of recovered and ground-truth faces extracted from a pre-trained VGG network. We evaluate our method on a large-scale synthesized dataset of real and stylized face pairs and attain state of the art results. In addition, our method can recover photorealistic faces from previously unseen stylized portraits, original paintings and human-drawn sketches.

    Original languageEnglish
    Title of host publicationProceedings - 2018 IEEE Winter Conference on Applications of Computer Vision, WACV 2018
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages102-111
    Number of pages10
    ISBN (Electronic)9781538648865
    DOIs
    Publication statusPublished - 3 May 2018
    Event18th IEEE Winter Conference on Applications of Computer Vision, WACV 2018 - Lake Tahoe, United States
    Duration: 12 Mar 201815 Mar 2018

    Publication series

    NameProceedings - 2018 IEEE Winter Conference on Applications of Computer Vision, WACV 2018
    Volume2018-January

    Conference

    Conference18th IEEE Winter Conference on Applications of Computer Vision, WACV 2018
    Country/TerritoryUnited States
    CityLake Tahoe
    Period12/03/1815/03/18

    Fingerprint

    Dive into the research topics of 'Identity-preserving face recovery from portraits'. Together they form a unique fingerprint.

    Cite this