The accuracy and value of machine-generated image tags: Design and user evaluation of an end-to-end image tagging system

Lexing Xie*, Apostol Natsev, Matthew Hill, John R. Smith, Alex Phillips

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

8 Citations (Scopus)

Abstract

Automated image tagging is a problem of great interest, due to the proliferation of photo sharing services. Researchers have achieved considerable advances in understanding motivations and usage of tags, recognizing relevant tags from image content, and leveraging community input to recommend more tags. In this work we address several important issues in building an end-to-end image tagging application, including tagging vocabulary design, taxonomy-based tag refinement, classifier score calibration for effective tag ranking, and selection of valuable tags, rather than just accurate ones. We surveyed users to quantify tag utility and error tolerance, and use this data in both calibrating scores from automatic classifiers and in taxonomy based tag expansion. We also compute the relative importance among tags based on user input and statistics from Flickr. We present an end-to-end system evaluated on thousands of user-contributed photos using 60 popular tags. We can issue four tags per image with over 80% accuracy, up from 50% baseline performance, and we confirm through a comparative user study that value-ranked tags are preferable to accuracy-ranked tags.

Original languageEnglish
Title of host publicationCIVR 2010 - 2010 ACM International Conference on Image and Video Retrieval
Pages58-65
Number of pages8
DOIs
Publication statusPublished - 2010
Externally publishedYes
EventACM International Conference on Image and Video Retrieval, ACM-CIVR 2010 - Xi'an, China
Duration: 5 Jul 20107 Jul 2010

Publication series

NameCIVR 2010 - 2010 ACM International Conference on Image and Video Retrieval

Conference

ConferenceACM International Conference on Image and Video Retrieval, ACM-CIVR 2010
Country/TerritoryChina
CityXi'an
Period5/07/107/07/10

Fingerprint

Dive into the research topics of 'The accuracy and value of machine-generated image tags: Design and user evaluation of an end-to-end image tagging system'. Together they form a unique fingerprint.

Cite this