TY - GEN
T1 - The accuracy and value of machine-generated image tags
T2 - ACM International Conference on Image and Video Retrieval, ACM-CIVR 2010
AU - Xie, Lexing
AU - Natsev, Apostol
AU - Hill, Matthew
AU - Smith, John R.
AU - Phillips, Alex
PY - 2010
Y1 - 2010
N2 - Automated image tagging is a problem of great interest, due to the proliferation of photo sharing services. Researchers have achieved considerable advances in understanding motivations and usage of tags, recognizing relevant tags from image content, and leveraging community input to recommend more tags. In this work we address several important issues in building an end-to-end image tagging application, including tagging vocabulary design, taxonomy-based tag refinement, classifier score calibration for effective tag ranking, and selection of valuable tags, rather than just accurate ones. We surveyed users to quantify tag utility and error tolerance, and use this data in both calibrating scores from automatic classifiers and in taxonomy based tag expansion. We also compute the relative importance among tags based on user input and statistics from Flickr. We present an end-to-end system evaluated on thousands of user-contributed photos using 60 popular tags. We can issue four tags per image with over 80% accuracy, up from 50% baseline performance, and we confirm through a comparative user study that value-ranked tags are preferable to accuracy-ranked tags.
AB - Automated image tagging is a problem of great interest, due to the proliferation of photo sharing services. Researchers have achieved considerable advances in understanding motivations and usage of tags, recognizing relevant tags from image content, and leveraging community input to recommend more tags. In this work we address several important issues in building an end-to-end image tagging application, including tagging vocabulary design, taxonomy-based tag refinement, classifier score calibration for effective tag ranking, and selection of valuable tags, rather than just accurate ones. We surveyed users to quantify tag utility and error tolerance, and use this data in both calibrating scores from automatic classifiers and in taxonomy based tag expansion. We also compute the relative importance among tags based on user input and statistics from Flickr. We present an end-to-end system evaluated on thousands of user-contributed photos using 60 popular tags. We can issue four tags per image with over 80% accuracy, up from 50% baseline performance, and we confirm through a comparative user study that value-ranked tags are preferable to accuracy-ranked tags.
KW - Image tagging
KW - Social media
KW - User value
UR - http://www.scopus.com/inward/record.url?scp=77955890353&partnerID=8YFLogxK
U2 - 10.1145/1816041.1816052
DO - 10.1145/1816041.1816052
M3 - Conference contribution
SN - 9781450301176
T3 - CIVR 2010 - 2010 ACM International Conference on Image and Video Retrieval
SP - 58
EP - 65
BT - CIVR 2010 - 2010 ACM International Conference on Image and Video Retrieval
Y2 - 5 July 2010 through 7 July 2010
ER -