TY - GEN
T1 - Camera Adversaria
AU - Browne, Kieran
AU - Swift, Ben
AU - Nurmikko-Fuller, Terhi
N1 - Publisher Copyright:
© 2020 ACM.
PY - 2020/4/21
Y1 - 2020/4/21
N2 - In this paper we introduce Camera Adversaria; a mobile app designed to disrupt the automatic surveillance of personal photographs by technology companies. The app leverages the brittleness of deep neural networks with respect to high-frequency signals, adding generative adversarial perturbations to users' photographs. These perturbations confound image classification systems but are virtually imperceptible to human viewers. Camera Adversaria builds on methods developed by machine learning researchers as well as a growing body of work, primarily from art and design, which transgresses contemporary surveillance systems. We map the design space of responses to surveillance and identify an under-explored region where our project is situated. Finally we show that the language typically used in the adversarial perturbation literature serves to affirm corporate surveillance practices and malign resistance. This raises significant questions about the function of the research community in countenancing systems of surveillance.
AB - In this paper we introduce Camera Adversaria; a mobile app designed to disrupt the automatic surveillance of personal photographs by technology companies. The app leverages the brittleness of deep neural networks with respect to high-frequency signals, adding generative adversarial perturbations to users' photographs. These perturbations confound image classification systems but are virtually imperceptible to human viewers. Camera Adversaria builds on methods developed by machine learning researchers as well as a growing body of work, primarily from art and design, which transgresses contemporary surveillance systems. We map the design space of responses to surveillance and identify an under-explored region where our project is situated. Finally we show that the language typically used in the adversarial perturbation literature serves to affirm corporate surveillance practices and malign resistance. This raises significant questions about the function of the research community in countenancing systems of surveillance.
KW - adversarial examples
KW - critical design
KW - surveillance capitalism
UR - http://www.scopus.com/inward/record.url?scp=85091267033&partnerID=8YFLogxK
U2 - 10.1145/3313831.3376434
DO - 10.1145/3313831.3376434
M3 - Conference contribution
AN - SCOPUS:85091267033
T3 - Conference on Human Factors in Computing Systems - Proceedings
BT - CHI 2020 - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
PB - Association for Computing Machinery (ACM)
T2 - 2020 ACM CHI Conference on Human Factors in Computing Systems, CHI 2020
Y2 - 25 April 2020 through 30 April 2020
ER -