Augmenting Sculpture with Immersive Sonification

Yichen Wang; Henry Gardner; Charles Martin; Matt Adcock

doi:10.1109/VRW55335.2022.00164

Augmenting Sculpture with Immersive Sonification

Yichen Wang^*, Henry Gardner, Charles Martin, Matt Adcock

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Citation (Scopus)

Abstract

We present an artistic Mixed Reality (MR) system that remixes a sculptural element of a building and its aesthetic context to provide an on-site augmented art experience. Mainstream MR systems, particularly art-related, focus on the use of visuals in presenting additional information, whereas the use of audio as the main information channel has rarely been considered. In this work, we explore two different versions of a sonic experience for walking through an artistic staircase to enhance its public's engagement. Our user evaluation reveals the effectiveness of sonic design for a rewarding MR experience. With this, we emphasise the importance of sonic design in MR applications.

Original language	English
Title of host publication	Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	626-627
Number of pages	2
ISBN (Electronic)	9781665484022
DOIs	https://doi.org/10.1109/VRW55335.2022.00164
Publication status	Published - 2022
Event	2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022 - Virtual, Online, New Zealand Duration: 12 Mar 2022 → 16 Mar 2022

Publication series

Name	Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022

Conference

Conference	2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022
Country/Territory	New Zealand
City	Virtual, Online
Period	12/03/22 → 16/03/22

Access to Document

10.1109/VRW55335.2022.00164

Cite this

Wang, Y., Gardner, H., Martin, C., & Adcock, M. (2022). Augmenting Sculpture with Immersive Sonification. In Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022 (pp. 626-627). (Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/VRW55335.2022.00164

Wang, Yichen ; Gardner, Henry ; Martin, Charles et al. / Augmenting Sculpture with Immersive Sonification. Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022. Institute of Electrical and Electronics Engineers Inc., 2022. pp. 626-627 (Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022).

@inproceedings{7ac810ac2c234b1a86f66e38fd3213a7,

title = "Augmenting Sculpture with Immersive Sonification",

abstract = "We present an artistic Mixed Reality (MR) system that remixes a sculptural element of a building and its aesthetic context to provide an on-site augmented art experience. Mainstream MR systems, particularly art-related, focus on the use of visuals in presenting additional information, whereas the use of audio as the main information channel has rarely been considered. In this work, we explore two different versions of a sonic experience for walking through an artistic staircase to enhance its public's engagement. Our user evaluation reveals the effectiveness of sonic design for a rewarding MR experience. With this, we emphasise the importance of sonic design in MR applications.",

keywords = "Applied computing, Arts and humanities, Human computer interaction (HCI), Human-centered computing, Interaction paradigms, Mixed/augmented reality, Sound and music computing",

author = "Yichen Wang and Henry Gardner and Charles Martin and Matt Adcock",

note = "Publisher Copyright: {\textcopyright} 2022 IEEE.; 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022 ; Conference date: 12-03-2022 Through 16-03-2022",

year = "2022",

doi = "10.1109/VRW55335.2022.00164",

language = "English",

series = "Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "626--627",

booktitle = "Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022",

address = "United States",

}

Wang, Y, Gardner, H, Martin, C & Adcock, M 2022, Augmenting Sculpture with Immersive Sonification. in Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022. Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022, Institute of Electrical and Electronics Engineers Inc., pp. 626-627, 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022, Virtual, Online, New Zealand, 12/03/22. https://doi.org/10.1109/VRW55335.2022.00164

Augmenting Sculpture with Immersive Sonification. / Wang, Yichen; Gardner, Henry; Martin, Charles et al.
Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022. Institute of Electrical and Electronics Engineers Inc., 2022. p. 626-627 (Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Augmenting Sculpture with Immersive Sonification

AU - Wang, Yichen

AU - Gardner, Henry

AU - Martin, Charles

AU - Adcock, Matt

PY - 2022

Y1 - 2022

N2 - We present an artistic Mixed Reality (MR) system that remixes a sculptural element of a building and its aesthetic context to provide an on-site augmented art experience. Mainstream MR systems, particularly art-related, focus on the use of visuals in presenting additional information, whereas the use of audio as the main information channel has rarely been considered. In this work, we explore two different versions of a sonic experience for walking through an artistic staircase to enhance its public's engagement. Our user evaluation reveals the effectiveness of sonic design for a rewarding MR experience. With this, we emphasise the importance of sonic design in MR applications.

AB - We present an artistic Mixed Reality (MR) system that remixes a sculptural element of a building and its aesthetic context to provide an on-site augmented art experience. Mainstream MR systems, particularly art-related, focus on the use of visuals in presenting additional information, whereas the use of audio as the main information channel has rarely been considered. In this work, we explore two different versions of a sonic experience for walking through an artistic staircase to enhance its public's engagement. Our user evaluation reveals the effectiveness of sonic design for a rewarding MR experience. With this, we emphasise the importance of sonic design in MR applications.

KW - Applied computing

KW - Arts and humanities

KW - Human computer interaction (HCI)

KW - Human-centered computing

KW - Interaction paradigms

KW - Mixed/augmented reality

KW - Sound and music computing

UR - http://www.scopus.com/inward/record.url?scp=85129665749&partnerID=8YFLogxK

U2 - 10.1109/VRW55335.2022.00164

DO - 10.1109/VRW55335.2022.00164

M3 - Conference contribution

T3 - Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022

SP - 626

EP - 627

BT - Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022

Y2 - 12 March 2022 through 16 March 2022

ER -

Wang Y, Gardner H, Martin C, Adcock M. Augmenting Sculpture with Immersive Sonification. In Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022. Institute of Electrical and Electronics Engineers Inc. 2022. p. 626-627. (Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022). doi: 10.1109/VRW55335.2022.00164

Augmenting Sculpture with Immersive Sonification

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

The Augmented Web

Cite this

Augmenting Sculpture with Immersive Sonification

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Projects

The Augmented Web

Cite this