Scenario-Based Design to Envision How GenAI Can Support Sound Design Practices

Minsik Choi*, Josh Andres, Alexander Hunter, Charles Patrick Martin

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference Paperpeer-review

1 Citation (SciVal)

Abstract

Sound design involves crafting communicative sonic interfaces such as warning and confirmation signals. An interactive sound design method using musical tension and release with a supporting tool has been explored for practitioners without musical expertise; however, there remain needs for further development of the tool, regarding recommended samples and translated musical knowledge. This paper reports on a project that investigates the use of generative AI applications in sonic interaction design through practitioner-based scenarios. We present two case studies that highlight domain challenges based on a prior study of sound and UX designers, develop two practitioner scenarios from the contexts, and create a prototype of an AI-powered sound design tool with four GenAI applications and four supporting features, tailored to the scenarios. We finally provide reflections on the overall design process and the prototype. This study contributes by extending domain needs into a tangible AI-driven interface through scenario-based design.

Original languageEnglish
Title of host publicationOzCHI '24: Proceedings of the 36th Australasian Conference on Human-Computer Interaction
EditorsStephen Viller, Jeni Paay, Joel Fredericks, Jane Turner
Place of PublicationMeanjin/Brisbane
PublisherAssociation for Computing Machinery (ACM)
Pages640-646
Number of pages7
ISBN (Electronic)9798400715099
DOIs
Publication statusPublished - 29 Sept 2025
Event36th Australasian Conference on Human-Computer Interaction, OzCHI 2024: Beyond Being Human - Meanjin (Brisbane), Australia
Duration: 30 Nov 20244 Dec 2024
https://dl.acm.org/doi/proceedings/10.1145/3726986 (Proceedings)

Conference

Conference36th Australasian Conference on Human-Computer Interaction, OzCHI 2024
Abbreviated titleOzCHI '24
Country/TerritoryAustralia
CityMeanjin (Brisbane)
Period30/11/244/12/24
Internet address

Fingerprint

Dive into the research topics of 'Scenario-Based Design to Envision How GenAI Can Support Sound Design Practices'. Together they form a unique fingerprint.

Cite this