TY - GEN
T1 - "was that successful?" on Integrating Proactive Meta-Dialogue in a DIY-Assistant using Multimodal Cues
AU - Kraus, Matthias
AU - Schiller, Marvin
AU - Behnke, Gregor
AU - Bercher, Pascal
AU - Dorna, Michael
AU - Dambier, Michael
AU - Glimm, Birte
AU - Biundo, Susanne
AU - Minker, Wolfgang
N1 - Publisher Copyright:
© 2020 ACM.
PY - 2020/10/21
Y1 - 2020/10/21
N2 - Effectively supporting novices during performance of complex tasks, e.g. do-it-yourself (DIY) projects, requires intelligent assistants to be more than mere instructors. In order to be accepted as a competent and trustworthy cooperation partner, they need to be able to actively participate in the project and engage in helpful conversations with users when assistance is necessary. Therefore, a new proactive version of the DIY-assistant Robert is presented in this paper. It extends the previous prototype by including the capability to initiate reflective meta-dialogues using multimodal cues. Two different strategies for reflective dialogue are implemented: A progress-based strategy initiates a reflective dialogue about previous experience with the assistance for encouraging the self-appraisal of the user. An activity-based strategy is applied for providing timely, task-dependent support. Therefore, user activities with a connected drill driver are tracked that trigger dialogues in order to reflect on the current task and to prevent task failure. An experimental study comparing the proactive assistant against the baseline version shows that proactive meta-dialogue is able to build user trust significantly better than a solely reactive system. Besides, the results provide interesting insights for the development of proactive dialogue assistants.
AB - Effectively supporting novices during performance of complex tasks, e.g. do-it-yourself (DIY) projects, requires intelligent assistants to be more than mere instructors. In order to be accepted as a competent and trustworthy cooperation partner, they need to be able to actively participate in the project and engage in helpful conversations with users when assistance is necessary. Therefore, a new proactive version of the DIY-assistant Robert is presented in this paper. It extends the previous prototype by including the capability to initiate reflective meta-dialogues using multimodal cues. Two different strategies for reflective dialogue are implemented: A progress-based strategy initiates a reflective dialogue about previous experience with the assistance for encouraging the self-appraisal of the user. An activity-based strategy is applied for providing timely, task-dependent support. Therefore, user activities with a connected drill driver are tracked that trigger dialogues in order to reflect on the current task and to prevent task failure. An experimental study comparing the proactive assistant against the baseline version shows that proactive meta-dialogue is able to build user trust significantly better than a solely reactive system. Besides, the results provide interesting insights for the development of proactive dialogue assistants.
KW - assistance system
KW - do-it-yourself
KW - meta-dialogue
KW - proactivity
UR - http://www.scopus.com/inward/record.url?scp=85096715804&partnerID=8YFLogxK
U2 - 10.1145/3382507.3418818
DO - 10.1145/3382507.3418818
M3 - Conference contribution
T3 - ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction
SP - 585
EP - 594
BT - ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction
PB - Association for Computing Machinery, Inc
T2 - 22nd ACM International Conference on Multimodal Interaction, ICMI 2020
Y2 - 25 October 2020 through 29 October 2020
ER -