HDGI: A Human Device Gesture Interaction Ontology for the Internet of Things

Madhawa Perera; Armin Haller; Sergio José Rodríguez Méndez; Matt Adcock

doi:10.1007/978-3-030-62466-8_8

HDGI: A Human Device Gesture Interaction Ontology for the Internet of Things

Madhawa Perera^*, Armin Haller, Sergio José Rodríguez Méndez, Matt Adcock

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

5 Citations (Scopus)

Abstract

Gesture-controlled interfaces are becoming increasingly popular with the growing use of Internet of Things (IoT) systems. In particular, in automobiles, smart homes, computer games and Augmented Reality (AR)/Virtual Reality (VR) applications, gestures have become prevalent due to their accessibility to everyone. Designers, producers, and vendors integrating gesture interfaces into their products have also increased in numbers, giving rise to a greater variation of standards in utilizing them. This variety can confuse a user who is accustomed to a set of conventional controls and has their own preferences. The only option for a user is to adjust to the system even when the provided gestures are not intuitive and contrary to a user’s expectations. This paper addresses the problem of the absence of a systematic analysis and description of gestures and develops an ontology which formally describes gestures used in Human Device Interactions (HDI). The presented ontology is based on Semantic Web standards (RDF, RDFS and OWL2). It is capable of describing a human gesture semantically, along with relevant mappings to affordances and user/device contexts, in an extensible way.

Original language	English
Title of host publication	The Semantic Web – ISWC 2020 - 19th International Semantic Web Conference, 2020, Proceedings
Editors	Jeff Z. Pan, Valentina Tamma, Claudia d’Amato, Krzysztof Janowicz, Bo Fu, Axel Polleres, Oshani Seneviratne, Lalana Kagal
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	111-126
Number of pages	16
ISBN (Print)	9783030624651
DOIs	https://doi.org/10.1007/978-3-030-62466-8_8
Publication status	Published - 2020
Event	19th International Semantic Web Conference, ISWC 2020 - Athens, Greece Duration: 2 Nov 2020 → 6 Nov 2020

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	12507 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	19th International Semantic Web Conference, ISWC 2020
Country/Territory	Greece
City	Athens
Period	2/11/20 → 6/11/20

Access to Document

10.1007/978-3-030-62466-8_8

Cite this

Perera, M., Haller, A., Rodríguez Méndez, S. J., & Adcock, M. (2020). HDGI: A Human Device Gesture Interaction Ontology for the Internet of Things. In J. Z. Pan, V. Tamma, C. d’Amato, K. Janowicz, B. Fu, A. Polleres, O. Seneviratne, & L. Kagal (Eds.), The Semantic Web – ISWC 2020 - 19th International Semantic Web Conference, 2020, Proceedings (pp. 111-126). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12507 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-62466-8_8

Perera, Madhawa ; Haller, Armin ; Rodríguez Méndez, Sergio José et al. / HDGI : A Human Device Gesture Interaction Ontology for the Internet of Things. The Semantic Web – ISWC 2020 - 19th International Semantic Web Conference, 2020, Proceedings. editor / Jeff Z. Pan ; Valentina Tamma ; Claudia d’Amato ; Krzysztof Janowicz ; Bo Fu ; Axel Polleres ; Oshani Seneviratne ; Lalana Kagal. Springer Science and Business Media Deutschland GmbH, 2020. pp. 111-126 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{0daa661a731445208add543790000123,

title = "HDGI: A Human Device Gesture Interaction Ontology for the Internet of Things",

abstract = "Gesture-controlled interfaces are becoming increasingly popular with the growing use of Internet of Things (IoT) systems. In particular, in automobiles, smart homes, computer games and Augmented Reality (AR)/Virtual Reality (VR) applications, gestures have become prevalent due to their accessibility to everyone. Designers, producers, and vendors integrating gesture interfaces into their products have also increased in numbers, giving rise to a greater variation of standards in utilizing them. This variety can confuse a user who is accustomed to a set of conventional controls and has their own preferences. The only option for a user is to adjust to the system even when the provided gestures are not intuitive and contrary to a user{\textquoteright}s expectations. This paper addresses the problem of the absence of a systematic analysis and description of gestures and develops an ontology which formally describes gestures used in Human Device Interactions (HDI). The presented ontology is based on Semantic Web standards (RDF, RDFS and OWL2). It is capable of describing a human gesture semantically, along with relevant mappings to affordances and user/device contexts, in an extensible way.",

keywords = "Gesture, Gesture interfaces, Internet of Things, Ontology, Semantic web",

author = "Madhawa Perera and Armin Haller and {Rodr{\'i}guez M{\'e}ndez}, {Sergio Jos{\'e}} and Matt Adcock",

note = "Publisher Copyright: {\textcopyright} 2020, Springer Nature Switzerland AG.; 19th International Semantic Web Conference, ISWC 2020 ; Conference date: 02-11-2020 Through 06-11-2020",

year = "2020",

doi = "10.1007/978-3-030-62466-8_8",

language = "English",

isbn = "9783030624651",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "111--126",

editor = "Pan, {Jeff Z.} and Valentina Tamma and Claudia d{\textquoteright}Amato and Krzysztof Janowicz and Bo Fu and Axel Polleres and Oshani Seneviratne and Lalana Kagal",

booktitle = "The Semantic Web – ISWC 2020 - 19th International Semantic Web Conference, 2020, Proceedings",

address = "Germany",

}

Perera, M, Haller, A, Rodríguez Méndez, SJ & Adcock, M 2020, HDGI: A Human Device Gesture Interaction Ontology for the Internet of Things. in JZ Pan, V Tamma, C d’Amato, K Janowicz, B Fu, A Polleres, O Seneviratne & L Kagal (eds), The Semantic Web – ISWC 2020 - 19th International Semantic Web Conference, 2020, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 12507 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 111-126, 19th International Semantic Web Conference, ISWC 2020, Athens, Greece, 2/11/20. https://doi.org/10.1007/978-3-030-62466-8_8

HDGI: A Human Device Gesture Interaction Ontology for the Internet of Things. / Perera, Madhawa; Haller, Armin; Rodríguez Méndez, Sergio José et al.
The Semantic Web – ISWC 2020 - 19th International Semantic Web Conference, 2020, Proceedings. ed. / Jeff Z. Pan; Valentina Tamma; Claudia d’Amato; Krzysztof Janowicz; Bo Fu; Axel Polleres; Oshani Seneviratne; Lalana Kagal. Springer Science and Business Media Deutschland GmbH, 2020. p. 111-126 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12507 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - HDGI

T2 - 19th International Semantic Web Conference, ISWC 2020

AU - Perera, Madhawa

AU - Haller, Armin

AU - Rodríguez Méndez, Sergio José

AU - Adcock, Matt

PY - 2020

Y1 - 2020

N2 - Gesture-controlled interfaces are becoming increasingly popular with the growing use of Internet of Things (IoT) systems. In particular, in automobiles, smart homes, computer games and Augmented Reality (AR)/Virtual Reality (VR) applications, gestures have become prevalent due to their accessibility to everyone. Designers, producers, and vendors integrating gesture interfaces into their products have also increased in numbers, giving rise to a greater variation of standards in utilizing them. This variety can confuse a user who is accustomed to a set of conventional controls and has their own preferences. The only option for a user is to adjust to the system even when the provided gestures are not intuitive and contrary to a user’s expectations. This paper addresses the problem of the absence of a systematic analysis and description of gestures and develops an ontology which formally describes gestures used in Human Device Interactions (HDI). The presented ontology is based on Semantic Web standards (RDF, RDFS and OWL2). It is capable of describing a human gesture semantically, along with relevant mappings to affordances and user/device contexts, in an extensible way.

AB - Gesture-controlled interfaces are becoming increasingly popular with the growing use of Internet of Things (IoT) systems. In particular, in automobiles, smart homes, computer games and Augmented Reality (AR)/Virtual Reality (VR) applications, gestures have become prevalent due to their accessibility to everyone. Designers, producers, and vendors integrating gesture interfaces into their products have also increased in numbers, giving rise to a greater variation of standards in utilizing them. This variety can confuse a user who is accustomed to a set of conventional controls and has their own preferences. The only option for a user is to adjust to the system even when the provided gestures are not intuitive and contrary to a user’s expectations. This paper addresses the problem of the absence of a systematic analysis and description of gestures and develops an ontology which formally describes gestures used in Human Device Interactions (HDI). The presented ontology is based on Semantic Web standards (RDF, RDFS and OWL2). It is capable of describing a human gesture semantically, along with relevant mappings to affordances and user/device contexts, in an extensible way.

KW - Gesture

KW - Gesture interfaces

KW - Internet of Things

KW - Ontology

KW - Semantic web

UR - http://www.scopus.com/inward/record.url?scp=85096545684&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-62466-8_8

DO - 10.1007/978-3-030-62466-8_8

M3 - Conference contribution

SN - 9783030624651

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 111

EP - 126

BT - The Semantic Web – ISWC 2020 - 19th International Semantic Web Conference, 2020, Proceedings

A2 - Pan, Jeff Z.

A2 - Tamma, Valentina

A2 - d’Amato, Claudia

A2 - Janowicz, Krzysztof

A2 - Fu, Bo

A2 - Polleres, Axel

A2 - Seneviratne, Oshani

A2 - Kagal, Lalana

PB - Springer Science and Business Media Deutschland GmbH

Y2 - 2 November 2020 through 6 November 2020

ER -

Perera M, Haller A, Rodríguez Méndez SJ, Adcock M. HDGI: A Human Device Gesture Interaction Ontology for the Internet of Things. In Pan JZ, Tamma V, d’Amato C, Janowicz K, Fu B, Polleres A, Seneviratne O, Kagal L, editors, The Semantic Web – ISWC 2020 - 19th International Semantic Web Conference, 2020, Proceedings. Springer Science and Business Media Deutschland GmbH. 2020. p. 111-126. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-62466-8_8

HDGI: A Human Device Gesture Interaction Ontology for the Internet of Things

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this