Investigating the communication of emotions through multimodal technologies and gestures

Author/Creator ORCID

Date

Department

Program

Citation of Original Publication

Kuber, R., Sulaiman, S. & Blandford, A. 2006: Investigating the Communication of Emotions through Multimodal Technologies and Gestures. In proceedings of the 20th BCS Conference on Human Computer Interaction - HCI’06 Volume 2, https://userpages.umbc.edu/~rkuber/pubs/BCSHCI2006a.pdf

Rights

This item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author.

Subjects

Abstract

In human–human interactions, touch is an important means of communicating emotional content. Touch-based technologies may have a role to play in augmenting computer-mediated communications, such as Chat and Instant Messaging. The study reported here investigated whether emotions could be effectively understood via haptic and gestural interfaces. Each interface was developed to communicate a specific emotion, based on established descriptions of the visual and gestural representations of positive and negative emotions. Sixteen subjects were asked to identify the emotion being expressed by reference to ‘emo-cards’ which displayed a larger range of emotions. Participants successfully identified the emotion of surprise, were partially successful in identifying happiness and disgust, but were unable to reliably identify sadness. We outline a programme of further research to determine which emotions can be reliably communicated, and how to design effective representations for communicating those emotions.