Zhixin Zhang
Interactive Gestures: Designing a gesture graphic system for hearing-impaired and their hearing communication partners
Summary
Abstract
Gestures are tools that can assist language and facilitate communication, as well as helping to recall words, shape ideas and even change the sounds that people hear. Gestural communication differs from sign language. Sign language is a language, but gestures are a form of non-verbal communication. Different countries have their own sign language, which is difficult to standardise and is very complex, with so many movements that most hearing people with normal hearing would struggle to understand it. Compared to sign language, interactive gestures are the most effective way for people with hearing impairment to communicate with hearing people. Interactive gesture is a form of non-verbal communication, consisting particularly in hand and arm movements (often referred to as gestures), It has long been recognised as an important element of human interaction and compensatory behaviour for individuals with communication impairments. The use of interactive gestural visual resources by hearing- impaired people and their hearing communication partners in their daily interactions suggests the need for a new gestural graphic system to enable effective communication.
This research focuses on the design of such a system for people with hearing impairment and their hearing communication partners, the research used a participatory approach to designing this system. Through participatory activities, participants co-developed gestures, which he used as the basis for designs for a graphical system of interactive gestures, and to create visual tools to enhance and alter communication. The system is designed to be accessible to people with language impairments, but can be used by all. This research can provide findings in the areas of graphic design, visual communication, inclusive design and more.
Keywords: interactive gesture, participatory activity, hearing-impaired people, hearing communication partner, graphic system
Additional info
Zhang Zhixin (Henry). He is a visual communication designer and researcher, and a hearing-impaired person. His recent research, which brings together participatory design methods, inclusive design, and hearing-impaired groups, investigates how hearing-impaired people communicate with their hearing communication partners. His main research interests are communication issues and creative practices (particularly visual communication) that examine the ways in which hearing impaired people communicate. His interdisciplinary approach draws on resources both inside and outside visual culture studies, including anthropology, digital media, psychology, and sociology.
Interactive Gestures
Kendon’s Continuum. D. McNeill, 2005.
Participatory activities and details of the design process. Zhixin Zhang, 2022.
Video screenshots of engaging in participatory activities. Zhixin Zhang, 2022.
Types of gestures, zhixin zhang, 2022.
GIF design of gesture graphics, zhixin zhang, 2022.
Interactive gesture graphics system. Zhixin Zhang, 2022.
