Inclusive Technologies Research

Vibrotactile

My research is also experimenting with new immersive technology in the areas of vibrotactile experiences, gesture recognition devices and sensor technology that translates body movement into digitally generated sound and image. Each of these technologies has initially been developed to enhance the sensory experiences of those with sensory loss, mental illness or individuals with disabilities.
The Centre for Learning Technologies (CLT) and the SMART Lab (Science of Music, Auditory Reasearch and Technology), Ryerson University have completed a research initiative exploring ways of making sound and music more accessible to all people, regardless of hearing ability, and have developed a cross-modal audiotactile program that supports that supports the presentation of audio information as vibrotactile stimuli. The core assumption is that emotional aspects of sound and music can be "translated" across modalities. The Alternative Sensory Information Display (ASID), also referred to as the Emoti-Chair, allows for the creation of cross-modal experiences representing sound stimuli that are currently unavailable to deaf or hard of hearing individuals. The technology, designed for the purpose of theatre chairs for the deaf, separates audio signals into discrete vibrotactile output channels (voice coils) that can be presented on the body to create a high resolution audiotactile experience through direct connection with musical instruments, live sound and digital sound files.
In researching and using the vibrotactile technology to create 'vibratory compositions' or tactile components, with  the generous support of TAD Inc., I will have the opportunity of investigating a much broader application of the sensory interpretation and emotionality of sound. 

Grateful aknowledgements to:
Ryerson Research Team:  Dr. Deb Fels, Dr. Frank Russo, Carme Branje (PhD), Sai Cherukumilli (MEng)
Tactile Audio Displays Inc. (TAD) Director: Dr. Maria Karam

Centre for Learning Technologies - http://imdc.ca/asid/ASID.html
SMART Lab - http://www.ryerson.ca/smart
TAD - http://tadsinc.com

Views of Emoti-Chair prototypes and wearable ASID system

                             The Mark,  'Emoti-chair', (published Video)

                 Ryerson University, 'Emoti-Chair' 

Gesture Interfaces and the Vibrotactile

This area of research investigates how computer vision and gesture interfaces could be used by deaf and hearing artists and musicians as a creative medium. We have begun exploring various models that could be used to generate tactile feedback using gestural interfaces. In addition, we are also working with the Xbox Kinect hardware to implement the computer vision, and gesture recognition. The gesture interface will be developed to work with the Emoti-chair system, and it will take the user’s movements as an input and provide vibro-tactile stimulation on the surface of the skin. 

Vibrotactile Workshop, UnLab, UWO, London   2012 (participants Maria Karam and Sigi Torinus)


Soundbeam
The Soundbeam technology, developed in the UK, translates body movement into digitally generated sound and image and was designed for intervention and support in the areas of special needs and music therapy. In performance, education and therapy, this unique creative and expressive medium is now widely recognized as a significant technology. Soundbeam offers teachers and students new opportunities for contemporary forms of composition and group music making. 
As a potential artistic medium it enable visitors/viewers to interact and recreate aspects of installation and performance art. Soundbeam is extensivelu used in contemporary dance, community music, and by artists and musicians throughout the world, as well as in interactive science centres and arts venues.

www.soundbeam.co.uk


Picture

Experiential Workshop for the Deaf

'Composing' for vibratory stimuli expressed through these technologies offer a new and unique approach to producing and enjoying art using the tactile senses. Not only is there potential to make artistic expression more accessible, but the technique and strategies revealed through this project may well translate into greater innovation in creative activities. 
Currently, in partnership with my research partners at Ryerson, I have been organizing a series of vibrational composition workshops in which Hearing, Deaf, Deafened, Hard of Hearing and Deaf-Blind musicians and interactive artists can work together to invstigate 
compositional strategies and methods for creating through the vibrotactile experience. The workshops are intended to provide opportunities for artists, musicians, etc. to explore the technology and experiment with the system as a means for innovation creation and expression. These workshops have taken place Toronto and London, Ontario. An earlier workshop took place in Vancouver.
In May of 2011 a one-day workshop took place in Toronto in collaboration with the Toronto International Deaf Film and Arts Festival and included the participation of several international Deaf filmmakers. Participants were introduce to the design and use of the system and, for the remainder of the workshop, collaborated to create and perform two vibrotactile compositions for public presentation. The workshop included the participation of Deaf filmmakers Alexander Givensky (USA), Mike Cyr (Canada), Tracey Salaway (USA), Laura Harvey (USA), Chantel Deguire (Canada) and Pinky Aiello (USA).


Experiential Workshop for Multi-disciplinary Artists/Musicians

More recently, I  organized a three day workshop  held in London, Ontario at the UnLab, University of Western Ontario. With the organizational support and enthusiasm of Adam Caplan, the workshop  involved a dozen arts professionals representing a cross-section of creative disciplines from Toronto, London and Windsor. The VibraFusionLab collective evolved in response to this important event.  London workshop participants were Dennis Siren (audio engineer, producer, cinematographer, soundtrack composer), Leslie Putnam (Artist/Educator), Bernie Koenig (Musician, Philosopher, Educator), James T. Kirkpatrick, Peter Thompson (Artist), Jordan Stevens (Musician) , Richard Moule (journalist, broadcaster, educator and musician), Sigi Torinus (Installation/sound artist, educator)

VibraFusionLab
Creating "vibratory" compositions alone, or in combination with visual and auditory creations, encourages new attitudes and approaches towards vibratory media as an innovative and inclusive form of expression. These workshops have reinforced our collaborative venture of investigating alternative and creative ways of investing artistic practices (visual, music, film, performance, audio, etc.) with the added tactile experience. Following the success of this workshop many of the participants came together to form the collective VibraFusionLab.