The Haptic Audio Meter: Inclusion and Support for Blind and Low Vision Audio and Music Creators in the Digital Era

Abstract

This paper presents a prototype vibrotactile haptic feedback device which aims to address one of the accessibility barriers and usability challenges identified in the literature and in investigations to date that blind and low vision users of audio and music software face. The ability to monitor audio signal levels is crucial in all music and audio production fields. Current assistive technologies, which have been adapted from standard computer access technologies for blind and low vision users, and which utilise the sole interaction modality of computer speech feedback, are problematic when the user’s auditory perceptual channel is already fully engaged with creative content. A novel cross-modal mapping of the audio signal level into the haptic domain is defined, which bypasses the need for computer screen reader technologies to ‘speak’ the feedback information that is displayed on visual audio meters. The software detection of the audio signal level which maps the audio signal level to various vibrotactile stimuli signals is described. The rationale for the design choices for these mappings of audio signal levels to vibrotactile signals, informed by studies in cross-modal communication, is discussed. A prototype haptic interface ‘display’, that uses low-cost and flexible small audio loudspeakers, enables these cross-modal mappings to be perceived via contact with the fingers. Refinements to the hardware design elements are described that will allow miniaturisation and incorporation of the haptic feedback display into existing audio input interface elements, such as slide potentiometers (faders) that are common in music and audio production interface technologies.

Presenters

James Hurley
Student, PhD, The University of Newcastle, Australia, Berlin, Germany

Jon Drummond
Associate Professor, School of Creative Industries, College of Human and Social Futures, The University of Newcastle, Australia, New South Wales, Australia

Nicole Carroll
Lecturer in Digtial Composition, School of Creative Industries (SOCI), Music, University of Newcastle, New South Wales, Australia

Details

Presentation Type

Paper Presentation in a Themed Session

Theme

Design in Society

KEYWORDS

Digital Inclusion, Haptic Interfaces, Cross-Modal Communication, Participatory Design, Accessible Design