Abstract
When we consider multimodal communication with reference too auditory and visual methods, the two media are inherently linked with an auditory event having a visual reference whether this be diegetic or non-diegetic. This creates a homogenous stream of processed information. The two streams of data can form a synchronous meaningful interaction and perceptually we acknowledge this. However, when the link is removed and random audio and video are put together, it may be considered that the interaction has been lost. The concept that they may synchronise or create a meaningful interaction would at first appear questionable. However, this research has shown that two streams of data (audio and video) when played simultaneously, perceptually appear to some as having definable points of synchronisation. The resulting media file being a plausible synchronous multimodal experience. The concept of putting random music to a moving image creating an alternate soundtrack has been tested, and the parameters of what is perceived as synchronisation has been examined. This research has investigated what perceptual attributes support the synchronicity of auditory and visual stimuli. This research concludes that a process of perpetual masking occurs, allowing for the parameters of synchronisation to be overlooked. The perceptual masking is the umbrella term defined within this investigation as the process of multiple perceptual influences occurring, creating a plausible connection between the media. The investigation tests the parameters of random audio and video interaction and how it is perceived as a creating a meaningful event.
Presenters
Mark RandellTechnical Instructor - Associate Lecturer, Music & Media, The University of Derby, United Kingdom
Details
Presentation Type
Theme
New Media, Technology and the Arts
KEYWORDS
Audio visual synchronicity
