What Is the Correlation between Sound and Color in Raw Digital Data Formats?

Abstract

Throughout my work, I am always searching for interesting connections between light and sound. This includes how it involves the exploration into how sound is interpreted into visual information through open source command line software. In my graduate studies, I took digital images and converted them into sounds which were then organized into sound compositions. More recently, I have been researching my process in depth, RAW data formats for both sound and image, the different variations and methods used in the data import process and how color is translated from audio information. In galleries around the world, my installations convert raw information from the viewer into visual data. It is done by utilizing one to several kiosks that allow viewer interaction through webcams and microphones. This touches on several topics such as data visualization, raw data interpretation, surveillance, viewer interaction, installation art, video and sound art, color mapping and data conversion. Site specificity determines the size and scope of each installation as well as the number of kiosks. Each kiosk consists of one raspberry pi, one microphone, one webcam and one projector. Viewers enter the gallery and are encouraged to approach a vacant kiosk (or join an occupied one) interact with and alter the positioning, settings, focus, keystone of each projector and provide their own specific input to the webcams. In addition, viewers are encouraged to combine projections with other kiosks to create meta-projection compositions.

Presenters

Nick LeJeune
Assistant Professor of Interactive Media and Game Design, Communication and Humanities, SUNY Polytechnic Institute, New York, United States

Details

Presentation Type

Creative Practice Showcase

Theme

New Media, Technology and the Arts

KEYWORDS

DATA, DATA VISUALIZATION, INSTALLATION, INTERACTIVE, IMMERSION, SURVEILLANCE, IDENTITY, SOCIAL EQUALIZATION

Digital Media

This presenter hasn’t added media.
Request media and follow this presentation.