The Correlation between Sound and Color in RAW Digital Data Formats

By: Charles Le Jeune  

Individual video frames are converted to sound files and back through algorithmic code. This conversion process involves concepts such as abundance, collection, organization, reconfiguration, juxtaposition and aesthetic elevation. With regards to my installation work, video and sound are recorded and processed in real time within the space. This video processed with the result projected back onto the space. The resulting imagery is subject to change by viewer interaction and site specificity. Most recently, my research has lead into the study of how data is interpreted through my artistic process. A process where RAW data formats are used in ways that confuse the software packages that work with them. More specifically, raw sound files are imported into graphic editing programs. When raw sounds transition into raw image through this process, the resulting imagery is represented by a basic, 16 color palette. What dictates this allocation? What assigns these color values? How is/can this new data represented in the gallery? In this session, I will describe my process in depth, RAW data formats for both sound and image, the different variations and methods used in data import process and how color is translated from audio information.

Data, Visualization, Sound
New Media, Technology and the Arts
Creative Practice Showcase

Charles Le Jeune

Assistant Professor of Interactive Media and Game Design, College of Arts and Sciences, Department of Communication and Humanities, SUNY Polytechnic Institute, United States
NY, United States

Nick LeJeune received his Bachelors of Art in Art with concentrations in Graphic Design and Drawing from  McNeese State University in Lake Charles, Louisiana in 2006. He went on to receive his Masters of Fine Arts in Arts and Design with a concentration in Intermedia from West Virginia University in 2011. From 2010-2018, he served as an instructor and developer of the Studio Art: Cross Media track in the School of Fine Arts at Fairmont State University in Fairmont, WV. He is currently serving as an Assistant Professor of Interactive Media and Game Design at the College of Arts and Sciences at SUNY Polytechnic Institute in Utica, NY.