Computer Music Journal

Momeni, Ali.
Henry, Cyrille.
Dynamic Independent Mapping Layers for Concurrent Control of Audio and Video Synthesis
Computer Music Journal - Volume 30, Number 1, Spring 2006, pp. 49-66

The MIT Press

Momeni and Henry Ali Momeni* and Cyrille Henry† *Center for New Music and Audio Technologies University of California at Berkeley 1750 Arch Street Berkeley, California 94709 USA www.cnmat.berkeley.edu/~ali ali@cnmat.berkeley.edu † 11 Rue Jaques Kablé 75018 Paris, France www.chdh.net cyrille.henry@la-kitchen.fr Dynamic Independent Mapping Layers for Concurrent Control of Audio and Video Synthesis 49 The work we describe here is motivated by a desire for intimate and expressive control over creative processes implemented in real-time performance software. We seek a manner of control that offers a “low entry fee with no ceiling on virtuosity” and allows expressive control of musical and visual control structures (Wessel and Wright 2001). Like many colleagues, we believe that the answer lies in enriching the approach to mapping (Winkler 1995; Rovan et al. 1997; Arfib et al. 2002; Hunt et al. 2002). Correspondence between sound and image is an incredibly rich area of exploration ranging from psychoacoustic research to cinema and most recently to the world of computer-based media. Our interest in the latter category motivated a survey of what repertoire and tools explore interaction between sound and image in real-time work. Most works can be characterized as (1) sound-to-image, (2) image-tosound, or (3) concurrent generation of sound and image. The first two categories represent a unidirectional relationship between sound and image. In sound-to-image applications,...