Draft of Dynamic Performance Space Process

One of the biggest problems for telematic performances is that of auditory visual mismatch. Often collocated performances place musicians in a dry, studio-like environment, and rely on artificial reverberation and acoustic modeling techniques to place the musician's sound in an environment more conducive to musical performance. The problem comes when the musician sounds as if he/she is in a large performance space but looks as if he/she is in a very small studio environment. This problem is address by taking the musician out of the studio environment (using real-time matting techniques) and placing him/her into a photorealistic visual environment that has a visual impression that matches the acoustic room model being used. Experimentally verified, (Valente and Braasch 07 AES), this matching of visual and sonic impressions creates a performance that is perceptually more realistic, and provides an environment that affords musicals interaction and collaboration. By using techniques, performances are not limited to a single space, and can be freely changed during a collaboration. An example of such a dynamic performance space is the topic of my final project in a computer vision class I am taking this semester. A draft of the performance can be seen in my visual media page.