ftbsip

It' s all about the old idea of taking a sound input and producing images out of it. Our approach is mostly interested in finding algorithms that perform a transformation of the original data into a different representation space. We hope to find such spaces together with appropriate basis functions that will result in representations that are aesthetically meaningful and interesting.
It still remains our interest, to find proper mathematics to solve this problem.


0:02:10-0:02:15 0:11:40-0:11:52 0:21:45-0:21:55 0:26:20-0:26:39


samples taken from a concert of Marcus Schmickler at Batofar, Paris May 23,1999.
click on the above images to load the corresponding movie sample.


The above program performs a one-dimensional Fast Fourier Transform on the sampled input in realtime. 16 frequency-bands with a range of 8 bits are computed. These values are the input to a variety of algorithms, which range from simple graphing routines to animation of sampled images. The final programming of the visualization is performed on site. We have also used Hidden Markov Models that were trained offline on the sound input and whose inferred hidden states were used to generate images during the performance.
& contact: constantin rothkopf.





last updated Nov. 23, 2001