We have been developing video tracking systems in Max/MSP for the last year to work with heavilly disabled clients in music therapy, so I was very interested to see a similar project featured on the Cycling 74 site. Cycling ’74 || The Adaptive Use Instruments Project
We have also been working on video tracking for use in Music Therapy here at the VIPRE lab at the University of Western Sydney. Myself and Jon Drummond from the University of Western Sydney have been working with Alan Lem from the Nordoff Robins Music Therapy centre on an easily adaptable multi-timbrel sonification system that uses the concepts of Dynamic Orchestration (additional instrument area added as the gesture changes intensity, or some other established criteria), Realtime Synthesis so that the gestural nuances of the user are fully reflected in the sound, and a simple touch screen interface, and things like auto-scaling so that moving the camera to look at just one part of the body will provide the same result as looking at an entirely active body. The autoscaling function is also important to adjust to the range of movement of each client as they vary greatly. Here is a little video of some of the trials we did at Nordoff-Robbins with the very generous support of some of their clients.
A press release from the University is available here