IMPROMPTU CONDUCTOR - A VIRTUAL-REALITY SYSTEM FOR MUSIC GENERATION BASED ON SUPERVISED LEARNING

This paper presents the 'Impromptu Conductor' virtual reality system w hich combines computer graphics and music, with the emphasis on comput er music. We introduce the supervised learning method from the field o f pattern recognition into the reproduction and the organization of mu sic. We have proposed and implemented a practical way of capturing hum an motion to create music as well as generating the corresponding imag es on a screen by using a 6D tracker to simulate the user's hand in re al time. However, the mapping between music and hand motion in our sys tem is not a simple one-to-one function, and is constrained and proper ly modified by music styles collected from supervised learning. Thus t he music style produced by an interactive user strongly depends on the movement of their hands. The system implemented demonstrates that the system designer can give different styles of feedback to different pa tterns of a user's behaviour.