Nintendo challenge: conductor/music game

I started reading "Proving the Concept: how revolution will change games" and found it interesting. The idea of a conductor game is a good start but will have to be extended beyond "classical" music -- in today's "band," you only have handful of performers but one could consider the muscians and dancers as part of the "symphony" and try to manage them. How to extend to Jazz (where the mood and the interplay changes the music during the live performance) will be a challenge.