I played around with this kind of thing like 10 years ago and came to the conclusion that it only works for very boring music with consistent bass hits or if you have access to the midi files.

You can still do cool stuff with frequency shenanigans, but it will never have the same vibe as actually following the notes and rythm exactly. The crazy cool stuff you see at big events is always pre programmed or based on something like midi data.