Minimizing active audio source count