No Audio In When Not Default Device And Sound Control Panel Closed

I am attempting to record audio from multiple soundcards at the same time using NAudio and WASAPI. If a soundcard is set as the default record device, everything is fine on that NAudio capture but there is no audio on the other NAudio captures. If I open the Sound control panel and select the Record tab, everything works on all captures. As soon as I select a different tab or close the control panel, the audio goes away and the peak meter values are 0. Any ideas? Thanks.