Once an application has been silent for extended periods of time, switching the sink input doesn't cause sound to come out of the correct sink.

If Spotify, for instance, has been paused for an extended period of time, and I switch from my speakers to my headphones, once I play my music again, the music will come out of the speakers. Investigation into how Pulse handles extended silence is needed.