If booted with headphones in, sound comes from them and speakers

[stozi]

I've started playing music in my headphones without realizing it's also blaring from the speakers in public enough times now to try to fix this.

If headphones are in on boot, sound will come out of both them and the speakers unless you remove them and put them back. How to make only play from headphones if they are in on boot?