This is like the exact case that bone conducting headphones are for. You can hear everything, and no one has to hear your music.

I also have some earbuds that have a passthrough mode, but I wouldn’t trust them to stay in while running or biking.