As far as I understand votes are published as ActivityPub messages, otherwise multiple servers could not have the same vote counts. They need to be able to deduplicate the same vote coming from two different servers.

So everyone can read your votes there’s just not an easy UI for it.