But if we do that today, what do we do tomorrow? When someone someone else takes that vacant CEO position and starts receiving that ludicrous salary, what then?

If you killed every billionaire every month, they probably wouldn’t have time to seriously affect society, but then I suspect we’d have other problems. I have a feeling that would produce some negative outcomes for the economy and general quality of life.