It was famously already a well established argument by the time of the drafting of the US constitution. The southern states were deathly afraid their ability to keep slaves would be taken away, which was basically the entire driving motivation behind almost everything they did.