Most states have laws restricting faithless electors in some way, including voiding such votes (which has happened). Though, some lack enforcement mechanisms. The Supreme Court has upheld penalties for faithless electors within the past five years. As a result, it’s vanishingly rare.

It’s still a dumb system that is unrepresentative and relies too much on people just doing the right thing, but this characterization isn’t totally accurate.