Supreme Court Justice Clarence Thomas told attendees at a judicial conference Friday that he and his wife have faced “nastiness” and “lies” over the last several years and decried Washington, D.C., as a “hideous place.”

Thomas spoke at a conference attended by judges, attorneys and other court personnel in the 11th Circuit Judicial Conference, which hears federal cases from Alabama, Florida and Georgia. He made the comments pushing back on his critics in response to a question about working in a world that seems meanspirited.

“I think there’s challenges to that. We’re in a world and we — certainly my wife and I the last two or three years it’s been — just the nastiness and the lies, it’s just incredible,” Thomas said.

“But you have some choices. You don’t get to prevent people from doing horrible things or saying horrible things. But one you have to understand and accept the fact that they can’t change you unless you permit that,” Thomas said.