I’ve ran into this a few times, and I’m not sure how to get in besides getting lucky with a scroll of teleportation. Maybe Etheral Chains, but there’s nothing for them to hook onto.

I’ve checked the walls everywhere in the vicinity, and I can’t find a hidden door.