You can enter that hole after blasting the glass on the top of the hole (requires the super bomb), however going down is a bit tricky, and is even trickier to get out.

While falling down the hole, aim your gun downwards and continuously shoot, since the bottom is filled with enemies. You can find various upgrades there, as well as a shortcut to Underground Mines Level II and Underground Labs.