Our solar system mostly revolves around the sun on the same axis (apart from Pluto). Our galaxy does the same (along with other galaxies). Why? Gravity is linear?

Would it matter if we tried to escape the sun’s gravity by going “up?”