When you can just lift off and adjust verticality to avoid objects

You need to navigate between objects on an additional access. Also, manage speed and trajectory with a changing mass, as you exhaust fuel.

Not rocket science, but its close.

it is actually easier than self-driving cars (which is why almost all of a commercial flight is running on autopilot)

Commercial flight follows lanes of traffic with regular well-regulated flight paths.

One thing that gets helicopters and small engine aircraft pilots in trouble is that they don’t have any of that.