Not if you know how to machine

Use the right feeds, speeds and tools. Also there’s different types of aluminum alloys with different levels of machinability. If what you say were true there wouldn’t be so many machined aluminum parts in just about every project I’ve ever worked on