The difference is that in going to the past you have some idea of how things played out and what changes might matter. The changes that come up in time travel discussions are things like “kill this person before they do anything” or “let this guy into art school” or “cancel this one particular flight.” By the time the real consequences of possible small changes are known, you need more than small changes to acheve your objective.