Most importantly, old oil can have a lower smoke point than is safe. Definitely replace your oil if anything starts to taste burnt.