The last time I did a quote for a house in the northeast it came in at over 50k all-in. Oil tank had to be removed which would have costed a ton…the state would only pay for part of it. New ductwork run, baseboard heating removed (pipes sawed off and capped at wall), hot water heater added, new heat pump with dual zone + thermostats for upstairs/downstairs. Plumbing modifications for new setup including a new hot water line for reasons I can’t remember. Drywall ripped out, replaced, painted, etc.

3 different quotes for over 50k. I sold the house instead. No thanks.

My current place (not in the northeast) has a heat pump and our electric bill is never over $200 for a 2,200 sq ft home, so they will definitely save you money. That up front cost can be a killer, however. We had the heat pump stop working once and had to use emergency heat for about a month and our electric bill more than doubled.