Even outside of AI, there are many good reasons for improvements in semiconductors.

For laptops and smartphones, you can get better battery life.

For servers, semiconductors on new nodes greatly improve energy efficiency.

If anything, the bigger issue is software practices that de-emphasize efficient applications. This approach eats up any new hardware power that is developed from new semiconductors.