That’s kind of a structural problem with the fediverse itself. The whole appeal of social media is interacting with people. Less people, less appeal. The fediverse then takes its inherently smaller pool and splits it across different servers, especially once you account for defederation. Instances like lemmy.world are the natural result. Despite the structural drawbacks, a centralized social media with all users in the same space is inherently more appealing to most users