The sport, already fading in relevance, is paying a big price for being second fiddle to football.