• @[email protected]
    link
    fedilink
    English
    21 month ago

    That’s becoming less true. The cost of inference has been rising with bigger models, and even more so with “reasoning models”.

    Regardless, at the scale of 100M users, big one-off costs start looking small.

    • @adoxographer
      link
      English
      11 month ago

      But I’d imagine any Chinese operator will handle scale much better? Or?

      • @[email protected]
        link
        fedilink
        English
        11 month ago

        Maybe? Depends on what costs dominate operations. I imagine Chinese electricity is cheap but building new data centres is likely much cheaper % wise than countries like the US.