• @[email protected]
    link
    fedilink
    English
    12 days ago

    Lol, well obviously it would be cheaper to host an LLM that is smaller. Imagine the cost of hosting o1

    • @whatwhatwhatwhat
      link
      English
      12 days ago

      Fair. We’re using 4o and o1-mini right now, because access to the full o1 is waitlisted in Azure. However based on some brief review of their pricing for o1, I’d say we’re still going to save a metric fuckton of money compared to per-user subscriptions.