OpenAI spends about $700,000 a day, just to keep ChatGPT going. The cost does not include other AI products like GPT-4 and DALL-E2. Right now, it is pulling through only because of Microsoft's $10 billion funding
  • @BetaDoggo_English
    1•1 year ago

    In terms of flexibility oobabooga’s text generation webui is the best as it supports nearly every model as ggml, gptq and transformers.

    For the model itself Nous-hermes-llama2 is one the best for easy use.