• DarkThoughts
    link
    fedilink
    -210 months ago

    You need a little gpu server farm for proper models & context sizes though. Single consumer gpus don’t have enough vram for that.