• ffhein
    link
    English
    18 months ago

    GGUF q2_K works quite well IMO, I’ve run it with 12GB vram + 32GB ram