• @brucethemoose
    link
    English
    21 month ago

    Yep.

    32B fits on a “consumer” 3090, and I use it every day.

    72B will fit neatly on 2025 APUs, though we may have an even better update by then.

    I’ve been using local llms for a while, but Qwen 2.5, specifically 32B and up, really feels like an inflection point to me.