• setsubyou
    link
    fedilink
    English
    arrow-up
    1
    ·
    48 minutes ago

    I guess vLLM supports clusters so you could just use that? The setup is more difficult than just plugging in a cable though.