• @Ranta
    link
    1
    edit-2
    7 months ago

    Style TTs2 for output. Localllama with a high quant on 4x 4090’. Personal AI assistant running on your local homelab for <30k.

    I kinda see it as a home appliance or vehicle level purchase.

    • @[email protected]
      link
      fedilink
      17 months ago

      I am pretty sure that there are ASIC being put in production as we speak with Whisper embeded. Expect a 4 dollars chip to add voice recognition and a basic LLM to any appliance.