I have been watching HomeAssistant’s progress with assist for some time. We previously used Google Home via Nest Minis, and have switched to using fully local assist backed by local first + llama.cpp (previously Ollama). In this post I will share the steps I took to get to where I am today, the decisions I made and why they were the best for my use case specifically. Links to Additional Improvements Here are links to additional improvements posted about in this thread. New Features Security C...
  • lowspeedchase@lemmy.dbzer0.comEnglish
    11·
    1 day ago

    Good read!

    “…but I eventually found the brilliant llm-intents integration…”

    immediately followed by this:

    “…the results were mediocre.”

    made me chuckle though. I’ll probably jump in this pool once we achieve better performace/response times - both the silence and the idle dialog during that 2-5 seconds are maddening to me. I do not need loading screens irl.

  • Avid Amoeba@lemmy.caEnglish
    5·
    1 day ago

    This is something I’m going for too. Currently just running Ollama integration with HA for voice control but I’d be moving STT/TTS locally too. The new Qwen 3.5 35B loads fairly quickly and responds quickly enough to be usable for conversation on my system. The 9B version is extremely fast and adequate for voice control.