• CompostMaterial
    link
    fedilink
    English
    arrow-up
    9
    ·
    14 days ago

    I’ve tried it. I find the responses of the Qwen models to be far inferior to the Gemma models.

    • Shatur@discuss.tchncs.deOP
      link
      fedilink
      English
      arrow-up
      8
      ·
      14 days ago

      Interesting, I had the opposite experience. Especially for tool calls. But I heard it depends on the use case: Qwen better at coding and tool calls, Gemma is better for prose.

    • Bread@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      3
      ·
      13 days ago

      Like all things llm, the quantisation makes the difference. Which, of course you need the vram for to have good results. Flash next works very well if you can run the higher quants.