Hello there

I am starting to understand and discover local (like on my computer) LLM.

LMstudio make it easy for beginners.

There is something I can’t make works right : my laptop has a Nvidia T600 2Gb graphic card. Genuine Nvidia drivers works well on the OS and graphic applications (Linux Mint). But LMstudo can’t use it.

LLM models run fine but only on CPU.

I read somewhere about CUDA not being fully implemented on Linux, is it the limiting factor ? Anyone managed to offload some work to an Nvidia T600 on laptop?

Thanks

  • MasterBlasterEnglish
    1·
    1 month ago

    I installed ComfyUI recently and it included some CUDA libraries. When I run a prompt, my GPU spikes to 100%. I’m using an RTX 4080 16G cram Laptop. It’s possible your GPU isn’t capable. I don’t recognize the model, and 2G is tiny.

    I’m pretty sure it uses GPU in my LMStudio installation, too.