wuphysics87 to [email protected] • 2 months agoCan you trust locally run LLMs?message-square16fedilinkarrow-up164arrow-down17file-text
arrow-up157arrow-down1message-squareCan you trust locally run LLMs?wuphysics87 to [email protected] • 2 months agomessage-square16fedilinkfile-text
I’ve been play around with ollama. Given you download the model, can you trust it isn’t sending telemetry?
minus-squaremarcie (she/her)linkfedilink9•2 months agoyeah you could. though i dont see any evidence that the large open source llm programs like jan.ai or ollama are doing anything wrong with their program or files. chucking it in a sandbox would solve the problem for good though
minus-squareSeekPielinkfedilink5•edit-22 months agoYou could use “Alpaca” flatpak and remove the internet access with flatseal after having downloaded the model. (Linux) Or deny the app’s access to internet in app settings. (Android)
yeah you could. though i dont see any evidence that the large open source llm programs like jan.ai or ollama are doing anything wrong with their program or files. chucking it in a sandbox would solve the problem for good though
You could use “Alpaca” flatpak and remove the internet access with flatseal after having downloaded the model. (Linux)
Or deny the app’s access to internet in app settings. (Android)