SuspiciousCarrot78@aussie.zone to SelfhostedEnglish · 6 days agoDo you host your own AI?message-squaremessage-square204linkfedilinkarrow-up1181arrow-down142file-text
arrow-up1139arrow-down1message-squareDo you host your own AI?SuspiciousCarrot78@aussie.zone to SelfhostedEnglish · 6 days agomessage-square204linkfedilinkfile-text
minus-squaresurewhynotlemlinkfedilinkEnglisharrow-up4arrow-down1·6 days agoI have to recommend switching to llamacpp. It’s SO much faster than ollama.
minus-squarecurbstickle@anarchist.nexusMlinkfedilinkEnglisharrow-up2arrow-down1·6 days agoOn the list but haven’t gotten to it yet, but I know I should. I could probably get a bit more out of that box with it, expand the context windows a bit…
I have to recommend switching to llamacpp. It’s SO much faster than ollama.
On the list but haven’t gotten to it yet, but I know I should. I could probably get a bit more out of that box with it, expand the context windows a bit…