☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 1 month agoOllaya — Run decision models locally.ollaya.devexternal-linkmessage-square9linkfedilinkarrow-up125arrow-down16cross-posted to: [email protected][email protected]
arrow-up119arrow-down1external-linkOllaya — Run decision models locally.ollaya.dev☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 1 month agomessage-square9linkfedilinkcross-posted to: [email protected][email protected]
minus-square☆ Yσɠƚԋσʂ ☆@lemmy.mlOPlinkfedilinkarrow-up7arrow-down1·1 month agollama.cpp isn’t configured for this mode, there are forks that can work though, this is a good explanation of what’s different https://www.youtube.com/watch?v=bcGO7xre46o
or just use llama.cpp
llama.cpp isn’t configured for this mode, there are forks that can work though, this is a good explanation of what’s different https://www.youtube.com/watch?v=bcGO7xre46o