SuspiciousCarrot78@aussie.zone to SelfhostedEnglish · 3 days agoDo you host your own AI?message-squaremessage-square199linkfedilinkarrow-up1177arrow-down140file-text
arrow-up1137arrow-down1message-squareDo you host your own AI?SuspiciousCarrot78@aussie.zone to SelfhostedEnglish · 3 days agomessage-square199linkfedilinkfile-text
minus-squareirmadladlinkfedilinkEnglisharrow-up2arrow-down1·3 days agoI was thinking something along the lines of: AMD Ryzen 9 9950X3D 4.3GHz NVIDIA Tesla M10 Quad 96GB DDR5 4TB 990 EVO M.2 Which, with all the other accoutrements like water cooling, etc, will put me right at the $4k mark. https://codeberg.org/BobbyLLM/picoGURU I’ll check it out.
minus-squareSuspiciousCarrot78@aussie.zoneOPlinkfedilinkEnglisharrow-up3arrow-down2·3 days agoNice bit of kit that. Very nice. Planning on serious AI shenanigans? I’ll check it out. Cool. It’s not ready any time soon but when it is, I’ll announce it and make sure it’s callable via SSH / terminal / OpenAI style chat end point. That way you don’t need anything fancier than a nice terminal to call it.
minus-squareirmadladlinkfedilinkEnglisharrow-up3arrow-down2·3 days ago Planning on serious AI shenanigans Absolutely. Like I said, if I’m going to do it, I want to do it up right. I don’t want to come back in 5+ minutes for a result. LOL
minus-squareNatanox@discuss.tchncs.delinkfedilinkEnglisharrow-up3arrow-down2·3 days agoDamn bro, you’re treating yourself for sure! The RAM alone is what, 2k? 🥴
minus-squareirmadladlinkfedilinkEnglisharrow-up3arrow-down2·3 days agoWell, I haven’t had any new equipment in 15 years. I always buy used or refurb’d. I’m getting old. I figure, I’ve worked hard enough, might as well enjoy the fruits of my labor.
I was thinking something along the lines of:
Which, with all the other accoutrements like water cooling, etc, will put me right at the $4k mark.
I’ll check it out.
Nice bit of kit that. Very nice. Planning on serious AI shenanigans?
Cool. It’s not ready any time soon but when it is, I’ll announce it and make sure it’s callable via SSH / terminal / OpenAI style chat end point.
That way you don’t need anything fancier than a nice terminal to call it.
Absolutely. Like I said, if I’m going to do it, I want to do it up right. I don’t want to come back in 5+ minutes for a result. LOL
Damn bro, you’re treating yourself for sure! The RAM alone is what, 2k? 🥴
Well, I haven’t had any new equipment in 15 years. I always buy used or refurb’d. I’m getting old. I figure, I’ve worked hard enough, might as well enjoy the fruits of my labor.