I have avoided AI (LLMS) because it didn’t seem nearly useful enough to warrant supporting these tech assholes. Is there anyway to use it locally on a normal device (16 Gb ram, 8 year old Geforce graphics, etc?). Can I just slow it down and get it to work locally?

  • aesthelete
    link
    fedilink
    arrow-up
    1
    ·
    edit-2
    15 hours ago

    No, it’s not transmitted on TCP/IP packets, but the way opencode works makes it so it can be part of the pinning data. Along with probably a hashed version of the context attached to the project and other things. I have read a bit about it and vibe coded some workarounds and it’s not as simple as them cataloging the VPN exit nodes, because then none of them would ever work. I have like a “scramble” command on my setup now to get around it. This was all implemented by them sometime in the last month.

    Before I added the scrambling switching between VPN nodes after the october limit pinning would immediately associate you with the old limit when switching between VPN nodes, and after scrambling the MAC address and other things (nuking project metadata) it picks up a new limit again. I’m not 100% sure what specific pieces of metadata they’re using for pinning because I decided to just have the sandbox code scramble them all at the same time, but they are pinning now.

    The easier fix would be for them to just require an account, and I suspect eventually they’ll do that (I suspect they like the anonymous for demos, but that’ll only last so long). I also suspect that google AI mode will eventually get the same treatment (account requirements and usage limits) because I find it very difficult to believe someone hasn’t already Jerry-rigged up a coding harness attached to Google’s free AI mode.