Maybe… But no not in this scenario.

All I can say is, if all your friends jumped off a cliff will you jump off as well?

I mean of course the VCs will say that. They aren’t the ones working. ¯_(ツ)_/¯

Damn! Thank you so much. This is very helpful and a great starting point for me to mess about to make the most of my LLM setup. Appreciate it!!

Absolutely disgusting(ly cute)

Dude! That’s so dope. I would really like your insights in how you tuned MoE. That would be a game changer as you can swap out unnecessary layers from the GPU and still get the benefit of using a bigger model and stuff.

Yeah it’s a little hard to do inference with these limited VRAM situations and larger contexts. That’s a massive pain

You’re good. I’m trying to get larger context windows on my models so trying to figure that out and balance token throughput. I do appreciate your insights into the different use cases.

Have you tried larger 70b models? Or compared against larger MoE models?

Not to be that guy (he says as he becomes that guy) but the GPL is not a permissive license, BSD and MIT are. Tho imo GPL is the better and probably best license.

Also what models and use cases did you run it for? And what was your context window?

Damn, that was fast.

I wish you the best with your love life. You deserve someone who takes an interest in you and things that make you happy, and does nice things for you.

And now I’m a wizard!

Leaving his abusive dad is fair but he needs to take steps to improve his mental health either way. Healing from trauma takes time and needs professional help. There’s a saying, you can only lead a horse (or animal /entity of choice) to water, but you can’t make them drink.

Does he do it later? And how often are you dealing with him belittling your tastes?

Again do you think this is a relationship that can endure? Can you endure this? Do you see him changing how he sees himself?

Is he working on his depression? Therapy, self care, is he working on himself?

Also

Sometimes he doesn’t like doing stuff for me even when I do stuff for him or doesn’t like my interests much but wants me to like his.

Kinda a red flag, unless I’m misreading. It sounds like he doesn’t like doing stuff for you and doesn’t care for your interests. A relationship is people giving and taking. If ones depressed and can’t give that’s fine but ones gotta make up for it in their own way. Later when they can. If not something to ask yourself is can you do this for the rest of your life. Are you ok with that.

Lolol yes, it’s a weird straight circle indeed.

However applying those fixes and then learning to fix it is a great way to learn how to troubleshoot and unb0rk your system.

Treat the response like you would of an LLM, it needs to make sense to you, you need to make sure they aren’t messing with you or have given you a fix that only works in their case. Usually the best fixes are the simple ones. And it seems like even with the longer ones you’re able to figure out your simple fixes which is awesome!

They can’t consume human food. So caffeinated blood. Source: What we do in the shadows

To be fair they are right about the last 2

Tbh education was failing students long before AI. It started as soon as a degree requirement became the barrier of entry for a job. Companies don’t care about what you learnt, just you have a degree and you have a high GPA. Students are just playing the game appropriately. learning was never the objective of education after a point.

Lukes face is hilarious

I just map it to the abxy that steam suggests. Works great when I wanna keep using the trackpad or joystick at all times.

You know what they say, stupid people do stupid things, smart people outsmart each other than themselves than themselves.