FaceDeer

Every once in a rare while even a clock as broken as Trump can be correct.

“It’s done,” [ambassador Hoekstra] told National Post in his first-wide ranging interview in Canada since he was confirmed to the role last month. “From my standpoint, from the president’s standpoint, 51st state’s not coming back,” he said. “The president may bring it up every once in a while, but he recognizes it’s not going to happen unless the prime minister engages with the president.”

Hey, Hoekstra? Maybe we’d believe Trump could get the message pounded into his sponge-filled skull if he’d stop bringing it up.

Elon Musk decided they absolutely would not use lidar, years ago when lidar was expensive enough that a decision like that made economic sense to at least try making work. Nowadays lidar is a lot cheaper but for whatever reason Musk has drawn a line in the sand and refuses to back down on it.

Unlike many people online these days I don’t believe that Musk is some kind of sheer-luck bought-his-way-into-success grifter, he has been genuinely involved in many of the decisions that made his companies grow. But this is one of the downsides of that (Cybertruck is another). He’s forced through ideas that turned out to be amazing, but he’s also forced through ideas that sucked. He seems to be increasingly having trouble distinguishing them.

They believe that Jesus will come back when Armageddon happens, and Armageddon is supposed to happen in Israel.

The sound of rain means many things. The sound of the Titan imploding means one thing.

Bear in mind, that’s the sound of a 19 year old kid who didn’t want to go on that trip dying.

They’re holding it in Kananaskis, nicely tucked away in the mountains away from easy access by protestors. There’s a lot of people in Alberta who’d show up and make a scene otherwise.

IMO this is fine, it’s not really a pension plan’s role to be trying to manipulate what industries are doing well. A pension plan should be primarily focused on getting good long-term returns.

If you want that to not happen then you should focus on policies that make carbon-producing industries not produce good long-term returns in the first place. Then the pension plans and everyone else will stop investing in them as a natural consequence.

If they remain profitable and your pension plan stops investing in them, that just means you’re handing free money to the people who remain willing to invest in them.

Because the world wouldn’t be literally on fire, that’s hyperbole.

You’re still setting a high standard here. What counts as a “well trained” human and how many SO commenters count as that? Also “easier to teach” is complicated. It takes decades for a human to become well trained, an LLM can be trained in weeks. And an individual computer that’ll be running the LLM is “trained” in minutes, it just needs to load the model into memory. Once you have an LLM you can run as many instances of it as you want to spend money on.

There’s no guarantee LLM will get reliably better at everything

Never said they would. I said they’re as bad as they’re ever going to be, which allows for the possibility that they don’t get any better.

Even if they don’t, though, they’re still good enough to have killed Stack Overflow.

It still makes some mistakes today that it did when introduced and nobody knows how to fix that yet

And humans also make mistakes. Do we know how to fix that yet?

If they aren’t comfortable with their Discord messages being public, perhaps they shouldn’t have posted those messages in a public forum that the public can access.

Good thing human teachers never have hidden biases.

How does this play out when you hold a human contributor to the same standards? They also often fail to summarize information accurately or bring up the wrong thing. Lots of answers on Stack Overflow are just plain wrong, or focus on the wrong thing, or don’t reference the correct sources (when they reference anything at all). The most common criticism of Stack Overflow I’m seeing is how its human contributors direct people to other threads and declare that the question is “already answered” there when it isn’t really.

LLMs can do a decent job. And right now they are as bad as they’re ever going to be.

That’s the neat thing, you don’t.

LLM training is primarily about getting the LLM to understand concepts. When you need it to be factual, or are working with it to solve novel problems, you can put a bunch of relevant information into the LLM’s context and it can use that even if it wasn’t explicitly trained on it. It’s called RAG, retrieval-augmented generation. Most of the general-purpose LLMs on the net these days do that, when you ask Copilot or Gemini about stuff it’ll often have footnotes in the response that point to the stuff that it searched up in the background and used as context.

So for a future Stack Overflow LLM replacement, I’d expect the LLM to be backed up by being able to search through relevant documentation and source code.

What comes to mind when people talk about how mediocre AI is.

As I said above:

mobs of angry people ignorant of both the technical details and legal issues involved in it.

Emphasis added.

They do not “steal” anything when they train an AI off of something. They don’t even violate copyright when they train an AI off of something, which is what I assume you actually meant when you sloppily and emotively used the word “steal.”

In order to violate copyright you need to distribute a copy of something. Training isn’t doing that. Models don’t “contain” the training material, and neither do the outputs they produce (unless you try really hard to get it to match something specific, in which case you might as well accuse a photocopier manufacturer of being a thief).

Training an AI model involves analyzing information. People are free to analyze information using whatever tools they want to. There is no legal restriction that an author can apply to prevent their work from being analyzed. Similarly, “style” cannot be copyrighted.

A world in which a copyright holder could prohibit you from analyzing their work, or could prohibit you from learning and mimicking their style, would be nothing short of a hellish corporate dystopia. I would say it baffles me how many people are clamoring for this supposedly in the name of “the little guy”, but sadly, it doesn’t. I know how people can be selfish and short-sighted, imagining that they’re owed for their hard work of shitposting on social media (that they did at the time for free and for fun) now that someone else is making money off of it. There are a bunch of lawsuits currently churning through courts in various jurisdictions claiming otherwise, but let us hope that they all get thrown out like the garbage they are because the implications of them succeeding are terrible.

The world is not all about money. Art is not all about money. It’s disappointing how quickly and easily masses of people started calling for their rights to be taken away in exchange for the sliver of a fraction of a penny that they think they can now somehow extract. The offense they claim to feel over someone else making something valuable out of something that is free. How dare they.

And don’t even get me started about the performative environmental ignorance around the “they’re disintegrating all the water!” And “each image generation could power billions of homes!” Nonsense.

It’s a great new technology that unfortunately has become the subject of baying mobs of angry people ignorant of both the technical details and legal issues involved in it.

It has drawn some unwarranted hype, sure. It’s also drawn unwarranted hate. The common refrain of “it’s stealing from artists!” Is particularly annoying, it’s just another verse in the never-ending march to further monetize and control every possible scrap of peoples’ thoughts and ideas.

I’m eager to see all the new applications for it unfold, and I hope that the people demanding it to be restricted with draconian new varieties of intellectual property law or to be solely under the control of gigantic megacorporations won’t prevail (these two groups are the same group of people, they often don’t realize this).

This is an area where synthetic data can be useful. For example, you could scrape the documentation and source code for a Python library and then use an existing LLM to generate questions and answers about the content to train future coding assistants on. As long as the training data gets well curated for quality it’s perfectly useful for this kind of thing, no need for an actual forum.

AI companies have a lot of clever people working for them, they’re aware of these problems.

I don’t see how this comment is related to the content of this article. This is a bunch of information about how LLMs work under the hood, it has nothing to do with how they’re supposedly “sucking up and ingesting whatever’s out there unquestioningly.” I don’t see anything about LLM training mentioned here, it’s about how they function once they have been trained.

I’m a fan of the Machete Order.

There may be some spoilers in that blog post, it’s been a while since I read it, so here it is in summary:

• A New Hope (4)
• Empire Strikes Back (5)
• Attack of the Clones (2)
• Revenge of the Sith (3)
• Return of the Jedi (5)

Phantom Menace is omitted because it’s the weakest of the prequel trilogy and everything that happens in it is summarized at the beginning of Attack of the Clones anyway. If you want to be a completionist then watch it between Empire Strikes Back and Attack of the Clones.

There’s good reasons for following this order, but it’s hard to describe them without spoiling anything. Basically, Lucas assumed you’d watched the original trilogy when he made the prequels, so it’s got a bunch of spoilers in it that the Machete Order preserves quite nicely.