The conventional wisdom, well captured recently by Ethan Mollick, is that LLMs are advancing exponentially. A few days ago, in very popular blog post, Mollick claimed that “the current best estimates of the rate of improvement in Large Language models show capabilities doubling every 5 to 14 months”:
  • @CeeBee
    2•7 months ago

    I also worked in the field for a decade up until recently. And I use LLMs for a few things professionally, particularly code generation. It can’t write “good and clean” code, but what it does do is help get the ball rolling writing boilerplate stuff and helps solve issues that aren’t immediately clear.

    I actually run a number of models locally also.

    I get you are excited about the tech

    What a condescending thing to say. It has nothing to do with being excited or not. The broader issue is that people are approaching the topic from a “it’ll replace programmers/writers/accountants/lawyers, etc” standpoint. And I bet that’s what all the suits at various companies expect.

    Whereas the true usefulness in LLMs are as a supplementary tool to help existing jobs be more efficient. It’s no different than spell check, autocomplete, code linting, and so on. It’s just more capable than those tools.

    for now it is mostly novel and creating junk.

    This statement proves my point. Everyone thinks LLMs will “do the job” when they’re just a tool to HELP with doing the job.

      • @CeeBee
        1•7 months ago

        Said by someone who’s never written a line of code.

        Is autocorrect always right? No, but we all still use it.

        And I never said “poorly generated”, I decidedly used “good and clean”. And that was in the context of writing larger segments of code on it’s own. I did clarify after that it’s good for writing things like boilerplate code. So no, I never said “poorly generated boilerplate”. You were just putting words in my mouth.

        Boilerplate code that’s workable can help you get well ahead of a task than if you did it yourself. The beauty about boilerplate stuff is that there’s not really a whole lot of different ways to do it. Sure there are fancier ways, but generally anything but code that’s easy to read is frowned upon. Fortunately LLMs are actually great at the boilerplate stuff.

        Just about every programmer that’s tried GitHub Copilot agrees that it’s not taking over progressing jobs anytime soon, but does a fine job as a coding assistant tool.

        I know of at least three separate coding/tech related podcasts with multiple hosts that have come to the same conclusion in the past 6 months or so.

        If you’re interested, the ones I’m thinking of are Coder Radio, Linux After Dark, Linux Downtime, and 2.5 Admins.

        Your reply also demonstrates the ridiculous mindset that people have about this stuff. There’s this mentality that if it’s not literally a self aware AI then it’s spam and worthless. Ya, it does a fairly basic and mundane thing in the real world. But that mundane thing has measurable utility that makes certain workloads easier or more efficient.

        Sorry it didn’t blow your mind.