• @SpaceNoodle
    link
    English
    95 months ago

    In what ways are you benefiting from a bevy of factually dubious query responses?

    • @[email protected]
      link
      fedilink
      English
      105 months ago

      Can absolutely never blindly trust the hallucinating plagiarism machine.

      It’s great where either facts don’t matter or you’re personally in a position to vet all of its “factual” output 100%. Text revision, prompting for additional perspectives, prompting to challenge beliefs and identify gaps. Reformatting, quick and easy data extraction, outlining, brainstorming.

      • @SpaceNoodle
        link
        English
        25 months ago

        Reformatting and outlining as long as you go over and revise it again anyway, seemingly making that moot.

        Data extraction as long as you don’t care if the data is mangled.

        Brainstorming is a good one, since off-the-wall ideas can be useful in that context.

        • @[email protected]
          link
          fedilink
          English
          45 months ago

          In most cases I’ve seen AI used, the person spends as much time correcting it than they would if they just did the work without AI. So maybe it makes you feel more productive because a bunch of stuff happens all at once, but at least for text generation, I think it’s more of a placebo.

          • Blóðbók
            link
            fedilink
            English
            35 months ago

            It can at least get one unstuck, past an indecision paralysis, or give an outline of an idea. It can also be useful for searching though data.

          • @SpaceNoodle
            link
            English
            -15 months ago

            If all I want is something blatantly false or legible yet nonsensical, like a modern lorem ipsum, it’s a real time-saver.

            • @[email protected]
              link
              fedilink
              English
              05 months ago

              Why not just use lorem ipsum? It’s just a copy/paste, and without the liability of having false information if you forget to proofread it.

              • @SpaceNoodle
                link
                English
                -25 months ago

                I guess ChatGPT is just completely useless, then.

    • Zos_Kia
      link
      fedilink
      English
      75 months ago

      You cannot in all seriousness use a LLM as a research tool. That is explicitly not what it is useful for. A LLM’s latent space is like a person’s memory : sure there is some accurate data in there, but also a lot of “misremembered” or “misinterpreted” facts, and some bullshit.

      Think of it like a reasoning engine. Provide it some data which you have researched yourself, and ask it to aggregate it, or summarize it, you’ll get some great results. But asking it to “do the research for you” is plain stupid. If you’re going to query a probabilistic machine for accurate information, you’d be better off rolling dice.

      • @SpaceNoodle
        link
        English
        -2
        edit-2
        5 months ago

        Exactly my point - except that the word “reasoning” is far too generous, as it implies that there would be some way for it to guarantee that its logic is sound, not just highly resembling legible text.

        • Zos_Kia
          link
          fedilink
          English
          05 months ago

          I don’t understand. Have you ever worked an office job? Most humans have no way to guarantee their logic is sound yet they are the ones who do all of the reasoning on earth. Why would you have higher standards for a machine?

          • @SpaceNoodle
            link
            English
            35 months ago

            I have higher expectations for machines than humans, yes.

            • Zos_Kia
              link
              fedilink
              English
              05 months ago

              Sounds like a recipe for disappointment tbh. But on the other hand, sounds like you trust techno marketing a bit too much.

              • @SpaceNoodle
                link
                English
                05 months ago

                No, I just know how to spot the lies in a datasheet.

                • Zos_Kia
                  link
                  fedilink
                  English
                  -15 months ago

                  I"m not sure what lie and what datasheet you’re referring to ?

    • capital
      link
      English
      3
      edit-2
      5 months ago

      This question betrays either your non-use or misuse of the products available. You’re either just reading the headlines of the screw-ups or you’re just bad at using the tool.

      To directly answer your question:

      • Quick scripts in a variety of languages. Tested before being used on real data/systems.
      • Creating visual graphs of data in python and Jupyter notebooks with no prior knowledge of python itself or the tools it’s running. In this case, I was able to update the way I wanted it to look in natural language, have it suggest code changes, and immediately try them in the notebook with great results.
      • Improving the sentiment of correspondence. Proofread before sending. It has better grammar and flow than a surprising number of correspondences I’ve come across at work. Sure, English may be their second language but it doesn’t change the fact.
      • Quickly finding documentation pertaining to the query which, yes, you need to go read to verify any answers any LLM provides. Anyone using it regularly should know this by now.
      • Quick “do this in command line. What options are required” which is then immediately tested.
      • In one case, a news story was referenced in passing in a podcast I listen to. It stuck with me days later and I wanted to find actual articles written about it. I was able to describe what I was looking for in natural language and included as many details as I could remember and asked it to find articles for me. I found exactly what I was after.

      But were you actually looking for a real response to your question?

      • @SpaceNoodle
        link
        English
        -15 months ago

        It’s worse at all programming tasks except boilerplate, especially with its tendency to inject booby traps. Not knowing how to use the programming language it emits becomes a significant problem.

        Comparing a language model to an idiot is unfair to the idiot.

        A normal search engine works for everything else.

        Any well-defined query I’ve ever made of an LLM has resulted in hilariously bad results, but I suppose I was expecting it to do something that I couldn’t already do better myself.

        • capital
          link
          English
          45 months ago

          I’m a systems administrator, not a programmer. Like I said, quick scripts. An LLM could probably parse my comment better than you, evidently.

          Comparing a language model to an idiot is unfair to the idiot.

          Oof… Was this in reply to my bit about better grammar and ESL individuals?

          A normal search engine works for everything else.

          Fuck no. Especially the python visualization point.

          Any well-defined query I’ve ever made of an LLM has resulted in hilariously bad results, but I suppose I was expecting it to do something that I couldn’t already do better myself.

          I suppose you’re just a god among men then. For the rest of us, it’s useful and you’ve been given plenty of good answers to your disingenuous question.

    • Kogasa
      link
      fedilink
      English
      35 months ago

      I don’t really query, but it’s good enough at code generation to be occasionally useful. If it can spit out 100 lines of code that is generally reasonable, it’s faster to adjust the generated code than to write it all from scratch. More generally, it’s good for generating responses whose content and structure are easy to verify (like a question you already know the answer to), with the value being in the time saved rather than the content itself.

      • @SpaceNoodle
        link
        English
        -25 months ago

        It’s good at regurgitating boilerplate, from what I’ve gathered.

    • @tsonfeir
      link
      English
      -95 months ago

      Someone doesn’t know how to use ChatGPT

      • @SpaceNoodle
        link
        English
        65 months ago

        Oh, is there an arcane invocation that magically imbues it with reason?

        • @tsonfeir
          link
          English
          -55 months ago

          Nope, just gotta know what it IS, what it ISN’T, and how to correctly write prompts for it to return data that you can use to formulate your own conclusion.

          When using AI, it’s only as smart as the operator.

          • @SpaceNoodle
            link
            English
            -25 months ago

            Well, it’s not AI, for starters.

            • @[email protected]
              link
              fedilink
              English
              35 months ago

              As much as I hate to do this, it is AI, as ML is a part of Artificial Intelligence.

              It isn’t AGI, some might say it may be, but they are wrong. But the model is learning.

              • @SpaceNoodle
                link
                English
                -1
                edit-2
                5 months ago

                An LLM is not capable of learning. It won’t hallucinate less with additional training input.

                • @[email protected]
                  link
                  fedilink
                  English
                  05 months ago

                  Just the notion of a computer having hallucinations should suggest that it’s doing more than just basic code.

                  It’s not ‘intelligent’, but it has ‘learned’ enough beyond standard CPU instructions.

                  That’s why it’s not a General AI, but it’s still an AI.

                  • @SpaceNoodle
                    link
                    English
                    0
                    edit-2
                    5 months ago

                    I also talk about gremlins inside CPUs, but that doesn’t mean I think there are magical critters turning a crank inside them.

                    It’s called a metaphor, brother.

                    Regardless, it’s all code that’s eventually run on a CPU, so there isn’t any step where magic is injected.

              • Zos_Kia
                link
                fedilink
                English
                75 months ago

                No you don’t understand. The word AI, which was invented to describe this kind of technology, should not be used to describe this technology. It should instead be reserved for some imaginary magical technology that may exist in the future.

                • @[email protected]
                  link
                  fedilink
                  English
                  15 months ago

                  From what I’ve seen online, most people differentiate between AI and AGI, which is cool.

                • @tsonfeir
                  link
                  English
                  -25 months ago

                  So then don’t call it AI.

                  • Zos_Kia
                    link
                    fedilink
                    English
                    35 months ago

                    I thought the sarcasm in my comment was self evident 🤔

      • capital
        link
        English
        4
        edit-2
        5 months ago

        New version of people who know how to search the web vs those who don’t. Currently shit search results broken by search companies notwithstanding.