The ChatGPT phrase “As of my last knowledge update” appears in several papers published by academic journals.

  • FaceDeer
    link
    fedilink
    1024 months ago

    This really just shines a light on a more significant underlying problem with scientific publication in general, that being that there’s just way too much of it. “Publish or perish” is resulting in enormous pressure to churn out papers whether they’re good or not.

    • @AtmaJnana
      link
      English
      21
      edit-2
      4 months ago

      As an outsider with a researcher PhD in the family, I suspect its an issue of how the institutions measure success. How many papers? How many cites? Other metrics might work, but probably not as broadly. I assume they will also care about the size of your staff, how much grant money you get, patents held, etc.

      I suspect that, short of a Nobel prize, it is difficult to objectively measure how one is advancing scientific progress (without a PhD committee to evaluate it.)

      • FaceDeer
        link
        fedilink
        114 months ago

        The saying “when a measure becomes a target it ceases to be a good measure” (Goodhart’s Law) has been making the rounds online recently, this is a good example of that.

        Ironically, this is a common problem faced when training AIs too.

      • @[email protected]
        link
        fedilink
        English
        74 months ago

        Yeah, that’s my sense too, as someone within low-level academia. Bibliometrics and other attempts to quantify research output have been big in the last few decades, but I think that they have made the problem worse if anything.

        It’s especially messy when we consider the kind of progress and contribution that Nobel prizes can’t account for, like education and outreach. I really like how Dr Fatima explores this in her video How Science Pretends to be Meritocratic(duration: 37:04)