The ChatGPT phrase “As of my last knowledge update” appears in several papers published by academic journals.

  • @AtmaJnana
    link
    English
    21
    edit-2
    3 months ago

    As an outsider with a researcher PhD in the family, I suspect its an issue of how the institutions measure success. How many papers? How many cites? Other metrics might work, but probably not as broadly. I assume they will also care about the size of your staff, how much grant money you get, patents held, etc.

    I suspect that, short of a Nobel prize, it is difficult to objectively measure how one is advancing scientific progress (without a PhD committee to evaluate it.)

    • FaceDeer
      link
      fedilink
      113 months ago

      The saying “when a measure becomes a target it ceases to be a good measure” (Goodhart’s Law) has been making the rounds online recently, this is a good example of that.

      Ironically, this is a common problem faced when training AIs too.

    • @[email protected]
      link
      fedilink
      English
      73 months ago

      Yeah, that’s my sense too, as someone within low-level academia. Bibliometrics and other attempts to quantify research output have been big in the last few decades, but I think that they have made the problem worse if anything.

      It’s especially messy when we consider the kind of progress and contribution that Nobel prizes can’t account for, like education and outreach. I really like how Dr Fatima explores this in her video How Science Pretends to be Meritocratic(duration: 37:04)