• GamingChairModel
    link
    fedilink
    arrow-up
    2
    ·
    29 days ago

    Wait can tokens just be directly compared like that? My impression is that token cost can vary by 2 orders of magnitude, depending on model, because the actual work of computation varies by that much between models.

    • Robin
      link
      fedilink
      English
      arrow-up
      2
      ·
      28 days ago

      Yeah this is a bad metric. GLM outputs a lot of reasoning tokens.