• @[email protected]
    link
    fedilink
    119 months ago

    Move options include; move closer, move away, fireball, megapunch, hurricane, and megafireball.

    Megafireball, Megafireball, Megafireball, Megafireball, Megafireball, Megafireball…

  • qaz
    link
    69 months ago

    Last but not least, the question arises whether this is a useful benchmark for LLMs, or just an interesting distraction. More complex games could provide more rewarding insights, but results would probably be more difficult to interpret.

    I’d love to see LLM’s rated by the time it takes them to beat the ender dragon

    • chiisana
      link
      fedilink
      39 months ago

      Could be a fun category extension. LLM Dragon% RSG: Using a fixed system such as AWS g5.xlarge for example (for fairness of frame rate), players are allowed to use LLM of their choice, using a consistent screen parser to generate a string describing the screen state to be filled as part of their LLM prompt, that’d navigate through the game from start to finish.