• Pennomi
    link
    English
    215 days ago

    Interesting conclusion, LLMs are inherently 1D in nature, and ARC is a 2D task. LLMs are able to emulate 2D reasoning for sufficiently small tasks, but suffer greatly as the size of the task increases. This is like asking humans to solve 4D problems.

    This is probably a fundamental limitation in LLM architecture and will need to be solved someday, presumably by something completely different.

    • Semperverus
      link
      English
      85 days ago

      I’ve beaten Portal and Portal 2, have I not solved 4D problems?

      • @Giooschi
        link
        English
        75 days ago

        Not really, portals give you shortcuts in 3D space, they don’t allow you to interact with a whole different dimension. If you have Minecraft there’s a really nice custom map called “The Hypercube” which sorts of emulates a 4th dimension, it felt much more confusing than Portal (2) for me.

      • finley
        link
        fedilink
        English
        2
        edit-2
        5 days ago

        Odd does it may sound, not exactly. Again, that’s a perception problem, not a reasoning problem.

        If you compare the perception of portal travel from the show Stargate to the game Portal, I think it illustrates the difference.