I wonder if higher quality datasets are the future rather than using tons of internet scraped texts. Either way, neat model!

  • Behohippy
    link
    41 year ago

    Bad article title. This is the “Textbooks are all you need” paper from a few days ago. It’s programming focused and I think Python only. For general purpose LLM use, LLaMA is still better.