We have identified how millions of concepts are represented inside Claude Sonnet, one of our deployed large language models. This is the first ever detailed look inside a modern, production-grade large language model.

I often see a lot of people with outdated understanding of modern LLMs.

This is probably the best interpretability research to date, by the leading interpretability research team.

It’s worth a read if you want a peek behind the curtain on modern models.

  • @General_EffortEnglish
    4•7 months ago

    Those aren’t the basics, though. That’s how saying it’s statistics is misleading. A Bayesian network is not a neural network.