Thanks to @[email protected] for the links!
Here’s a link to Caltech’s press release: https://www.caltech.edu/about/news/thinking-slowly-the-paradoxical-slowness-of-human-behavior
Here’s a link to the actual paper (paywall): https://www.cell.com/neuron/abstract/S0896-6273(24)00808-0
Here’s a link to a preprint: https://arxiv.org/abs/2408.10234
From a cursory glance it seems at least quite close to the definition of a bit in relation to entropy, also known as a shannon.
If it’s not re-defining the term then I’m using it like the paper is defining it.
Because just understanding words to respond to them, ignoring all the sub-processes that are also part of “thought” and directly impact both your internal narration and your actual behavior, takes more than 10 bits of information to manage. (And yeah I do understand that each word isn’t actually equally likely as I used to provide a number in my rough version, but they also require your brain to handle far more additional context than just the information theory “information” of the word itself.)