

We don’t know this. In some respects there is an idea sitting underneath, because the model has a metric fuckton of latent space state that changes as it processes text. We don’t know how thoughts or consciousness arise, so for all we know it is entirely possible that there’s flickers of consciousness happening in the matrix that makes up an LLM every time the model iterates.
So, if someone made all calculations by hand, using pen and paper, to produce the llm output, would that make sense to think about some form of consciousness arising somewhere? Perhaps in the paper? In the pen? In the person’s brain, as a hosted virtual conscience?






That map was clearly requested by an emperor penguin