alt Hacker NewsI wonder what the "waves" in LLMs are; The global firing patterns that can help us interpret what the weights are doing en-masse
Replies
tomrod • today at 8:05 PM
I thought this research had already been done and published by Anthropic. https://www.anthropic.com/research/tracing-thoughts-language...
Care to define 'waves' in this context?
I suspect, if our conscious experience === the waves created by neuron's firing, that the hum of the GPU when running a LLM doesn't have the dynamic range to meaningfully talk about having a conscious experiences.
But that's armchair conjecturing.