alt Hacker NewsYou can take the weights and model description, write them down on a notebook, then, by hand, compute the next token. Try to do the same with meat.
You can take the weights and model description, write them down on a notebook, then, by hand, compute the next token. Try to do the same with meat.
Probably pretty similar. Weights are how many synapses there are between neurons. Temperature is whatever hormonal chemical mix is going on at the moment. Inputs tokens are electrical signals from our senses. Output tokens are thoughts, muscle movements. How you’re raised and your interactions with society are the RLHF. Some people are born with a GB300 while others have an L40S and lower token/sec output rates…