logoalt Hacker News

g413nlast Monday at 5:49 PM1 replyview on HN

what's the basis for conversion between hours of neural data to number of tokens? is that counting the paired text tokens?


Replies

rio-popperlast Monday at 5:53 PM

edit: oops sorry misread - the neural data is tokenised by our embedding model. the number of tokens per second of neural data varies and depends on the information content.