logoalt Hacker News

conceptionyesterday at 9:47 PM1 replyview on HN

150k by account. At 1.5k a second you hit it very quickly.


Replies

devyyesterday at 9:59 PM

Exactly, it burns the tokens 3000x faster, which means the budget ($$$$$$) runs out so faster it will stop super quick, not able to perform long-duration work. At 27B parameter size, the intelligence is not able to accomplish work within a short amount time. Consequently, it become not usable.

show 1 reply