Why use electricity alone for open models? Surely you’d want to spread the cost of hardware over the period too?
I think the key there is “hardware you already own.”
If you own a graphics card you bought for gaming or a laptop you bought for doing schoolwork there is $0 in cost of local AI tokens, because 100% of the cost was assigned to doing other things.
alt Hacker News
I think the key there is “hardware you already own.”
If you own a graphics card you bought for gaming or a laptop you bought for doing schoolwork there is $0 in cost of local AI tokens, because 100% of the cost was assigned to doing other things.