logoalt Hacker News

bartread • today at 4:12 PM • 2 replies • view on HN

The thing is, it's not actually that hard to spend at that kind of rate.

I wouldn't say this was the norm, but I have burned through £1k of tokens in a couple of days before. And, on that same gig, I realised a test I was considering running would burn £2.5k worth of tokens over the course of a few hours so spent a couple of hours of my own time re-engineering it to get that down to £150.

The point is that I don't necessarily know that spending a shitload of money on tokens really tells us anything useful. If he's getting a return on that investment, fine, whatever.

Obviously most of us couldn't afford to spend that much ourselves, no matter how much value it might deliver, and many of our employers wouldn't be too happy if we spent it on their dime either. Equally, if you can, and it's delivering real value, then I don't see why you wouldn't?


Replies

plusfour • today at 4:29 PM

> would burn £2.5k worth of tokens over the course of a few hours

details please, if it's interesting

➕ show 2 replies
nodesocket • today at 4:54 PM

At what point do you buy a Mac studio or AMD Gorgon Halo and try running some of these tasks in local models? Surely don’t need frontier models for all this work.