An RTX4090 or a 128gb macbook can generate a pretty reasonable number of tok/sec. Those are not cheap, but within the realm of serious hobbyist. I really hope the AI bubble deflates a bit so consumers can get more powerful hardware at the low thousand $ range.