alt Hacker NewsDecent storage is $10/TB, so for $10,000 you could just keep the entire 1PB of data.
A rather obvious question is if someone has trained an LLM on this archive yet.
Decent storage is $10/TB, so for $10,000 you could just keep the entire 1PB of data.
A rather obvious question is if someone has trained an LLM on this archive yet.
A rather obvious answer is Meta is currently being sued for training Llama on Anna's archive.
You can be practically certain that every notable LLM has been trained on it.