Huh. I wrote a whole thing here about serving a niche in serving local LLMs, but turns out, any niche it could have served is probably better served (per dollar) by either more RAM or modern SSDs.

There's an argument to be made for the persistent memory being a cheaper substitute for more RAM, but imo the gap isn't big enough to justify it when considered as a % of the rest of the system you're building around it and the performance tradeoff.

Important reminder to check your biases. I was sure Optane had missed its mark by dropping out just before LLMs became a primary use case for high $ systems.