For $50 you can pick up a used mini PC with say, i5-6500T and 8GB ram, that'll be much faster than the Pi 5. And it'll be compatible with all Linux distros. Really the Pi 3 is good enough as an edge device where you want to hook up things to the GPIO pins.
But a PC like what you’re suggesting would result in a much higher energy bill compared to a Pi if you leave it on 24/7 to use as a server.
At a huge boost in power consumption and space.