Compared to buying from parts? No.

Compared to an average prebuilt? You can probably find large tower PCs at a lower price, but they'll likely have a low quality motherboard or power supply.

Compared to an average prebuilt that ships with Linux? Absolutely