How does more pollution/waste equal higher consumer cost? Do you mean because we'll have to pay more taxes because we'll need more publicly funded resources to clean up the excess waste? Or because corporations would pass the price of the fines for violating environmental regulations onto consumers?
It doesn't matter much how exactly those costs are passed on; someone has to eventually pay for them. That includes the energy itself, which doesn't come for free, but also the bill for environmental damage and resource exhaustion that we will have to pay at some point. You can argue that that'll be the case only in the far future, but then you're just externalising the cost—again—to future generations. It's all moot: Someone will pay for it eventually.