Absolutely, that reduces your surface area more than anything else, but at an enormous cost to ergonomics.

Some of us are still fighting for docker images to not include a vim install ("but it's so handy!") and here we've got madlads building their app as its own bootable machine image.