FWIW stable-diffusion.cpp[0] (which implements a lot more than just stable diffusion, despite the name) is already a MIT licensed C++ library.

[0] https://github.com/leejet/stable-diffusion.cpp/