My problem with it is that I want to use C libraries. And I would (like) it to handle that as much as possible. But SPM can't use vcpkg packages or call CMake stuff (at least, not trivially), so it's extremely hard to use on non-Apple platforms. Which honestly is it's killer for me. It's still so, so Apple focused.
I think cmake very recently got added to spm
You can build Swift entirely with CMake;
https://github.com/swiftlang/swift-cmake-examples