>I think a big reason for this is that PDF editing tools are just pretty terrible.

Inkscape is a pretty good tool to edit .pdfs

when you import a regular .pdf, it needs to convert it once, and once saved, you can edit the pdf and work on it as if it was a regular .svg

if you choose to embed the fonts when saving, .pdf files becomes easy to work on, you don't even need to export them.