I haven't seen much if anything saying webp itself is annoying directly, and your conclusion agrees with what I've seen. The complaining I've seen is about the tooling available (mainly from non-techies who don't care to know how to convert to another image format because, and I agree, why should they?) that once you've got a webp image file from one site the next site you try to upload it to doesn't accept them. For those of us who can convert the tooling has been there for ages, as have editors happy to load and save the format.

Though TBH I still use JPEG, PNG, or GIF, depending on use case, out of habit. The size saving for the same quality of lossy compression is not something I've found myself hankering for. It is different if you run a site that sends out millions of every image, but nothing I do is that popular and is never likely to be, and no one stuck on a really slow connection where the difference would matter to them is going to be accessing my stuff.