They're more fun. The programming is easier (although you can get an Arduino like experience on a ESP32). They have 5V options, which make some projects easier without having to add additional components. The ESP32 API (and the Pico for that matter) are better suited professional programmers.
An Arduino is better if you're doing something and want a quick, easy, simple to program controller. It started as a way for artists to add MCUs to the projects without having to become embedded programmers.
Ain't fun spending $40 for a 'fun' project. ESP32 is like a dollar for WiFi and GPIOs. That's fun.
For what it’s worth, the original ESP32 is actually 5V tolerant, semi-officially acknowledged by Espressif. Good enough for hobby projects, anyway
I've only ever used my ESP32s with the Arduino IDE. I don't think there's anything "easier" about using an Arduino board vs that experience.