Jim Keller goes into some detail about what difference the ISA makes in general in this clip https://youtu.be/yTMRGERZrQE?si=u-dEXwxp0MWPQumy

Spoiler, it's not much because most of the actual execution time is spent in a handful of basic OPs.

Branch prediction is where the magic happens today.