> You can be catholic and not like the pope
You can be christian and not like the pope.
But to catholics, the pope is the terrestrial embodiment of the holy spirit, and as such considered infaillible. Not recognizing the pope as such is incompatible with catholicism.
Papacy is a core part of catholicism, it's not a "pick and choose buffet".
> and as such considered infaillible
This is a common misconception. The pope is only considered as speaking infallibly by the Catholic Church when speaking ex cathedra on matter of faith and morals. This is very rare and is considered to only have happened twice in history.