I’ve also struggled with the “not enjoying something because I suck at it” problem, and it’s a tough one. The answer is to remove expectations, but much easier said than done.
That said, I wonder if doing it with other people who suck would help. I started playing ice hockey as an adult, and the thing that got me over the initial hump of being completely useless was doing lessons with other newbies in my exact shoes (or skates) rather than trying to go right to full speed games.