For me coffee is all about the taste. I'm having my coffee lab with two grinders, a V60, a scale, and Cafelat Robot to brew the best possible coffee I can get. We have multiple good coffee roasters in our city, and I'm mostly getting very light roasts with lots of complex sugars in the bean. I drink two cups a day: one filter coffee in the morning and one espresso after lunch.
I can't imagine drinking bad coffee only for the caffeine.
You can drink good coffee for the caffeine, too. I think anyone (not necessarily saying that's you) saying it's only about the taste and has nothing to do with caffeine is fooling themselves. The reason you were able to trick yourself into liking this bitter stuff is because it gets reinforced with caffeine.