That's so funny: I also first started to realize I had aphantasia during a period when I was taking chess very seriously during university. Unlike even lesser skilled peers, it was so difficult for me to understand games written out in chess books without playing them out on the board and I couldn't understand why...
Experiences like that are how I understand the question of 'shame' relating to aphantasia and the importance of 'diagnosis'/understanding how your mind actually works. 'Diagnosis' just helps you understand how to adapt and prevents you from slamming your head against approaches that won't work no matter how hard you try.
Similarly on sleep, I can sleep anywhere anytime with little effort and always tell my wife, who often has insomnia, "just close your eyes until you sleep" to her frustration.
What's really remarkable is how similar the life experiences are of most who have aphantasia...