the question is, where does that feeling come from? from your own time growing up, based on how your own father interacted with you? from your friends/peers? others?
i can relate. when my kids were young i didn't know what to do with them. but it's not that i didn't like spending time with them. before we had kids, working part-time so i could spend a lot of time at home was my dream. it was what i wanted. when the dream became real my inability to initiate play with the children was unexpected.
i figure it was because i had no rolemodels from my time growing up, no childhood experience that i could replicate because i grew up with a single dad who wasn't as close to me as i wanted to. every interaction was initiated by my children. it got easier as they got older because our interests became more compatible. (we could play games together that i also enjoyed, etc)
all the other stuff, taking care of them, feeding, putting them to sleep, etc. was easy because it's clear what needs to be done. and it wasn't/isn't exhausting either. i relish every interaction and moments of success where we achieve something together.