Similar situation. I have no doubt that a large fraction of my childhood memories are fabricated, but there were a few that I kept to myself until I was over the age of 30 and were later confirmed by a parent or aunt or uncle.

There's also the phenomenon of having a memory of a memory. At age 10, I had a very solid recollection of my life at ages 5 to 6 (not so much of age 4). Now all I remember is that I used to remember a lot more than I do know.