I'm in the same boat. My phone is used to record 'memories', but I rarely ever look at the shots I capture with it. I'd probably be better off dropping this habit.
My camera is for art, and in my mind this an entirely different thing than recording stuff with my phone. These are as different as using writing utensils to briefly write notes vs. using them to make a complex drawing.