Getting the grams right goes a long way. At the end of the day, you're trying to approximately measure the caloric density per gram, and maybe macros (proportion protein / fat / carbs). You're thinking in way too fine detail for it to be sustainable. Even with a lax approach, it is pretty tedious.

I wouldn't really recommend tracking long-term, but doing it for a week or so just to get a sense of how much you're currently consuming is a good idea.