I'm doing something similar but not for the whole family, just for myself, both for home stuff and for work stuff (seperated), but I just give pi access to the tools and accounts I want it to use. I don't use google for anything other than watching YouTube so it would not work for me anyway. I have a knowledge base git repo which the agents use together to do things. The PDF filling thing is especially cool with a KB in the background because the Agent can fill in 99% of the things by itself. It also organizes my todo lists and my calendar.