Pedantry would be pointing out the extensive history of "you guys" as being non-gendered and that even dictionaries say that is what it means. Anyone misinterpreting a word or phrase by using their own made up non-standard definition of it is, at best, assuming the absolute worst about someone's intention without any cause. If people feel excluded by the phrase it's an entirely self-inflicted wound.
And yet despite centuries of use of singular they/them pronouns, people respond the same way when they encounter them. Presumably you are comfortable with singular they, given its long and frequent use?