There's plenty of small businesses in Japan that straight-up ask you to leave at the door if you look foreign, despite being fluent.

A lot of landlords refuse to rent to any non-Japanese people, despite being fluent.

A xenophobic society won't even let you participate fully, much less integrate, no matter how well you speak the language.