The broader concern seems to be “outsiders taking our jobs/raising house prices/voting in elections” etc etc. Anything perceived to be done by “outsiders” is an issue.
Americans/British saying this about non-white immigrants. Switzerland about Europeans. India saying it about Bangladeshi migrants.
It’s like people dislike others who are worse off them.
No it's people disliking importing the cultures and problems that made those people worse off in the first place.