The issue is that someone can look over your shoulder and memorize your code, if you use a pin in public.
Some people will use the same pin for screen lock and BankID, and if someone gets their code and their phone they can cause a huge amount of trouble in a very short time.
That's just their fault at that point, in my opinion.