I think the problems arise from using glue on it.

If I only print PLA without glue, one wipe with IPA and it's clean.

Glue on the other hand, it really sticks and you need water and soap.