I think a big reason why cruising sailors would remove the labels is that there's a belief that cockroaches & other bugs would lay eggs in the paper / glue [0], and having an infestation on a sailboat is then challenging to deal with while at sea.

[0] https://www.spinsheet.com/cruising/sailors-offer-tips-long-t...