I believe some clients (dhcpcd, networkd) also do the check on their side, so it's possible that they reject the lease and ask for a new one if it's in use.