It sounds like your address isn't listed correctly in the UK Postcode Address File (PAF).[0] There's a form you can fill in requesting a correction.[1]

[0] https://en.wikipedia.org/wiki/Postcode_Address_File [1] https://www.royalmail.com/personal/receiving-mail/update-you...