Well, thermodynamics is considered pretty fundamental, and the second law of thermodynamics is pretty much all about information. (But your link already touches that.)

People also interpret the 'unitarity' of quantum mechanics to mean that information is preserved.