Your body produces lactase, an enzyme that breaks down lactose. People who are lactose intolerant are unable to produce lactase and therefore, unable to break down lactose. Gut bacteria can break down lactose and perhaps if you drink milk all the time, those bacteria proliferate but loactose intolerance is no fun. It's better to just skip milk altogether.

https://en.wikipedia.org/wiki/Lactase