The thing is a lot of these rural areas were farms before 1950 or if we got back further before even the Meji Restoration in Japan.
It's actually more of a recent phenomenon that a lot these small villages and towns now becoming basically vacant in Japan.
People have been in Japan for many thousands of years at this point.