Crazy to see 2 of my niche interests interact. Great idea, you could extent the idea to use example based texture synthesis, such as Image Quilting https://www.merl.com/publications/docs/TR2001-17.pdf