We've been doing this for a long time now, it's similar to using a depth map or a line drawing to control the silhouette.