I'm pretty sure what Decart is building does exactly what you want.

I saw a demo - it took you, put a piece of clothing on you, and showed in realtime how that clothing moved on your body in the size you'd selected. I think it even picked the size.