I would add some lerp-smoothing to the position of the cursor/touch, since it's a bit rigid. Click-drag-release often doesn't result in a fling but rather a sharp drop.

Lovely idea by the way.