This is a very cool demo! Well done!
One suggestion for fixing the cursor drift during finger taps is instead of using hand position, use index finger. Then tap the middle finger to the thumb for selection. Since this doesn’t change the cursor position, yet is still a comfortable and easy to parse action.
Thanks Herman, glad you enjoyed it! I agree with your suggestion, having the middle finger + thumb for tap and index finger for the movement will mitigate the cursor drift. The only reason I used index finger + thumb is so that it is like the Apple Vision Pro input. But definitely could be an improvement.
Unrelated, but shoutout to bearblog. My first blog was on bearblog, which made me start writing. Although I later ended up self-hosting my own blog.