logoalt Hacker News

LatencyKillstoday at 8:53 AM4 repliesview on HN

I've been working on a utility that lets me "see through" app windows on macOS [1] (I was a dev on Apple's Xcode team and have a strong understanding of how to do this efficiently using private APIs).

I wondered how Claude Code would approach the problem. I fully expected it to do something most human engineers would do: brute-force with ScreenCaptureKit.

It almost instantly figured out that it didn't have to "see through" anything and (correctly) dismissed ScreenCaptureKit due to the performance overhead.

This obviously isn't a "frontier" type problem, but I was impressed that it came up with a novel solution.

[1]: https://imgur.com/a/gWTGGYa


Replies

Yizahitoday at 12:36 PM

Was it a novel solution for you or for everyone? Because that's a pretty big difference. A lot stuff novel for me would be something someone had been doing for decades somewhere.

show 1 reply
skctoday at 9:18 AM

That's actually pretty cool. What made you think of doing this in the first place?

show 1 reply
saagarjhatoday at 10:21 AM

Why is ScreenCaptureKit a bad choice for performance?

show 1 reply
stavrostoday at 9:12 AM

What was the solution?

show 1 reply