logoalt Hacker News

Zero-Copy GPU Inference from WebAssembly on Apple Silicon

71 pointsby agambrahmayesterday at 10:46 PM27 commentsview on HN

Comments

nltoday at 6:46 AM

I'm pretty sure this is just "yes (parts of), memory control in WASM works"[1].

The whole Apple Silicon thing is (in this case) just added details that don't actually matter.

[1] https://github.com/WebAssembly/memory-control/blob/main/prop...

show 1 reply
saagarjhatoday at 2:27 AM

I'm curious what this offers over just building the host side code to be native?

show 1 reply
fulafeltoday at 6:52 AM

> Apple Silicon changes the physics. The CPU and GPU share the same physical memory (Apple's Unified Memory Architecture) ... no bus!

Beware the reality distortion field: This is of course how it's worked on most x86 machines for a long time. And also on most Macs when they were using Intel chips.

show 1 reply
truenotoday at 1:00 AM

> on Apple Silicon, a WebAssembly module's linear memory can be shared directly with the GPU: no copies, no serialization, no intermediate buffers

enhance

> no copies, no serialization, no intermediate buffers

would it kill people to write their own stuff why are we doing this. out of all the things people immediately cede to AI they cede their human ability to communicate and convey/share ideas. this timeline is bonkers.

show 3 replies
pjmlptoday at 5:01 AM

Goodbye WebAssembly "security".

Also, these folks should be amazed by 8 and 16 bit games development, or games consoles in general.

wmftoday at 12:58 AM

This works in wasmtime not browsers.

show 1 reply
EthanFrostHItoday at 3:48 AM

[flagged]