logoalt Hacker News

TechSquidTVtoday at 2:42 AM3 repliesview on HN

This still requires 128Gb of memory, right? Me and my lowly 96Gb, like a commoner; missing out on the fun.


Replies

embedding-shapetoday at 9:40 AM

It shouldn't? Unless you're using BF16 for all weights (I'm using NVFP4 for the text encoder, otherwise everything BF16 (and audio F32)) you'll fit it all within 96GB VRAM, bugs non-with-standing :) I've been fitting this within 96GB VRAM without issues.

pferdonetoday at 9:39 AM

you should have a look at https://github.com/deepbeepmeep/Wan2GP which is the goto tool for "gpu poor", although as people below already pointed out you should be fine with comfyui's standard setup aswell

show 1 reply
thehamkercattoday at 2:46 AM

From README:

> On the 128 GB M5 Max, clean end-to-end image+audio and embedded-video+audio renders completed in 74.58 and 76.99 seconds respectively, each with about a 40.1 GB peak physical footprint and zero swaps.

Looks like it uses 40GB? So your 96GB mac setup should work fine i guess (Model itself is 33B)

show 1 reply