logoalt Hacker News

jcelerier • today at 4:39 PM • 1 reply • view on HN

I'd like to look into adding it to https://github.com/jcelerier/librediffusion for real time inference using tensorrt, do you think it's worth trying?


Replies

dvrp • today at 4:57 PM

We’ve tried a lot of inference techniques but we’re not a real-time level yet (and believe us, we’ve done real time models!).

We’d like to open-source it soon (it’s just that it’s another can of worms - that we already went thru for Krea 2), precisely for people to try things like this. The Krea 2 community efforts have been incredible to watch from the inside.

Once Krea 3 is open, you should def try!