For Tarot, did you generate base-color, roughness and normal maps? How do you make sure something like the roughness map doesn't deviate slightly from the base-color?
But basically diffui's build step provides an API to create normal/roughness/depth maps from images. It's essentially an interface to fal.ai's Patina model, which does a really good job at creating those.
The one thing that's missing with it though is metalness maps (Patina can theoretically output them, but they only have a ~10% success rate I've found). I'm trying to train my own diffusion model now to help generate those so the reflectivity isn't fully uniform. I just posted very, VERY early results here - right now my model has around a ~25% succes rate: https://x.com/pwnies/status/2082980850120163756
Yea. I have a very speed run version of how I made that one here: https://x.com/pwnies/status/2076755344471289898
But basically diffui's build step provides an API to create normal/roughness/depth maps from images. It's essentially an interface to fal.ai's Patina model, which does a really good job at creating those.
The one thing that's missing with it though is metalness maps (Patina can theoretically output them, but they only have a ~10% success rate I've found). I'm trying to train my own diffusion model now to help generate those so the reflectivity isn't fully uniform. I just posted very, VERY early results here - right now my model has around a ~25% succes rate: https://x.com/pwnies/status/2082980850120163756