try ninfer once you get your 5090 https://github.com/Neroued/ninfer