Another option is renting cloud GPUs only when you need them. A server with 8x B200 is around $32/hr.
Obviously depends on the use case and threat model, but that hardware is publicly available at far less than $500k upfront.